Skip to content

[plan] Audit failing workflows and improve validation messages #8058

Description

@github-actions

Objective

Investigate why 46 out of 172 workflows (26.7%) fail compilation and improve validation error messages to be more actionable.

Context

The current 73.3% compilation success rate suggests either intentional test fixtures, validation issues, or unclear error messaging. Improving this will directly impact developer iteration speed.

Approach

  1. Run compilation audit on all 172 workflows
  2. Categorize each failure into:
    • Intentional test fixtures
    • Deprecated/archived workflows
    • Validation errors needing better messages
    • Actual bugs
  3. Move intentional test fixtures to dedicated test directory or mark clearly
  4. Archive or remove deprecated workflows
  5. Identify top 5 most common validation error patterns
  6. Enhance error messages with "how to fix" guidance
  7. Document expected compilation success rate in DEVGUIDE.md

Files to Modify

  • .github/workflows/*.md (failing workflows - categorize and organize)
  • pkg/workflow/validation.go (enhance error messages)
  • pkg/workflow/compiler.go (improve error context)
  • DEVGUIDE.md (document expected success rate)

Example Error Enhancement

Before: invalid network configuration

After: invalid network configuration: 'allowed' must be a list of domains. Try: allowed: ['api.github.com']

Acceptance Criteria

  • All 46 failing workflows categorized with documented reasons
  • Intentional test fixtures moved to dedicated test directory or clearly marked
  • Deprecated workflows archived or removed
  • Top 5 validation error patterns identified
  • Error messages for top 5 patterns enhanced with actionable recovery guidance
  • Expected compilation success rate documented in DEVGUIDE.md
  • Compilation success rate improved (target: >90%)

AI generated by Planning Assistant for #7631
Related to #8056

AI generated by Plan Command for discussion #7631

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions