Skip to content

feat: add experimental dependency-aware workflow batching - #149

Draft
baszalmstra wants to merge 1 commit into
RoboStack:masterfrom
baszalmstra:experimental/workflow-batching
Draft

feat: add experimental dependency-aware workflow batching#149
baszalmstra wants to merge 1 commit into
RoboStack:masterfrom
baszalmstra:experimental/workflow-batching

Conversation

@baszalmstra

Copy link
Copy Markdown
Collaborator

The generated GitHub Actions workflows use stage-wide barriers, so unrelated jobs can sit idle or get blocked by a failure in the previous stage.

This adds an opt-in dependency-aware batching strategy with exact needs edges, finite-runner scheduling, failure-isolation heuristics, and weights derived from recipe backends or historical Actions timings. The existing strategy remains the default.

This is an experiment for validating the scheduling model on ros-jazzy before changing any defaults.

Tested with pixi run pytest vinca/ -q (195 tests), Ruff, and the real Jazzy dependency graph.

@baszalmstra

Copy link
Copy Markdown
Collaborator Author

This is the generated graph:

https://github.com/baszalmstra/ros-jazzy/actions/runs/33676183670

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant