Skip to content

[SPARK-57327][INFRA] Move scheduled CIs for 4.1 to branch-4.1#56379

Closed
gaogaotiantian wants to merge 2 commits into
apache:masterfrom
gaogaotiantian:decouple-branch41-scheduler
Closed

[SPARK-57327][INFRA] Move scheduled CIs for 4.1 to branch-4.1#56379
gaogaotiantian wants to merge 2 commits into
apache:masterfrom
gaogaotiantian:decouple-branch41-scheduler

Conversation

@gaogaotiantian

@gaogaotiantian gaogaotiantian commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Add a unified entry for all scheduled CIs for branch-4.1 (branch41_scheduler.yml). It uses gh workflow to trigger the self-contained build workflows on branch-4.1, and removes the per-build build_branch41_*.yml files from master.

This follows the same approach as SPARK-56990 (#56046), which did this for branch-4.x. SPARK-57267 (#56330) already laid the ground on branch-4.1 by making the build workflows self-contained and dispatchable, so this PR only needs to change the master scheduled tasks.

The scheduler triggers the following targets on branch-4.1 (also exposed via workflow_dispatch): build_java17, build_java21, build_maven, build_maven_java21, build_non_ansi, build_python_3.11, build_python_3.14, build_python_pypy3.10. Note this differs from the branch-4.x set: there is no java25 build on branch-4.1, and branch-4.1 additionally has a pypy3.10 build. The cron times are spread out and chosen to avoid the hours already used by the branch-4.x scheduler.

README.md is updated so the branch-4.1 badges point at the self-contained workflows filtered by ?branch=branch-4.1.

Why are the changes needed?

This is part of decoupling our CIs. All branch-4.1 related CIs should only rely on files on branch-4.1, with the exception of this new scheduler file which is needed on master to trigger scheduled tasks (scheduled workflows only fire from the default branch).

Does this PR introduce any user-facing change?

No. CI only.

How was this patch tested?

These workflows can be triggered manually via workflow_dispatch once merged.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Code (Claude Opus 4.8)

Add a unified scheduler on master for all scheduled CIs for branch-4.1, and remove the per-build branch-4.1 workflow files.

Co-authored-by: Isaac
…ter for badge rendering

Co-authored-by: Isaac
@gaogaotiantian

Copy link
Copy Markdown
Contributor Author

Merged to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants