[SPARK-57327][INFRA] Move scheduled CIs for 4.1 to branch-4.1#56379
Closed
gaogaotiantian wants to merge 2 commits into
Closed
[SPARK-57327][INFRA] Move scheduled CIs for 4.1 to branch-4.1#56379gaogaotiantian wants to merge 2 commits into
gaogaotiantian wants to merge 2 commits into
Conversation
Add a unified scheduler on master for all scheduled CIs for branch-4.1, and remove the per-build branch-4.1 workflow files. Co-authored-by: Isaac
…ter for badge rendering Co-authored-by: Isaac
zhengruifeng
approved these changes
Jun 9, 2026
dongjoon-hyun
approved these changes
Jun 9, 2026
Contributor
Author
|
Merged to master. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
Add a unified entry for all scheduled CIs for branch-4.1 (
branch41_scheduler.yml). It usesgh workflowto trigger the self-contained build workflows onbranch-4.1, and removes the per-buildbuild_branch41_*.ymlfiles frommaster.This follows the same approach as SPARK-56990 (#56046), which did this for
branch-4.x. SPARK-57267 (#56330) already laid the ground onbranch-4.1by making the build workflows self-contained and dispatchable, so this PR only needs to change themasterscheduled tasks.The scheduler triggers the following targets on
branch-4.1(also exposed viaworkflow_dispatch):build_java17,build_java21,build_maven,build_maven_java21,build_non_ansi,build_python_3.11,build_python_3.14,build_python_pypy3.10. Note this differs from thebranch-4.xset: there is nojava25build onbranch-4.1, andbranch-4.1additionally has apypy3.10build. The cron times are spread out and chosen to avoid the hours already used by thebranch-4.xscheduler.README.mdis updated so the branch-4.1 badges point at the self-contained workflows filtered by?branch=branch-4.1.Why are the changes needed?
This is part of decoupling our CIs. All
branch-4.1related CIs should only rely on files onbranch-4.1, with the exception of this new scheduler file which is needed onmasterto trigger scheduled tasks (scheduled workflows only fire from the default branch).Does this PR introduce any user-facing change?
No. CI only.
How was this patch tested?
These workflows can be triggered manually via
workflow_dispatchonce merged.Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Claude Opus 4.8)