Skip to content

[SPARK-57483][INFRA] Move scheduled CIs for 4.0 to branch-4.0#56530

Open
gaogaotiantian wants to merge 2 commits into
apache:masterfrom
gaogaotiantian:decouple-branch40-scheduler
Open

[SPARK-57483][INFRA] Move scheduled CIs for 4.0 to branch-4.0#56530
gaogaotiantian wants to merge 2 commits into
apache:masterfrom
gaogaotiantian:decouple-branch40-scheduler

Conversation

@gaogaotiantian

@gaogaotiantian gaogaotiantian commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Add a unified entry for all scheduled CIs for branch-4.0 (branch40_scheduler.yml). It uses gh workflow to trigger the self-contained build workflows on branch-4.0, and removes the per-build build_branch40_*.yml files from master.

This follows the same approach as SPARK-56990 (#56046) for branch-4.x and SPARK-57327 (#56379) for branch-4.1. SPARK-57398 (#56461) already laid the ground on branch-4.0 by making the build workflows self-contained and dispatchable, so this PR only needs to change the master scheduled tasks.

The scheduler triggers the following targets on branch-4.0 (also exposed via workflow_dispatch): build_java17, build_java21, build_maven, build_maven_java21, build_non_ansi, build_python_3.11, build_python_pypy3.10. Note this differs from the branch-4.1 set: there is no python_3.14 build on branch-4.0. The cron schedule preserves the original times and */4 frequency from the build_branch40_*.yml files (the Java 17 and Python 3.11 builds share 0 12, and the Maven and Maven Java 21 builds share 0 14, as before).

README.md is updated so the branch-4.0 badges point at the self-contained workflows filtered by ?branch=branch-4.0.

Why are the changes needed?

This is part of decoupling our CIs. All branch-4.0 related CIs should only rely on files on branch-4.0, with the exception of this new scheduler file which is needed on master to trigger scheduled tasks (scheduled workflows only fire from the default branch).

Does this PR introduce any user-facing change?

No. CI only.

How was this patch tested?

These workflows can be triggered manually via workflow_dispatch once merged.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Code (Claude Opus 4.8)

This pull request and its description were written by Isaac.

Add a unified entry for all scheduled CIs for branch-4.0 (`branch40_scheduler.yml`), and remove the per-build `build_branch40_*.yml` files from `master`.

Co-authored-by: Isaac
Restore the original `*/4` cron frequency and hours from the per-build
`build_branch40_*.yml` files instead of switching to `*/2`.

Co-authored-by: Isaac
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant