Build / Java21 (master, Scala 2.13, Hadoop 3, JDK 21) #1026
build_java21.yml
on: schedule
Run
/
Check changes
1m 0s
Run
/
Protobuf breaking change detection and Python CodeGen check
1m 17s
Run
/
Java 17 build with Maven
Run
/
Java 25 build with Maven
Run
/
Run TPC-DS queries with SF=1
1h 23m
Run
/
Run Docker integration tests
1h 41m
Run
/
Run Spark on Kubernetes Integration test
1h 4m
Run
/
Run Spark UI tests
35s
Matrix: Run / build
Run
/
Build modules: sparkr
25m 10s
Run
/
Linters, licenses, and dependencies
0s
Run
/
Documentation generation
0s
Matrix: Run / pyspark
Annotations
20 errors and 20 warnings
|
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
/tmp/tmp.bHa25ymCUB/lib/python3.11/site-packages/pyspark/jars/hadoop-client-api-3.4.3.jar
|
|
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-24703b55bcd94a68b7fb2870c1561f4d-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-24703b55bcd94a68b7fb2870c1561f4d-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
|
|
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-e1e7fa9cf00336d5-exec-1".
|
|
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-ff19ef9cefff9932-exec-1".
|
|
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-fc81569ceffeb1fe-exec-1".
|
|
Run / Run Spark on Kubernetes Integration test
sleep interrupted
|
|
Run / Run Spark on Kubernetes Integration test
sleep interrupted
|
|
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-40975c9cefeb2f0d-exec-1".
|
|
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-73a4629cefea49ac-exec-1".
|
|
Run / Build modules: core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant
Process completed with exit code 18.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Run / Base image build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: docker/build-push-action@v6, docker/login-action@v3, docker/setup-buildx-action@v3, docker/setup-qemu-action@v3. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Protobuf breaking change detection and Python CodeGen check
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: bufbuild/buf-breaking-action@v1, bufbuild/buf-lint-action@v1, bufbuild/buf-setup-action@v1. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sparkr
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: yarn
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: hive - slow tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: mllib-local, mllib, graphx, profiler, pipelines
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-structured-streaming, pyspark-structured-streaming-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: api, catalyst, hive-thriftserver
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: hive - other tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sql - extended tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Run TPC-DS queries with SF=1
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sql - slow tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Run Docker integration tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sql - other tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
apache~spark~RFYR7U.dockerbuild
|
25.9 KB |
sha256:1fd90216d89dfe4e41192c0743317ff34de8c76bc48cfa7fe83877d9d362dfb7
|
|
|
apache~spark~S1VMG0.dockerbuild
|
31 KB |
sha256:e425ab42bf7024abff8ef3a3ee795bd840622292ef95bd3d36dda8b497f5cc6e
|
|
|
test-results-api, catalyst, hive-thriftserver--21-hadoop3-hive2.3
|
720 KB |
sha256:ac7a98f9ca07be301641fcb26e232fb49d1ee35384ce6e9b3c4679a39f7e202e
|
|
|
test-results-core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant--21-hadoop3-hive2.3
|
807 KB |
sha256:9346fa45463c9717f0461eac36dd38d06c81ded955d25ca873d16c365e6095ee
|
|
|
test-results-docker-integration--21-hadoop3-hive2.3
|
53.2 KB |
sha256:76751a64a16bcb8e7c727037f17d8818c28c787f3b0d42a9e786217e27c0a892
|
|
|
test-results-hive-- other tests-21-hadoop3-hive2.3
|
240 KB |
sha256:e6741627e8e68f208b766fa28cd504186b8ad904e06d34f8e894a121fb647a96
|
|
|
test-results-hive-- slow tests-21-hadoop3-hive2.3
|
230 KB |
sha256:d0d8ce43166e7225f5c7b129b2ab5ae65809484375d2652687943da1d058576a
|
|
|
test-results-mllib-local, mllib, graphx, profiler, pipelines--21-hadoop3-hive2.3
|
501 KB |
sha256:c46e291cd02ba7d8a20a2580d46dfbb6e732b245d8903e393eb11fcfd08ec054
|
|
|
test-results-pyspark-connect--21-hadoop3-hive2.3-python3.11
|
202 KB |
sha256:c34c7cb0d671adcbb9aef1fdd4523ae2c9a59f4a8c77f44caa0cb3bf35cab42f
|
|
|
test-results-pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger--21-hadoop3-hive2.3-python3.11
|
46.1 KB |
sha256:d0d987a31b365a2b3e8d7615cb8e7b808c25ae637c0c7817e9cfdf1ed9f8c9cf
|
|
|
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines--21-hadoop3-hive2.3-python3.11
|
101 KB |
sha256:3f2aed4771523f0eb29c04af98bc2fb5fe00efdcaa864316df1ee3b179f3db0f
|
|
|
test-results-pyspark-sql, pyspark-resource, pyspark-testing--21-hadoop3-hive2.3-python3.11
|
205 KB |
sha256:091005d693dbe63b4f8f261c03e1c8c3eb9fde7e103886e1103e8ce8582b3e48
|
|
|
test-results-pyspark-structured-streaming, pyspark-structured-streaming-connect--21-hadoop3-hive2.3-python3.11
|
31.2 KB |
sha256:22e17ffde744349c59202bdb2e2ab6533d1f022d8c12167654effd907c8afbcd
|
|
|
test-results-sparkr--21-hadoop3-hive2.3
|
17.1 KB |
sha256:c1431411afd695f141fe29053a82f9005be5fd63a3b5391f37610439a6889b09
|
|
|
test-results-sql-- extended tests-21-hadoop3-hive2.3
|
1.35 MB |
sha256:1f95b03f828e1b11917b8a52d9ff19cbec43bd0e30cda3240f399a3e7826b052
|
|
|
test-results-sql-- other tests-21-hadoop3-hive2.3
|
1.61 MB |
sha256:7c46e264b306757bf029aba35c89e439b8e4b57a10cbfd21778174a02032fe03
|
|
|
test-results-sql-- slow tests-21-hadoop3-hive2.3
|
1.36 MB |
sha256:062a456cdb567aff59fd224f40fbd46379c70efd9911c07d0cf17b172bde2032
|
|
|
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect--21-hadoop3-hive2.3
|
454 KB |
sha256:9bce5ab5cbcde5912d4b8af3bf728850f10e1c74f0c5bedcc73c67ecec80b712
|
|
|
test-results-tpcds--21-hadoop3-hive2.3
|
4.91 KB |
sha256:f23c179a7ef524a522d326d9b1aa0212e6b248d4c43e12232fcfb5ffebe9d9e1
|
|
|
test-results-yarn--21-hadoop3-hive2.3
|
42.7 KB |
sha256:e24fd5c782f45d139e2ef0bbade175ed98b6f5a15f64b953ac8ff18fec297a58
|
|
|
unit-tests-log-core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant--21-hadoop3-hive2.3
|
16.3 MB |
sha256:408174fdc3a1bc553b95283360e39cbefd2a98cc30f608849dcb59ed661dbfd4
|
|