Skip to content

TEZ-4633: Set Baseline to JDK 21 and cleanup obsolete JVM configurations#506

Merged
abstractdog merged 3 commits into
apache:masterfrom
Aggarwal-Raghav:TEZ-4633
Jun 23, 2026
Merged

TEZ-4633: Set Baseline to JDK 21 and cleanup obsolete JVM configurations#506
abstractdog merged 3 commits into
apache:masterfrom
Aggarwal-Raghav:TEZ-4633

Conversation

@Aggarwal-Raghav

@Aggarwal-Raghav Aggarwal-Raghav commented Jun 2, 2026

Copy link
Copy Markdown
Contributor
  • Get rid of deprecated JVM OPTS flags
  • Removed java8-16, java17 profiles and moved the version specific src directories in tez-javadoc-tools to standard directory

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 56s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 41s Maven dependency ordering for branch
+1 💚 mvninstall 4m 42s master passed
+1 💚 compile 3m 56s master passed
+1 💚 checkstyle 2m 18s master passed
-1 ❌ mvnsite 0m 45s /branch-mvnsite-tez-api.txt tez-api in master failed.
-1 ❌ mvnsite 1m 57s /branch-mvnsite-root.txt root in master failed.
+1 💚 javadoc 2m 56s master passed
+0 🆗 spotbugs 1m 20s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 0m 39s tez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗 spotbugs 0m 23s branch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 7m 24s root in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 16s Maven dependency ordering for patch
+1 💚 mvninstall 4m 27s the patch passed
+1 💚 codespell 2m 5s No new issues.
+1 💚 compile 4m 36s the patch passed
+1 💚 javac 4m 36s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 31s tez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️ checkstyle 0m 27s /results-checkstyle-tez-tools_tez-javadoc-tools.txt tez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 checkstyle 0m 20s The patch passed checkstyle in docs
-0 ⚠️ checkstyle 1m 12s /results-checkstyle-root.txt root: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
-1 ❌ markdownlint 0m 5s /results-markdownlint.txt The patch generated 1 new + 118 unchanged - 1 fixed = 119 total (was 119)
-1 ❌ mvnsite 0m 53s /patch-mvnsite-tez-api.txt tez-api in the patch failed.
-1 ❌ mvnsite 1m 58s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 javadoc 2m 55s the patch passed
+0 🆗 spotbugs 0m 22s docs has no data from spotbugs
_ Other Tests _
+1 💚 unit 71m 27s root in the patch passed.
+1 💚 asflicense 2m 16s The patch does not generate ASF License warnings.
145m 43s
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/1/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
uname Linux f93f32aa7d49 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / 330fdc8
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/1/testReport/
Max. process+thread count 1315 (vs. ulimit of 5500)
modules C: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/1/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor Author

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478

@abstractdog

Copy link
Copy Markdown
Contributor

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478
thanks, I hope we can get hadoop 3.5 upgrade in soon

@abstractdog

Copy link
Copy Markdown
Contributor

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478

hadoop 3.5.0 upgrade PR is merged, I hope this can move forward now! 🚀

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor Author

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478

hadoop 3.5.0 upgrade PR is merged, I hope this can move forward now! 🚀

Yes, I'll start rebasing the PR shortly.

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 26s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 43s Maven dependency ordering for branch
+1 💚 mvninstall 4m 46s master passed
+1 💚 compile 3m 56s master passed
+1 💚 checkstyle 2m 16s master passed
+1 💚 mvnsite 16m 0s master passed
+1 💚 javadoc 2m 51s master passed
+0 🆗 spotbugs 1m 22s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 0m 36s tez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗 spotbugs 0m 23s branch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 6m 54s root in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 14s Maven dependency ordering for patch
+1 💚 mvninstall 4m 0s the patch passed
+1 💚 codespell 1m 48s No new issues.
+1 💚 compile 3m 58s the patch passed
+1 💚 javac 3m 58s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 28s tez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️ checkstyle 0m 22s /results-checkstyle-tez-tools_tez-javadoc-tools.txt tez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 checkstyle 0m 20s The patch passed checkstyle in docs
-0 ⚠️ checkstyle 1m 2s /results-checkstyle-root.txt root: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
-1 ❌ markdownlint 0m 5s /results-markdownlint.txt The patch generated 1 new + 118 unchanged - 1 fixed = 119 total (was 119)
+1 💚 mvnsite 15m 57s the patch passed
+1 💚 javadoc 2m 55s the patch passed
+0 🆗 spotbugs 0m 23s docs has no data from spotbugs
_ Other Tests _
+1 💚 unit 73m 35s root in the patch passed.
+1 💚 asflicense 2m 7s The patch does not generate ASF License warnings.
167m 57s
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/2/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
uname Linux c51aa13ac681 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / 5766cda
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/2/testReport/
Max. process+thread count 2103 (vs. ulimit of 5500)
modules C: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/2/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor Author

Missed markdownlint, will fix after the review comments if any

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 10m 52s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 40s Maven dependency ordering for branch
+1 💚 mvninstall 4m 48s master passed
+1 💚 compile 3m 58s master passed
+1 💚 checkstyle 2m 13s master passed
+1 💚 mvnsite 15m 58s master passed
+1 💚 javadoc 2m 57s master passed
+0 🆗 spotbugs 1m 21s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 0m 38s tez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗 spotbugs 0m 23s branch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 6m 53s root in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 14s Maven dependency ordering for patch
+1 💚 mvninstall 4m 4s the patch passed
+1 💚 codespell 1m 47s No new issues.
+1 💚 compile 3m 56s the patch passed
+1 💚 javac 3m 56s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 29s tez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️ checkstyle 0m 22s /results-checkstyle-tez-tools_tez-javadoc-tools.txt tez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 checkstyle 0m 20s The patch passed checkstyle in docs
-0 ⚠️ checkstyle 1m 1s /results-checkstyle-root.txt root: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
+1 💚 markdownlint 0m 3s The patch generated 0 new + 0 unchanged - 119 fixed = 0 total (was 119)
+1 💚 mvnsite 15m 51s the patch passed
+1 💚 javadoc 2m 52s the patch passed
+0 🆗 spotbugs 0m 24s docs has no data from spotbugs
_ Other Tests _
+1 💚 unit 69m 51s root in the patch passed.
+1 💚 asflicense 2m 16s The patch does not generate ASF License warnings.
166m 37s
Subsystem Report/Notes
Docker ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/3/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
uname Linux 406cfa6c255b 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / 72a42de
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/3/testReport/
Max. process+thread count 1371 (vs. ulimit of 5500)
modules C: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/3/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Comment thread pom.xml
-->

<head><title>Install and Deployment Instructions</title></head>
# Install/Deploy Instructions for Tez

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for reformatting/cleaning this file
would you consider mentioning https://github.com/apache/tez/blob/master/dev-support/bin/tez_run_example.sh here, as it takes care of the same install steps in a convenient way?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, how about adding it here?

For older Tez versions, the compatibility is as follows:

- Tez 0.9.0 and higher: Apache Hadoop 2.7.0 or higher.
- Tez 0.8.3 and higher: Apache Hadoop 2.6.0 or higher.
- Tez 0.5.0 to 0.8.2: Apache Hadoop 2.2.0 or higher.

> **Note:** For a quick local setup, you can use the helper script
  [tez_run_example.sh](../../../../dev-support/bin/tez_run_example.sh)
  which automates these installation, configuration, and deployment
  steps to run a simple word count example in a pseudo-distributed
  single-node cluster.

1. Deploy Apache Hadoop using version of 3.5.0 or higher.

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 29s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 44s Maven dependency ordering for branch
+1 💚 mvninstall 4m 49s master passed
+1 💚 compile 3m 57s master passed
+1 💚 checkstyle 2m 19s master passed
+1 💚 mvnsite 15m 58s master passed
+1 💚 javadoc 2m 55s master passed
+0 🆗 spotbugs 1m 21s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 0m 38s tez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗 spotbugs 0m 24s branch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 6m 47s root in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 13s Maven dependency ordering for patch
+1 💚 mvninstall 4m 5s the patch passed
+1 💚 codespell 1m 44s No new issues.
+1 💚 compile 3m 57s the patch passed
+1 💚 javac 3m 57s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 28s tez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️ checkstyle 0m 23s /results-checkstyle-tez-tools_tez-javadoc-tools.txt tez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 checkstyle 0m 19s The patch passed checkstyle in docs
-0 ⚠️ checkstyle 1m 3s /results-checkstyle-root.txt root: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
+1 💚 markdownlint 0m 3s The patch generated 0 new + 0 unchanged - 119 fixed = 0 total (was 119)
+1 💚 mvnsite 15m 46s the patch passed
+1 💚 javadoc 2m 56s the patch passed
+0 🆗 spotbugs 0m 22s docs has no data from spotbugs
_ Other Tests _
+1 💚 unit 71m 35s root in the patch passed.
+1 💚 asflicense 2m 14s The patch does not generate ASF License warnings.
158m 2s
Subsystem Report/Notes
Docker ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/4/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
uname Linux 60631849f267 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / f924848
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/4/testReport/
Max. process+thread count 1469 (vs. ulimit of 5500)
modules C: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/4/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@abstractdog abstractdog self-requested a review June 23, 2026 07:04

@abstractdog abstractdog left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@abstractdog abstractdog merged commit 7058de2 into apache:master Jun 23, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants