Skip to content

fix: Fix CI failure due to integration test's Hive install - #3174

Merged
laskoviymishka merged 1 commit into
apache:mainfrom
DerGut:fix/hms-expired-debian-metadata
Sep 8, 2026
Merged

fix: Fix CI failure due to integration test's Hive install#3174
laskoviymishka merged 1 commit into
apache:mainfrom
DerGut:fix/hms-expired-debian-metadata

Conversation

@DerGut

@DerGut DerGut commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

What changes are included in this PR?

The Hive Metastore test image currently installs curl through Debian Bullseye before downloading its Hadoop AWS dependencies.

Debian Bullseye reached end of LTS support on August 31, 2026. Its final bullseye-security repository metadata subsequently expired, causing apt-get update to fail while building the integration-test environment. This also affected unrelated PRs such as #3170.

This change removes the unnecessary Debian package-manager dependency. Docker now downloads the two required JARs directly from Maven Central using ADD:

  • hadoop-aws 3.1.0
  • aws-java-sdk-bundle 1.11.271

Both downloads are pinned to their SHA-256 checksums, and their permissions are explicitly set to 0644 so that the non-root hive user can load them.

The Hive, Hadoop, and AWS SDK versions remain unchanged. This is intentional: Hive 3 is EOL, but upgrading to Hive 4 requires a separate migration because the current Rust HMS Thrift client is not fully compatible with Hive 4.

Are these changes tested?

Yes.

  • Built dev/hms/Dockerfile directly with Docker.
  • Built the hive-metastore service through dev/docker-compose.yaml, matching the CI build path.
  • Verified that both downloaded JARs have the expected filenames and are readable by the non-root hive user.
  • Ran git diff --check.

No new automated test is included because this only changes how existing, checksum-pinned test dependencies are installed. The existing integration-test suite exercises the resulting Hive Metastore image.

AI Disclosure

AI assistance was used to inspect the CI failure, investigate the Debian and Hive lifecycle, draft the Dockerfile change, and identify relevant validation. I reviewed the resulting change and ran the validation commands listed above.

Signed-off-by: Jannik Steinmann <jannik.steinmann@datadoghq.com>
@DerGut
DerGut marked this pull request as ready for review September 8, 2026 12:14

@anoopj anoopj left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The fix looks correct to me. I think this should fix the failure in my PR #3171

cc @CTTY @blackmwk

@laskoviymishka laskoviymishka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@laskoviymishka
laskoviymishka merged commit 4687d26 into apache:main Sep 8, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants