Skip to content

Tune Maven's own retry/concurrency to reduce Maven Central rate-limiting #1835

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rapids-bot merged 7 commits into from
Sep 2, 2026
+119 −33
Merged

Tune Maven's own retry/concurrency to reduce Maven Central rate-limiting #1835

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
bb78dd1
Add java/cuopt/.mvn/maven.config to reduce Maven Central rate-limiting
ramakrishnap-nv Sep 1, 2026
e2facf8
Fix build.sh Java build to cd into java/cuopt before invoking mvn
ramakrishnap-nv Sep 1, 2026
af54fa7
Only attach source/javadoc jars behind an opt-in profile, not on ever…
ramakrishnap-nv Sep 1, 2026
c622743
Merge branch 'main' into java-maven-retry-config
ramakrishnap-nv Sep 1, 2026
07b3afb
Merge remote-tracking branch 'origin/main' into java-maven-retry-config
ramakrishnap-nv Sep 1, 2026
7f776e8
Correct Maven retry property namespace to aether.connector.http.retry…
ramakrishnap-nv Sep 1, 2026
82e4e86
Prefer the GCS Maven Central mirror over repo.maven.apache.org
ramakrishnap-nv Sep 2, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion build.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -505,7 +505,10 @@ if hasArg java; then
bash "${REPODIR}"/java/cuopt/scripts/build_native.sh
source "${REPODIR}"/java/cuopt/scripts/maven.sh
cuopt_maven_args
cuopt_mvn -f "${REPODIR}"/java/cuopt/pom.xml clean package \
# cd into java/cuopt so Maven's directory-search picks up java/cuopt/.mvn/maven.config --
# it walks up from the current working directory, not from -f's directory.
cd "${REPODIR}"/java/cuopt
cuopt_mvn -f pom.xml clean package \
-DskipTests \
-Dcuopt.native.dir="${CUOPT_JAVA_NATIVE_BUILD_DIR}"
fi
Expand Down
8 changes: 8 additions & 0 deletions java/cuopt/.mvn/maven.config
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
-e
-B
-Daether.connector.basic.downstreamThreads=1
-Daether.connector.http.retryHandler.count=8
-Daether.connector.http.retryHandler.interval=5000
-Daether.connector.http.retryHandler.intervalMax=60000
-Daether.connector.http.retryHandler.serviceUnavailable=429,503
-Dmaven.wagon.http.retryHandler.count=5
139 changes: 107 additions & 32 deletions java/cuopt/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,63 @@ SPDX-License-Identifier: Apache-2.0
<junit.jupiter.version>5.11.4</junit.jupiter.version>
</properties>

<!--
Maven Central rate-limits NVIDIA-managed GitHub Actions runners: they egress through a small,
shared NAT'd IP range, so every RAPIDS repo's Java CI shares the same budget against Central
(see rapidsai/build-infra#370). Prefer the Google Cloud read-only mirror of Central, the same
one Apache ORC/Lucene/Spark use, and fall back to Central for anything not mirrored. Matches
the fix applied in rapidsai/kvikio#992.
-->
Comment on lines +48 to +54

@jameslamb jameslamb Sep 2, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<!--
Maven Central rate-limits NVIDIA-managed GitHub Actions runners: they egress through a small,
shared NAT'd IP range, so every RAPIDS repo's Java CI shares the same budget against Central
(see rapidsai/build-infra#370). Prefer the Google Cloud read-only mirror of Central, the same
one Apache ORC/Lucene/Spark use, and fall back to Central for anything not mirrored. Matches
the fix applied in rapidsai/kvikio#992.
-->
<!--
Maven Central rate-limits NVIDIA-managed GitHub Actions runners: they egress through a small,
shared NAT'd IP range, so every repo's Java CI shares the same budget against Central
(see rapidsai/build-infra#370). Prefer the Google Cloud read-only mirror of Central, the same
one Apache ORC/Lucene/Spark use, and fall back to Central for anything not mirrored. Matches
the fix applied in rapidsai/kvikio#992.
-->

If you want a comment documenting this that's fine, but it's not specific to "RAPIDS". This applies to every project using NVIDIA's hosted GitHub Actions runners.

<repositories>
<repository>
<id>gcs-maven-central-mirror</id>
<name>GCS Maven Central mirror</name>
<url>https://maven-central.storage-download.googleapis.com/maven2/</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
<repository>
<id>central</id>
<name>Maven Central</name>
<url>https://repo.maven.apache.org/maven2</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
</repositories>

<pluginRepositories>
<pluginRepository>
<id>gcs-maven-central-mirror</id>
<name>GCS Maven Central mirror</name>
<url>https://maven-central.storage-download.googleapis.com/maven2/</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>false</enabled>
</snapshots>
</pluginRepository>
<pluginRepository>
<id>central</id>
<name>Maven Plugin Repository</name>
<url>https://repo.maven.apache.org/maven2</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>false</enabled>
</snapshots>
</pluginRepository>
</pluginRepositories>

<dependencies>
<dependency>
<groupId>org.junit.jupiter</groupId>
Expand Down Expand Up @@ -109,38 +166,6 @@ SPDX-License-Identifier: Apache-2.0
</execution>
</executions>
</plugin>
<!-- Sources and javadoc jars are required by any Maven repository we would publish to. -->
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-source-plugin</artifactId>
<version>3.3.1</version>
<executions>
<execution>
<id>attach-sources</id>
<goals>
<goal>jar-no-fork</goal>
</goals>
</execution>
</executions>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-javadoc-plugin</artifactId>
<version>3.11.2</version>
<configuration>
<!-- The bindings are documented against the C API rather than in javadoc comments;
missing tags should not fail the build. -->
<doclint>none</doclint>
</configuration>
<executions>
<execution>
<id>attach-javadocs</id>
<goals>
<goal>jar</goal>
</goals>
</execution>
</executions>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-surefire-plugin</artifactId>
Expand All @@ -154,4 +179,54 @@ SPDX-License-Identifier: Apache-2.0
</plugin>
</plugins>
</build>

<profiles>
<!--
Sources and javadoc jars are required by any Maven repository we would publish to, but
not by anything else. Attaching them unconditionally meant every `mvn test`/`verify`
invocation (which never packages anything) still had to resolve maven-source-plugin and
maven-javadoc-plugin from Maven Central, on every CI run, for no reason. That repeated,
unnecessary resolution repeatedly hit Maven Central 429 rate limits. Activate explicitly
with -Pattach-source-javadoc when actually packaging for publishing; mvn test/verify
should not activate it.
-->
<profile>
<id>attach-source-javadoc</id>
<build>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-source-plugin</artifactId>
<version>3.3.1</version>
<executions>
<execution>
<id>attach-sources</id>
<goals>
<goal>jar-no-fork</goal>
</goals>
</execution>
</executions>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-javadoc-plugin</artifactId>
<version>3.11.2</version>
<configuration>
<!-- The bindings are documented against the C API rather than in javadoc comments;
missing tags should not fail the build. -->
<doclint>none</doclint>
</configuration>
<executions>
<execution>
<id>attach-javadocs</id>
<goals>
<goal>jar</goal>
</goals>
</execution>
</executions>
</plugin>
</plugins>
</build>
</profile>
</profiles>
</project>
Loading