Skip to content

update DD to invoke AuditType::ValidateLocationMetadata every hour#13113

Open
gxglass wants to merge 1 commit intoapple:mainfrom
gxglass:consistency-checker-automated
Open

update DD to invoke AuditType::ValidateLocationMetadata every hour#13113
gxglass wants to merge 1 commit intoapple:mainfrom
gxglass:consistency-checker-automated

Conversation

@gxglass
Copy link
Copy Markdown
Collaborator

@gxglass gxglass commented Apr 29, 2026

Adds a periodic invocation of the location metadata consistency check (equivalent to fdbcli audit_storage locationmetadata) directly within the Data Distributor control loops. New knob AUDIT_LOCATION_METADATA_INTERVAL (default 3600s / 1 hour, 0 to disable) controls the frequency.

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-clang-ide on Linux RHEL 9

  • Commit ID: 552a443
  • Duration 0:23:33
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

  • Commit ID: 552a443
  • Duration 0:37:30
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-clang-arm on Linux CentOS 7

  • Commit ID: 552a443
  • Duration 0:43:57
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-macos on macOS Ventura 13.x

  • Commit ID: 552a443
  • Duration 0:49:41
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-clang on Linux RHEL 9

  • Commit ID: 552a443
  • Duration 0:58:19
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr on Linux RHEL 9

  • Commit ID: 552a443
  • Duration 1:01:01
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-cluster-tests on Linux RHEL 9

  • Commit ID: 552a443
  • Duration 1:02:21
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

@gxglass
Copy link
Copy Markdown
Collaborator Author

gxglass commented Apr 30, 2026

Converted to draft while I work on testing on this on a cluster bigger than simulation

@gxglass gxglass marked this pull request as draft April 30, 2026 17:30
@gxglass gxglass force-pushed the consistency-checker-automated branch from 552a443 to f0bb44a Compare May 6, 2026 20:30
@gxglass gxglass requested a review from saintstack May 6, 2026 20:30
@gxglass gxglass marked this pull request as ready for review May 6, 2026 20:31
@gxglass
Copy link
Copy Markdown
Collaborator Author

gxglass commented May 6, 2026

Declaring this OK for main now. I'll find a way to test it at larger scale before backporting it to release branches.

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-clang-arm on Linux CentOS 7

  • Commit ID: f0bb44a
  • Duration 0:47:02
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-clang-ide on Linux RHEL 9

  • Commit ID: f0bb44a
  • Duration 0:56:58
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-cluster-tests on Linux RHEL 9

  • Commit ID: f0bb44a
  • Duration 1:03:38
  • Result: ❌ FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr on Linux RHEL 9

  • Commit ID: f0bb44a
  • Duration 1:06:31
  • Result: ❌ FAILED
  • Error: Error while executing command: ctest -j ${NPROC} --no-compress-output -T test --output-on-failure. Reason: exit status 8
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-clang on Linux RHEL 9

  • Commit ID: f0bb44a
  • Duration 1:50:31
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-macos on macOS Ventura 13.x

  • Commit ID: f0bb44a
  • Duration 3:10:58
  • Result: ❌ FAILED
  • Error: Error while executing command: # compatible with bash and zsh ssh -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -i ${HOME}/.ssh_key ec2-user@${MAC_EC2_HOST} ' set -e -o noclobber I=0 while ! (echo $$ >/tmp/ci.lock) 2>/dev/null ; do if ((I++ > 10800)); then # 3 hours echo "timeout waiting for ci.lock after $I seconds" exit 1 fi if ! ps -p "$(cat /tmp/ci.lock)" >/dev/null; then # racy but sleep so chances are low echo "lock holder may be gone ..." sleep $((8 + RANDOM % 8)) if ! ps -p "$(cat /tmp/ci.lock)" >/dev/null; then echo "lock holder is gone" rm -f /tmp/ci.lock else echo "new lock holder" fi fi sleep 1 done echo "acquired ci.lock" ' . Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Copy Markdown
Contributor

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

  • Commit ID: f0bb44a
  • Duration 3:12:11
  • Result: ❌ FAILED
  • Error: Error while executing command: # compatible with bash and zsh ssh -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -i ${HOME}/.ssh_key ec2-user@${MAC_EC2_HOST} ' set -e -o noclobber I=0 while ! (echo $$ >/tmp/ci.lock) 2>/dev/null ; do if ((I++ > 10800)); then # 3 hours echo "timeout waiting for ci.lock after $I seconds" exit 1 fi if ! ps -p "$(cat /tmp/ci.lock)" >/dev/null; then # racy but sleep so chances are low echo "lock holder may be gone ..." sleep $((8 + RANDOM % 8)) if ! ps -p "$(cat /tmp/ci.lock)" >/dev/null; then echo "lock holder is gone" rm -f /tmp/ci.lock else echo "new lock holder" fi fi sleep 1 done echo "acquired ci.lock" ' . Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants