feat(load-test): support native load-test benchmark runs#186
Draft
niran wants to merge 9 commits into
Draft
Conversation
Collaborator
🟡 Heimdall Review Status
|
… runs Wire the load-test payload worker to write a JSON result file on graceful shutdown and surface it in the report UI. After the benchmark window ends the runner sends SIGINT to the load-test binary and continues proposing settlement blocks until the worker exits (up to 90s), giving the binary time to flush its result. The output path is stored as an artifact in RunResult and shown as a "Load test" link in the run list that opens a dedicated detail page. Also fixes an inverted slices.Contains check in the importer that caused required files to be silently skipped on error and optional files to abort the import.
niran
force-pushed
the
niran/load-test-reports
branch
from
96a452d to
475b734
Compare
…k>/<timestamp>.json Drop the benchmark-specific UI page and report-api route added in the previous commit. Instead the load-test worker writes a normal load-test JSON report to output/load-tests/<network>/<timestamp>.json, which the benchmarking uploader can publish alongside regular benchmark runs. Network is resolved from BASE_BENCH_LOAD_TEST_NETWORK env var, then the payload's network field, then a chain-ID fallback map. The path is passed to base-load-test via LOAD_TEST_OUTPUT. The worker now shuts down gracefully so the sequencer can drain remaining transactions before stopping. Also fixes an inverted slices.Contains guard in the importer that would have returned an error for optional (rather than required) missing files.
niran
force-pushed
the
niran/load-test-reports
branch
from
475b734 to
e60e7c9
Compare
niran
force-pushed
the
niran/load-test-reports
branch
from
04cd46d to
c83ce2e
Compare
niran
changed the title
Forward pass-through JSON-RPC batch items to the upstream node while continuing to capture raw transactions. Fetch eth_getTransactionCount from upstream and merge it with transactions already accepted by the proxy so snapshot-backed accounts keep their real chain nonce. Co-authored-by: Codex <noreply@openai.com>
niran
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
load-testbenchmark payload that runsbase-load-testerfrom a native YAML config referenced byconfig_file.output/load-tests/<network>/<timestamp>.jsonviaLOAD_TEST_OUTPUT, so benchmark-triggered load tests publish into the existing load-test results namespace without custom UI handling.target_gpswhen configured. The native load-test config keeps ownership ofduration.target_gps, so a load-test benchmark can run one benchmark per target gas-per-second value without changing the builder gas limit.prevent-late-fcupreserves the existing benchmark behavior for regular benchmark payloads.base-consensusfollows the production-style cadence used by snapshot load tests.load-testpayloads tobase-consensus; keep other benchmark runs onprevent-late-fcu.Tests
go test ./...git diff --check origin/main...HEADPairs with: