refactor: cut TS world state and NAPI AVM over to WSDB IPC; delete NAPI WSDB by charlielye · Pull Request #23036 · AztecProtocol/aztec-packages

charlielye · 2026-05-07T13:14:37Z

Summary

Cuts TypeScript world-state usage and the in-process C++ AVM NAPI path over to the standalone generated @aztec/wsdb package and aztec-wsdb service from the lower stack.

This PR is now stacked after the bb.js migration, so it consumes the new generated package/runtime architecture instead of the old hand-rolled IPC pieces.

Stack

feat(ipc): add /ipc-codegen and /ipc-runtime foundation packages #23610 cl/ipc-foundation
refactor(wsdb): migrate aztec-wsdb to ipc-codegen + ipc-runtime #23611 cl/ipc-wsdb-migrate
refactor(bbapi): migrate bb binary to ipc-codegen + ipc-runtime #23612 cl/ipc-bb-migrate
refactor(barretenberg-rs): migrate to ipc-codegen + ipc-runtime; drop PipeBackend #23613 cl/ipc-bb-rs-migrate
refactor(bb.js): migrate to ipc-codegen + ipc-runtime; delete legacy bb::ipc #23614 cl/ipc-bb-js-migrate
refactor: cut TS world state and NAPI AVM over to WSDB IPC; delete NAPI WSDB #23036 cl/ipc-3-avm-wsdb-cutover — this PR
feat: add aztec-avm + aztec-cdb binaries and IPC supporting code (inert) #23084 cl/ipc-4-avm-binary
feat: AVM cutover — delete NAPI AVM, wire IPC simulator pool + CDB IPC server [PR 3b] #23697 cl/ipc-5-avm-cutover

What changes

C++ / NAPI AVM path

AvmSimAPI::simulate takes a LowLevelMerkleDBInterface& instead of an in-process WorldState&.
NAPI AVM accepts a WSDB socket path and constructs a generated wsdb IPC client plus VM2 wsdb adapter per simulation.
NAPI world-state module is deleted; the NAPI module no longer exposes in-process WorldState.
NAPI module links the current ipc_runtime path from the lower stack.

TypeScript world-state path

World-state startup is encapsulated behind the world-state service/facade instead of leaking binary discovery into callers.
NativeWorldStateService spawns aztec-wsdb through the generated @aztec/wsdb package.
The generated wsdb wrapper resolves its service binary from the installed/local arch package optional dependency.
The old WorldStateRevisionWithHandle shape is removed; callers use ordinary revisions and, where needed, the wsdb socket path.
Cleanup paths close spawned wsdb processes explicitly in tests and service lifecycles.

End state after this PR

The TS world-state path and the C++ AVM path both talk to world state over IPC. The in-process NAPI WSDB module is gone.

Validation

wsdb/bootstrap.sh
yarn-project/yarn install --immutable on this branch after generated package lock updates.
Root ./bootstrap.sh passed on this branch during stack validation.

…C server Replaces the in-process NAPI AVM with the standalone aztec-avm binary (spawned via AvmBackend from PR 3a) and a TS-hosted CdbIpcServer for the contract data callbacks. Stacked on top of PR 2b (cl/ipc-3-avm-wsdb-cutover, #23036) and PR 3a (cl/ipc-4-avm-binary, #23084).

socket-security · 2026-06-09T13:49:49Z

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	npm/@aztec/wsdb@0.0.0-use.local

View full report

…C server Replaces the in-process NAPI AVM with the standalone aztec-avm binary (spawned via AvmBackend from PR 3a) and a TS-hosted CdbIpcServer for the contract data callbacks. Stacked on top of PR 2b (cl/ipc-3-avm-wsdb-cutover, #23036) and PR 3a (cl/ipc-4-avm-binary, #23084).

A sequential-insert response can run to ~1.5 MB, but the default SHM rings were 1 MB, so the response could never be sent and the client hung forever (no error surfaced: the server crashed to a discarded stderr and the SHM client has no peer-disconnect signal). UDS streamed it fine, which is why this only bit the SHM path, and bb.js never hit it (tiny responses, SPSC only). - Size the spawned aztec-wsdb SHM rings to 32 MiB request+response (an SHM frame is capped at half the ring, so this gives ~16 MiB headroom). Keep the WSDB_TRANSPORT env gate (default uds) for opting into SHM. - SpscShm::create: gate the pre-fault memset to small rings so large rings stay demand-paged instead of forcing the whole mapping resident. - IpcServer::run(): catch handler/send failures and shut down cleanly with a logged reason instead of letting an uncaught exception reach std::terminate. - Generated spawned-service backend: capture the child's stdout/stderr to a temp logfile (an fd, not a pipe, to preserve clean process exit) and, on unexpected child exit, reject in-flight calls surfacing the log path — so a server crash is a clear error rather than a silent hang over SHM. - Add single-client MPSC pipelined-flood and burst tests; the SPSC grind never exercised the MPSC path. Verified: world-state native suite 50/50 over both SHM and UDS; avm_bulk (TS world state client 0 + C++ AVM client 1 on one aztec-wsdb) passes over SHM; no perf regression vs UDS.

charlielye force-pushed the cl/ipc-2-wsdb branch from bd2cd24 to 9974620 Compare May 7, 2026 13:50

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from 144f6c2 to d2d4ae7 Compare May 7, 2026 13:51

charlielye mentioned this pull request May 7, 2026

feat(ipc): MPSC shared-memory transport with multi-client echo test #23040

Merged

charlielye marked this pull request as ready for review May 7, 2026 16:48

charlielye requested review from IlyasRidhuan, MirandaWood and jeanmon as code owners May 7, 2026 16:48

charlielye removed request for IlyasRidhuan, MirandaWood and jeanmon May 7, 2026 16:48

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch 2 times, most recently from b7a6517 to 4941f2b Compare May 7, 2026 18:02

charlielye mentioned this pull request May 8, 2026

feat: add aztec-avm + aztec-cdb binaries and IPC supporting code (inert) #23084

Open

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch 3 times, most recently from 67d3c6c to d904a74 Compare May 11, 2026 13:59

charlielye mentioned this pull request May 11, 2026

feat: AVM cutover — delete NAPI AVM, wire IPC simulator pool + CDB IPC server [PR 3b] #23154

Closed

5 tasks

Base automatically changed from cl/ipc-2-wsdb to cl/ipc-1-mpsc-shm May 12, 2026 08:52

AztecBot force-pushed the cl/ipc-1-mpsc-shm branch 2 times, most recently from 17b93f4 to e668757 Compare May 12, 2026 09:02

Base automatically changed from cl/ipc-1-mpsc-shm to next May 12, 2026 10:55

charlielye added the ci-full Run all master checks. label May 12, 2026

This was referenced May 12, 2026

feat: AVM cutover — delete NAPI AVM, wire IPC simulator pool + CDB IPC server [PR 3b] #23196

Merged

feat: kv-store over IPC; aztec-kvdb binary; LMDBStore NAPI scaffold [PR 4] #23238

Closed

charlielye added the ci-no-squash label May 13, 2026

charlielye changed the base branch from next to cl/ipc-bb-js-migrate May 29, 2026 13:54

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from 0d58c3e to 679c622 Compare May 29, 2026 13:54

charlielye mentioned this pull request May 29, 2026

feat: AVM cutover — delete NAPI AVM, wire IPC simulator pool + CDB IPC server [PR 3b] #23697

Open

charlielye force-pushed the cl/ipc-bb-js-migrate branch from ef11595 to 67c5155 Compare June 9, 2026 13:48

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from d886c60 to 46639a1 Compare June 9, 2026 13:48

charlielye force-pushed the cl/ipc-bb-js-migrate branch from 67c5155 to ad67d9c Compare June 9, 2026 16:15

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from 3a9289a to 6042327 Compare June 9, 2026 16:15

charlielye force-pushed the cl/ipc-bb-js-migrate branch from ad67d9c to 1e2528e Compare June 9, 2026 17:00

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from 6042327 to 14392b8 Compare June 9, 2026 17:00

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from 14392b8 to 011106a Compare June 10, 2026 13:37

charlielye force-pushed the cl/ipc-bb-js-migrate branch from 1e2528e to 3cddf51 Compare June 10, 2026 13:37

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from 011106a to f46984b Compare June 10, 2026 13:44

charlielye force-pushed the cl/ipc-bb-js-migrate branch from 3cddf51 to c8b3cfa Compare June 10, 2026 14:11

charlielye force-pushed the cl/ipc-3-avm-wsdb-cutover branch from f46984b to 0d5cc4a Compare June 10, 2026 14:11

charlielye force-pushed the cl/ipc-bb-js-migrate branch from c8b3cfa to fbe1523 Compare June 11, 2026 17:50

charlielye added 4 commits June 17, 2026 12:17

refactor(world-state): cut over to generated wsdb package

017a351

refactor(world-state): use ipc path terminology

bacad66

refactor(world-state): remove legacy wsdb message dispatch

04ba4e6

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

refactor: cut TS world state and NAPI AVM over to WSDB IPC; delete NAPI WSDB#23036

refactor: cut TS world state and NAPI AVM over to WSDB IPC; delete NAPI WSDB#23036
charlielye wants to merge 4 commits into
nextfrom
cl/ipc-3-avm-wsdb-cutover

charlielye commented May 7, 2026 •

edited

Loading

Uh oh!

socket-security Bot commented Jun 9, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

charlielye commented May 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Stack

What changes

C++ / NAPI AVM path

TypeScript world-state path

End state after this PR

Validation

Uh oh!

socket-security Bot commented Jun 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

charlielye commented May 7, 2026 •

edited

Loading

socket-security Bot commented Jun 9, 2026 •

edited

Loading