doc: Add a watcher example to run with sideinput by vaibhavtiwari33 · Pull Request #30 · numaproj/numaflow-js

vaibhavtiwari33 · 2025-12-09T20:45:09Z

Mapper example that fetches values from the sideinput using a filewatcher.

Output from log sink:

{"timestamp":"2025-12-09T20:40:30.799733Z","level":"INFO","message":"Processed messages per second","processed":"30","target":"numaflow_core::tracker"}
{"timestamp":"2025-12-09T20:40:31.531971Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5041-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.531996Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5042-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532000Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5043-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532002Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5044-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532005Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5045-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532007Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5046-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532009Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5047-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532012Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5048-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532014Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5049-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532016Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5050-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532019Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5051-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532021Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5052-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532023Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5053-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532025Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5054-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532027Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5055-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532030Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5056-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532032Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5057-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532035Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5058-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532038Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5059-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532040Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5060-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532043Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5061-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532045Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5062-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532047Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5063-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532050Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5064-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532052Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5065-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532054Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5066-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532057Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5067-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532059Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5068-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532062Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5069-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.532064Z","level":"INFO","message":"Payload - side-input-value at epoch: 1765312800041 Keys -  EventTime - 1765312829790 Headers -  ID - out-5070-0-0","target":"numaflow_core::sinker::sink::log"}
{"timestamp":"2025-12-09T20:40:31.797773Z","level":"INFO","message":"Processed messages per second","processed":"30","target":"numaflow_core::tracker"}

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

…nstall Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

vaibhavtiwari33 added 3 commits December 9, 2025 15:43

doc: Add a watcher example to run with sideinput

5479a8c

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

Update the readme for sideinput-mapper

487acb4

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

Update readme with additional info regarding mapper functionality

623d192

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

vaibhavtiwari33 marked this pull request as ready for review December 9, 2025 20:47

vaibhavtiwari33 requested review from BulkBeing and adarsh0728 as code owners December 9, 2025 20:47

vaibhavtiwari33 marked this pull request as draft December 9, 2025 20:49

vaibhavtiwari33 added 2 commits December 9, 2025 15:52

Add async-mutext to main dependency

bda83e9

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

Remove async-mutex from main dependency, update lockfile using pnpm i…

5bed162

…nstall Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

vaibhavtiwari33 marked this pull request as ready for review December 9, 2025 20:57

vaibhavtiwari33 marked this pull request as draft December 11, 2025 03:19

vaibhavtiwari33 added 2 commits February 6, 2026 09:41

Merge branch 'main' into sideinput-watcher

f501472

Remove references to the intuit registry. fix linting

ecbe4bb

Signed-off-by: Vaibhav Tiwari <vaibhav.tiwari33@gmail.com>

vaibhavtiwari33 marked this pull request as ready for review February 6, 2026 16:21

BulkBeing approved these changes Feb 8, 2026

View reviewed changes

BulkBeing merged commit 55b8406 into main Feb 8, 2026
27 checks passed

BulkBeing deleted the sideinput-watcher branch February 8, 2026 04:03

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

doc: Add a watcher example to run with sideinput#30

doc: Add a watcher example to run with sideinput#30
BulkBeing merged 7 commits into
mainfrom
sideinput-watcher

vaibhavtiwari33 commented Dec 9, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

vaibhavtiwari33 commented Dec 9, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants