Skip to content

Specify strax mailbox processor in bootstrax #1577

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
cfuselli wants to merge 4 commits into from
Closed

Specify strax mailbox processor in bootstrax #1577

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
7ecea2e
specify strax mailbox processor in bootstrax
cfuselli Mar 7, 2025
dc8d63d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 7, 2025
f58074c
Skip rechunk on load for online processing
cfuselli Mar 7, 2025
ac76143
tensorflow does not work anymore in straxen print versions
cfuselli Mar 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 14 additions & 2 deletions straxen/scripts/bootstrax.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,10 @@
# Patch for targeted (uncompressed) chunk size
straxen.Peaklets.chunk_target_size_mb = strax.DEFAULT_CHUNK_SIZE_MB
straxen.nVETOHitlets.chunk_target_size_mb = strax.DEFAULT_CHUNK_SIZE_MB
# Don't do the rechunk on load for raw_records and peaklets
# It's something we do for offline reprocessing
straxen.DAQReader.rechunk_on_load = False
straxen.Peaklets.rechunk_on_load = False

parser = argparse.ArgumentParser(description="XENONnT online processing manager")
parser.add_argument(
Expand Down Expand Up @@ -277,7 +281,7 @@
hostname = socket.getfqdn()

versions = straxen.print_versions(
modules="strax straxen utilix daqnt numpy tensorflow numba".split(),
modules="strax straxen utilix daqnt numpy numba".split(),
include_git=True,
return_string=True,
)
Expand Down Expand Up @@ -1369,7 +1373,14 @@ def st_make():
)
log.info(f"Making {run_id}-{targets}")
log.debug(f"With {strax_config}, n-cores {cores}")
st.make(run_id, targets, allow_multiple=True, config=strax_config, max_workers=cores)
st.make(
run_id,
targets,
allow_multiple=True,
config=strax_config,
max_workers=cores,
processor="threaded_mailbox",
)

if len(post_processing):
for post_target in post_processing:
Expand All @@ -1388,6 +1399,7 @@ def st_make():
config=strax_config,
progress_bar=True,
max_workers=cores,
processor="threaded_mailbox",
)
else:
log.info(f"Not making {post_target}, it is already stored")
Expand Down