An error occurred while processing nuscenes test set data

[lda1049187465]

Hello. When I preprocess the nuscenes training data using the instructions you provided, everything is right: python tools/create_data.py nuscenes_data_prep --root_path=/root/autodl-tmp/nuscenes/trainval --version="v1.0-trainval" --nsweeps=10.

But when I run the test command:python tools/create_data.py nuscenes_data_prep_test --root_path=/root/autodl-tmp/nuscenes/test --nsweeps=10 ,The following error occurred:

======
Loading NuScenes tables for version v1.0-test...
23 category,
8 attribute,
4 visibility,
0 instance,
12 sensor,
1800 calibrated_sensor,
462901 ego_pose,
15 log,
150 scene,
6008 sample,
462901 sample_data,
0 sample_annotation,
4 map,
Done loading in 6.5 seconds.

Reverse indexing ...
Done reverse indexing in 1.9 seconds.

total scene num: 150
exist scene num: 150
test scene: 150
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 6008/6008 [00:05<00:00, 1003.01it/s]
test sample: 6008
0%| | 0/6008 [00:00<?, ?it/s]
Traceback (most recent call last):
File "tools/create_data.py", line 111, in
fire.Fire()
File "/root/miniconda3/lib/python3.8/site-packages/fire/core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
File "/root/miniconda3/lib/python3.8/site-packages/fire/core.py", line 466, in _Fire
component, remaining_args = _CallAndUpdateTrace(
File "/root/miniconda3/lib/python3.8/site-packages/fire/core.py", line 681, in _CallAndUpdateTrace
component = fn(*varargs, **kwargs)
File "tools/create_data.py", line 104, in nuscenes_data_prep_test
nu_ds.combine_sweeps(info, nsweeps)
File "/root/VISTA/det3d/datasets/nuscenes/nusc_common.py", line 254, in combine_sweeps
with open(info['lidar_path'], 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/root/autodl-tmp/nuscenes/test/samples_10LIDAR_TOP/n008-2018-08-01-16-03-27-0400__LIDAR_TOP__1533153857947444.pcd.bin'

Do you know how to solve this problem,thanks a lot?

[AndlollipopDE]

The error messages indicate your file path does not exist, or the file path was wrong, please check the path you pass.

[lda1049187465]

Thank you,I'll check it.

[bytepioneerX]

This is because you have not downloaded the complete data set. You can change the function
def _fill_trainval_infos(nusc, train_scenes, val_scenes, test=False, nsweeps=10, filter_zero=True):
.......
for sample in tqdm(nusc.sample):
# (Add this line !!!)
if sample["scene_token"] in train_scenes or sample["scene_token"] in val_scenes:
# Get reference pose and timestamp
# ref_chan == "LIDAR_TOP"
ref_sd_token = sample["data"][ref_chan]
ref_sd_rec = nusc.get("sample_data", ref_sd_token)
....................