Skip to content

[CI] Emit FrameworkWeb ingest JSON from parity workflow#3259

Draft
albmalamd wants to merge 57 commits into
developfrom
users/albmalamd/parity-json-ingest
Draft

[CI] Emit FrameworkWeb ingest JSON from parity workflow#3259
albmalamd wants to merge 57 commits into
developfrom
users/albmalamd/parity-json-ingest

[CI] Emit FrameworkWeb ingest JSON from parity workflow

406ab6f
Select commit
Loading
Failed to load commit list.
ROCm Repo Management API / Jenkins failed May 28, 2026 in 8h 54m 15s

Tests/Test Inductor/Run pytorch_inductor_1: error in 'error' step

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_1 / Error signal

Error in error step, with arguments Found 1 failure(s) in pytorch_reports/python-pytest/test_cuda/test_cuda-29539ab49c79773c.xml report Found 1 failure(s) in pytorch_reports/python-pytest/test_cuda/test_cuda-2ddf2a5e0abf14c8.xml report.

Found 1 failure(s) in pytorch_reports/python-pytest/test_cuda/test_cuda-29539ab49c79773c.xml report
Found 1 failure(s) in pytorch_reports/python-pytest/test_cuda/test_cuda-2ddf2a5e0abf14c8.xml report

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_1 / Error signal

Error in error step, with arguments Some tests are failed or errored.

Some tests are failed or errored

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_1 / Error signal

Error in error step, with arguments pytorch_test_1 failed.

pytorch_test_1 failed

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_1 / Archive JUnit-formatted test results

Warning in junit step.

2 tests failed

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_2 / Error signal

Error in error step, with arguments Found 1 failure(s) in pytorch_reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-92d6503e72d3a5c7.xml report.

Found 1 failure(s) in pytorch_reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-92d6503e72d3a5c7.xml report

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_2 / Error signal

Error in error step, with arguments Some tests are failed or errored.

Some tests are failed or errored

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_2 / Error signal

Error in error step, with arguments pytorch_test_2 failed.

pytorch_test_2 failed

Tests / Test PyTorch / Test PyTorch / Run pytorch_test_2 / Archive JUnit-formatted test results

Warning in junit step.

1 tests failed

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_1 / Shell Script

Error in sh step, with arguments rocminfo.

script returned exit code 1
Build log
[2026-05-27T20:40:51.205Z] + rocminfo
[2026-05-27T20:40:51.205Z] ROCk module version 6.10.5 is loaded
[2026-05-27T20:40:51.205Z] Unable to open /dev/kfd read-write: Invalid argument
[2026-05-27T20:40:51.205Z] jenkins is member of video group

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_1 / Error signal

Error in error step, with arguments pytorch_distributed_1 failed.

pytorch_distributed_1 failed

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_1 / Archive JUnit-formatted test results

Error in junit step.

No test report files were found. Configuration error?
Build log
[2026-05-27T22:10:06.792Z] Recording test results
[2026-05-27T22:10:06.902Z] No test report files were found. Configuration error?

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_1 / Error signal

Error in error step, with arguments Failed to publish test reports xml files.

Failed to publish test reports xml files

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_1 / Create Zip file

Error in zip step.

java.nio.file.AccessDeniedException: /home/jenkins/internal/workspace/orch_pytorch-ci-pipeline_PR-3259/pytorch_reports/pytorch_distributed_1.zip
Build log
[2026-05-27T22:10:07.325Z] Compress /home/jenkins/internal/workspace/orch_pytorch-ci-pipeline_PR-3259 filtered by [pytorch_reports/**/**/*.xml] - [null] to /home/jenkins/internal/workspace/orch_pytorch-ci-pipeline_PR-3259/pytorch_reports/pytorch_distributed_1.zip

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_1 / Error signal

Error in error step, with arguments Failed to archive test reports xml files.

Failed to archive test reports xml files

Tests / Test Distributed / Test Distributed / Run pytorch_distributed_2 / Shell Script

Error in sh step, with arguments rocminfo.

script returned exit code 1
Build log
[2026-05-27T22:22:43.255Z] + rocminfo
[2026-05-27T22:22:43.255Z] ROCk module version 6.10.5 is loaded
[2026-05-27T22:22:43.255Z] Unable to open /dev/kfd read-write: Invalid argument
[2026-05-27T22:22:43.255Z] jenkins is member of video group

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Shell Script

Error in sh step, with arguments rocminfo.

script returned exit code 1
Build log
[2026-05-27T20:40:57.924Z] + rocminfo
[2026-05-27T20:40:57.924Z] ROCk module version 6.10.5 is loaded
[2026-05-27T20:40:57.924Z] Unable to open /dev/kfd read-write: Invalid argument
[2026-05-27T20:40:57.924Z] jenkins is member of video group

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Shell Script

Error in sh step, with arguments ./test_pytorch_inductor.sh.

Timeout waiting for agent to come back
Build log
Build log truncated.

[2026-05-27T21:34:04.923Z] 
[2026-05-27T21:34:04.923Z] Finished test_torch 2/3 ... [2026-05-27 21:33:55.751063][37501.956387179], took 8.57min
[2026-05-27T21:34:04.923Z] Running test_torch 3/3 ... [2026-05-27 21:33:55.759961][37501.965287251]
[2026-05-27T21:34:04.923Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:34:04.923Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_torch.py', '--shard-id=3', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:33:55.760143]
[2026-05-27T21:34:04.923Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_torch/test_torch-fd213c7b0281fd2a.xml
[2026-05-27T21:34:04.923Z] Found job id: None
[2026-05-27T21:34:04.923Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:08.153Z] 
[2026-05-27T21:42:08.153Z] test_torch 3/3 was successful, full logs can be found in artifacts with path test/test-reports/test_torch_3.3_7b7d4308d9373eca_.log
[2026-05-27T21:42:08.154Z] Running 329 items in this shard: test/test_torch.py::TestBasicVitalSigns::test_basic_vitals, test/test_torch.py::TestBasicVitalSigns::test_basic_vitals_read_write, test/test_torch.py::TestTorch::test_Size_scalar, test/test_torch.py::TestTorch::test_apply, test/test_torch.py::TestTorch::test_as_subclass, test/test_torch.py::TestTorch::test_backward_hooks_traverse, test/test_torch.py::TestTorch::test_bf16_supported_on_cpu, test/test_torch.py::TestTorch::test_cat_neg_dim, test/test_torch.py::TestTorch::test_check, test/test_torch.py::TestTorch::test_chunk_neg_dim, test/test_torch.py::TestTorch::test_conj_physical_meta_stride, test/test_torch.py::TestTorch::test_copy_broadcast, test/test_torch.py::TestTorch::test_cummax_neg_dim, test/test_torch.py::TestTorch::test_data_ptr_of_empty_view_with_storage, test/test_torch.py::TestTorch::test_deterministic_fill_uninitialized_memory, test/test_torch.py::TestTorch::test_deterministic_flag, test/test_torch.py::TestTorch::test_device, test/test_torch.py::TestTorch::test_dir, test/test_torch.py::TestTorch::test_dot_data_use, test/test_torch.py::TestTorch::test_error_msg_type_translation, test/test_torch.py::TestTorch::test_fill_diagonal, test/test_torch.py::TestTorch::test_generator_cpu, test/test_torch.py::TestTorch::test_has_storage, test/test_torch.py::TestTorch::test_index_add_neg_dim, test/test_torch.py::TestTorch::test_invalid_generator_raises, test/test_torch.py::TestTorch::test_iter, test/test_torch.py::TestTorch::test_map2, test/test_torch.py::TestTorch::test_mean_neg_dim, test/test_torch.py::TestTorch::test_median_neg_dim, test/test_torch.py::TestTorch::test_memory_format, test/test_torch.py::TestTorch::test_memory_format_empty, test/test_torch.py::TestTorch::test_min_neg_dim, test/test_torch.py::TestTorch::test_multinomial_invalid_probs, test/test_torch.py::TestTorch::test_nanmedian_neg_dim, test/test_torch.py::TestTorch::test_narrow_neg_dim, test/test_torch.py::TestTorch::test_nbytes, test/test_torch.py::TestTorch::test_new, test/test_torch.py::TestTorch::test_no_cuda_monkeypatch, test/test_torch.py::TestTorch::test_parsing_int64, test/test_torch.py::TestTorch::test_pickle, test/test_torch.py::TestTorch::test_pickle_generator, test/test_torch.py::TestTorch::test_pin_memory, test/test_torch.py::TestTorch::test_prod_neg_dim, test/test_torch.py::TestTorch::test_renorm_neg_dim, test/test_torch.py::TestTorch::test_reversed, test/test_torch.py::TestTorch::test_scatter_neg_dim, test/test_torch.py::TestTorch::test_show_config, test/test_torch.py::TestTorch::test_slice, test/test_torch.py::TestTorch::test_sobolengine_continuing_scrambled, test/test_torch.py::TestTorch::test_sobolengine_draw_scrambled, test/test_torch.py::TestTorch::test_sobolengine_first_point, test/test_torch.py::TestTorch::test_sobolengine_raise, test/test_torch.py::TestTorch::test_sobolengine_reset, test/test_torch.py::TestTorch::test_storage_base_new, test/test_torch.py::TestTorch::test_storage_byteswap, test/test_torch.py::TestTorch::test_storage_cycle_via_slots, test/test_torch.py::TestTorch::test_storage_finalizer_dealloc, test/test_torch.py::TestTorch::test_storage_fix_weakref_no_leak, test/test_torch.py::TestTorch::test_structseq_repr, test/test_torch.py::TestTorch::test_sum_neg_dim, test/test_torch.py::TestTorch::test_swap_fail_slots, test/test_torch.py::TestTorch::test_t_not_2d_error, test/test_torch.py::TestTorch::test_tensor_base_init, test/test_torch.py::TestTorch::test_tensor_cycle_via_slots, test/test_torch.py::TestTorch::test_tensor_dead_weak_ref, test/test_torch.py::TestTorch::test_tensor_dict_dealloc, test/test_torch.py::TestTorch::test_tensor_finalizer_dealloc, test/test_torch.py::TestTorch::test_tensor_fix_weakref_no_leak, test/test_torch.py::TestTorch::test_tensor_resurrected_weak_ref, test/test_torch.py::TestTorch::test_tensoriterator_output_setup, test/test_torch.py::TestTorch::test_transpose_neg_dim, test/test_torch.py::TestTorch::test_type, test/test_torch.py::TestTorch::test_type_alias, test/test_torch.py::TestTorch::test_type_conversion_via_dtype_name, test/test_torch.py::TestTorch::test_unsqueeze_neg_dim, test/test_torch.py::TestTorch::test_var_neg_dim, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcdiv_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcdiv_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcdiv_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcdiv_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_False_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_False_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_False_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_True_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_True_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_True_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_addcmul_use_cpu_scalar_True_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bernoulli_edge_cases_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bernoulli_mem_overlap_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bernoulli_self_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bernoulli_self_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bernoulli_self_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bernoulli_self_cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_div_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_le_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_map_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_masked_select_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_min_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_mul_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_pow_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_broadcast_fn_sub_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bytes_to_scalar_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bytes_to_scalar_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bytes_to_scalar_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bytes_to_scalar_cuda_uint16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_bytes_to_scalar_cuda_uint64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cauchy_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cauchy_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cauchy_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cauchy_kstest_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cauchy_kstest_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cauchy_no_inf_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cdist_grad_p_lt_1_no_nan_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cdist_large_batch_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cdist_non_contiguous_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cdist_same_inputs_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_conv_transposed_backward_agnostic_to_memory_format_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy__cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy__cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy__cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy__cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy_math_view_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy_transpose_math_view_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy_transpose_math_view_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_copy_transpose_math_view_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_corrcoef_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cummax_discontiguous_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cummin_discontiguous_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_cumsum_64bit_indexing_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deepcopy_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deepcopy_scalar_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_empty_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_empty_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_empty_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_empty_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_replication_pad2d_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_resize_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_deterministic_resize_cuda_uint16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_diff_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_diff_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_diff_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_diff_noncontig_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_diff_noncontig_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_diff_noncontig_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_dist_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_expected_failure_xla_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_exponential_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_exponential_kstest_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_exponential_no_zero_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_geometric_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_geometric_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_geometric_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_geometric_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_geometric_kstest_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_geometric_kstest_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaler_deprecated_warning_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaler_pass_itself_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_autocast_foreach0_fused0_Adam_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_autocast_foreach2_fused_True_Adam_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_autocast_foreach2_fused_True_SGD_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_autocast_foreach_True_fused1_SGD_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_clipping_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_multiple_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_unscale_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_grad_scaling_update_scale_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_gradient_all_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_gradient_all_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_gradient_extreme_cases_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_complex32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_float8_e4m3fnuz, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_uint32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_item_cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_binary_op_no_materialize_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_binary_op_no_materialize_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_binary_op_no_materialize_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_view_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_view_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_view_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_view_cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_view_materialize_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lazy_clone_view_materialize_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_log_normal_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_logcumsumexp_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lognormal_kstest_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_lognormal_kstest_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_bool_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_float16_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_float16_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_float64_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_int16_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_int16_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_int32_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_int32_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_cuda_int64_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_fill_mem_overlap_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_scatter_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_scatter_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_scatter_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_scatter_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_scatter_mem_overlap_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_select_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_select_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_select_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_masked_select_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_memory_format_preserved_after_permute_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_module_share_memory_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_multinomial_cpu_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_multinomial_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_multinomial_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_multinomial_deterministic_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_multinomial_rng_state_advance_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_narrow_empty_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_no_nondeterministic_alert_interpolate_trilinear_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_AdaptiveAvgPool3d_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_AvgPool3d_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool1d_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool1d_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool2d_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool2d_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool3d_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool3d_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_MaxUnpool3d_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_ReflectionPad3d_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_bincount_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_histc_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_interpolate_bicubic_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_interpolate_bilinear_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_put_accumulate_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_alert_put_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_nondeterministic_resize_quantized_cuda_qint32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_normal_small_std_kstest_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_parallel_cow_materialize_error_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_parallel_cow_materialize_error_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_parallel_cow_materialize_error_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_parallel_cow_materialize_error_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_parallel_cow_materialize_error_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_params_invalidated_with_grads_invalidated_and_graph_partition_Adam_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_params_invalidated_with_grads_invalidated_and_graph_partition_SGD_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_params_invalidated_with_grads_invalidated_between_unscale_and_step_AdamW_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_pickle_gradscaler_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_pin_memory_from_constructor_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_accumulate_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_accumulate_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_accumulate_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_accumulate_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_accumulate_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_put_empty_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_reduced_type_float_copy_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_add_one_dim_deterministic_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_non_unique_index_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_non_unique_index_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_non_unique_index_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_operations_to_large_input_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_operations_to_large_input_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_operations_to_large_input_cuda_float32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_scalar_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_scatter_reduce_scalar_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_set_storage_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_set_storage_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_set_storage_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_set_storage_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_set_storage_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_set_storage_cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_cuda_int8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_cuda_uint16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_cuda_uint32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_cuda_uint64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_errors_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_errors_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_errors_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_errors_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_errors_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_errors_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_from_tensor_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_ok_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_ok_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_ok_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_meta_ok_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_setitem_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_setitem_cuda_qint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_storage_setitem_cuda_uint8, test/test_torch.py::TestTorchDeviceTypeCUDA::test_swap_data_ptr_self_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_take_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_from_storage_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_from_storage_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_from_storage_cuda_uint32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_from_storage_cuda_uint64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_shape_empty_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_storage_type_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_storage_type_cuda_bool, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_storage_type_cuda_complex64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_storage_type_cuda_int32, test/test_torch.py::TestTorchDeviceTypeCUDA::test_tensor_type_cuda, test/test_torch.py::TestTorchDeviceTypeCUDA::test_ternary_op_mem_overlap_cuda_float64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_typed_storage_meta_cuda_complex128, test/test_torch.py::TestTorchDeviceTypeCUDA::test_typed_storage_meta_cuda_float16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_typed_storage_meta_cuda_int16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_typed_storage_meta_cuda_int64, test/test_torch.py::TestTorchDeviceTypeCUDA::test_uniform_kstest_cuda_bfloat16, test/test_torch.py::TestTorchDeviceTypeCUDA::test_uniform_kstest_cuda_float32, test/test_torch.py::TestDevicePrecisionCUDA::test_advancedindex_mixed_devices_error_cuda, test/test_torch.py::TestDevicePrecisionCUDA::test_clamp_cuda_float32, test/test_torch.py::TestDevicePrecisionCUDA::test_clamp_cuda_int64, test/test_torch.py::TestDevicePrecisionCUDA::test_copy_broadcast_cuda, test/test_torch.py::TestDevicePrecisionCUDA::test_copy_noncontig_cuda, test/test_torch.py::TestDevicePrecisionCUDA::test_device_serialization_cuda, test/test_torch.py::TestDevicePrecisionCUDA::test_from_sequence_cuda_float32, test/test_torch.py::TestDevicePrecisionCUDA::test_from_sequence_cuda_int32, test/test_torch.py::TestDevicePrecisionCUDA::test_from_sequence_cuda_int8, test/test_torch.py::TestDevicePrecisionCUDA::test_index_add_bfloat16_cuda, test/test_torch.py::TestDevicePrecisionCUDA::test_type_conversions_same_device_cuda
[2026-05-27T21:42:08.156Z] 
[2026-05-27T21:42:08.156Z] Finished test_torch 3/3 ... [2026-05-27 21:42:02.334178][37988.539499295], took 8.11min
[2026-05-27T21:42:08.156Z] Running test_modules 1/5 ... [2026-05-27 21:42:02.352465][37988.557787992]
[2026-05-27T21:42:08.156Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:08.156Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'serial', '--shard-id=1', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:02.352847]
[2026-05-27T21:42:08.156Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_torch/test_torch-fd213c7b0281fd2a.xml
[2026-05-27T21:42:08.156Z] Found job id: None
[2026-05-27T21:42:08.156Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:08.156Z] 
[2026-05-27T21:42:08.156Z] test_modules 1/5 was successful, full logs can be found in artifacts with path test/test-reports/test_modules_1.5_0efe322a353f364a_.log
[2026-05-27T21:42:08.156Z] Running 0 items in this shard:
[2026-05-27T21:42:08.156Z] 
[2026-05-27T21:42:08.156Z] Finished test_modules 1/5 ... [2026-05-27 21:42:07.177598][37993.382919594], took 0.08min
[2026-05-27T21:42:08.156Z] Running test_modules 2/5 ... [2026-05-27 21:42:07.180333][37993.385655579]
[2026-05-27T21:42:08.156Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:08.156Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'serial', '--shard-id=2', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:07.180715]
[2026-05-27T21:42:08.156Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:08.156Z] Found job id: None
[2026-05-27T21:42:08.156Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:12.432Z] 
[2026-05-27T21:42:12.432Z] test_modules 2/5 was successful, full logs can be found in artifacts with path test/test-reports/test_modules_2.5_3c80abcafca8ed84_.log
[2026-05-27T21:42:12.432Z] Running 0 items in this shard:
[2026-05-27T21:42:12.432Z] 
[2026-05-27T21:42:12.432Z] Finished test_modules 2/5 ... [2026-05-27 21:42:11.905317][37998.110640471], took 0.08min
[2026-05-27T21:42:12.432Z] Running test_modules 3/5 ... [2026-05-27 21:42:11.907211][37998.112536751]
[2026-05-27T21:42:12.432Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:12.432Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'serial', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:11.907425]
[2026-05-27T21:42:12.432Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:12.433Z] Found job id: None
[2026-05-27T21:42:12.433Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:16.815Z] 
[2026-05-27T21:42:16.815Z] test_modules 3/5 was successful, full logs can be found in artifacts with path test/test-reports/test_modules_3.5_99e4428e51160788_.log
[2026-05-27T21:42:16.815Z] Running 0 items in this shard:
[2026-05-27T21:42:16.815Z] 
[2026-05-27T21:42:16.815Z] Finished test_modules 3/5 ... [2026-05-27 21:42:16.331114][38002.536435528], took 0.07min
[2026-05-27T21:42:16.815Z] Running test_modules 4/5 ... [2026-05-27 21:42:16.333309][38002.538632425]
[2026-05-27T21:42:16.815Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:16.815Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'serial', '--shard-id=4', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:16.333712]
[2026-05-27T21:42:16.815Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:16.815Z] Found job id: None
[2026-05-27T21:42:16.815Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:21.068Z] 
[2026-05-27T21:42:21.068Z] test_modules 4/5 was successful, full logs can be found in artifacts with path test/test-reports/test_modules_4.5_6d4d848ac7b491f8_.log
[2026-05-27T21:42:21.068Z] Running 0 items in this shard:
[2026-05-27T21:42:21.068Z] 
[2026-05-27T21:42:21.068Z] Finished test_modules 4/5 ... [2026-05-27 21:42:20.857651][38007.062974411], took 0.08min
[2026-05-27T21:42:21.068Z] Running test_modules 5/5 ... [2026-05-27 21:42:20.859612][38007.064937828]
[2026-05-27T21:42:21.068Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:21.068Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'serial', '--shard-id=5', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:20.859813]
[2026-05-27T21:42:21.068Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:21.068Z] Found job id: None
[2026-05-27T21:42:21.068Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:27.216Z] 
[2026-05-27T21:42:27.216Z] test_modules 5/5 was successful, full logs can be found in artifacts with path test/test-reports/test_modules_5.5_254446e8aa39423a_.log
[2026-05-27T21:42:27.216Z] Running 0 items in this shard:
[2026-05-27T21:42:27.216Z] 
[2026-05-27T21:42:27.216Z] Finished test_modules 5/5 ... [2026-05-27 21:42:25.333020][38011.538340955], took 0.07min
[2026-05-27T21:42:27.216Z] Running test_ops 1/12 ... [2026-05-27 21:42:25.334682][38011.540007461]
[2026-05-27T21:42:27.216Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:27.216Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=1', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:25.334923]
[2026-05-27T21:42:27.216Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:27.216Z] Found job id: None
[2026-05-27T21:42:27.216Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:36.736Z] 
[2026-05-27T21:42:36.736Z] test_ops 1/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_1.12_141a627a69558dfa_.log
[2026-05-27T21:42:36.736Z] Running 0 items in this shard:
[2026-05-27T21:42:36.736Z] 
[2026-05-27T21:42:36.736Z] Finished test_ops 1/12 ... [2026-05-27 21:42:36.270150][38022.475474325], took 0.18min
[2026-05-27T21:42:36.736Z] Running test_ops 2/12 ... [2026-05-27 21:42:36.271497][38022.476822851]
[2026-05-27T21:42:36.736Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:36.736Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=2', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:36.271710]
[2026-05-27T21:42:36.736Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:36.736Z] Found job id: None
[2026-05-27T21:42:36.736Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:48.165Z] 
[2026-05-27T21:42:48.165Z] test_ops 2/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_2.12_e719e3f92583bb52_.log
[2026-05-27T21:42:48.165Z] Running 0 items in this shard:
[2026-05-27T21:42:48.165Z] 
[2026-05-27T21:42:48.165Z] Finished test_ops 2/12 ... [2026-05-27 21:42:47.161392][38033.366717148], took 0.18min
[2026-05-27T21:42:48.165Z] Running test_ops 3/12 ... [2026-05-27 21:42:47.162868][38033.368193395]
[2026-05-27T21:42:48.165Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:48.165Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=3', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:47.163094]
[2026-05-27T21:42:48.165Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:48.165Z] Found job id: None
[2026-05-27T21:42:48.165Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:42:58.527Z] 
[2026-05-27T21:42:58.527Z] test_ops 3/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_3.12_fabaf48da3f17350_.log
[2026-05-27T21:42:58.527Z] Running 0 items in this shard:
[2026-05-27T21:42:58.527Z] 
[2026-05-27T21:42:58.527Z] Finished test_ops 3/12 ... [2026-05-27 21:42:58.100300][38044.305623046], took 0.18min
[2026-05-27T21:42:58.527Z] Running test_ops 4/12 ... [2026-05-27 21:42:58.101927][38044.307252933]
[2026-05-27T21:42:58.527Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:42:58.527Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=4', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:42:58.102117]
[2026-05-27T21:42:58.527Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:42:58.527Z] Found job id: None
[2026-05-27T21:42:58.527Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:43:10.039Z] 
[2026-05-27T21:43:10.039Z] test_ops 4/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_4.12_aee25cd34f272bc0_.log
[2026-05-27T21:43:10.039Z] Running 0 items in this shard:
[2026-05-27T21:43:10.039Z] 
[2026-05-27T21:43:10.039Z] Finished test_ops 4/12 ... [2026-05-27 21:43:09.283978][38055.489302698], took 0.19min
[2026-05-27T21:43:10.039Z] Running test_ops 5/12 ... [2026-05-27 21:43:09.286239][38055.491562164]
[2026-05-27T21:43:10.039Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:43:10.039Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=5', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:43:09.286629]
[2026-05-27T21:43:10.039Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:43:10.039Z] Found job id: None
[2026-05-27T21:43:10.039Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:43:24.058Z] 
[2026-05-27T21:43:24.058Z] test_ops 5/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_5.12_bd3ceb8dbf88a6e8_.log
[2026-05-27T21:43:24.058Z] Running 0 items in this shard:
[2026-05-27T21:43:24.058Z] 
[2026-05-27T21:43:24.058Z] Finished test_ops 5/12 ... [2026-05-27 21:43:20.771346][38066.976668356], took 0.19min
[2026-05-27T21:43:24.058Z] Running test_ops 6/12 ... [2026-05-27 21:43:20.773610][38066.978933082]
[2026-05-27T21:43:24.058Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:43:24.058Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=6', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:43:20.774007]
[2026-05-27T21:43:24.058Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:43:24.058Z] Found job id: None
[2026-05-27T21:43:24.058Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:43:32.150Z] 
[2026-05-27T21:43:32.150Z] test_ops 6/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_6.12_965c068eca5a749a_.log
[2026-05-27T21:43:32.150Z] Running 0 items in this shard:
[2026-05-27T21:43:32.150Z] 
[2026-05-27T21:43:32.150Z] Finished test_ops 6/12 ... [2026-05-27 21:43:31.756949][38077.962270987], took 0.18min
[2026-05-27T21:43:32.150Z] Running test_ops 7/12 ... [2026-05-27 21:43:31.758523][38077.963849357]
[2026-05-27T21:43:32.150Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:43:32.150Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=7', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:43:31.758715]
[2026-05-27T21:43:32.150Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:43:32.150Z] Found job id: None
[2026-05-27T21:43:32.150Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:43:44.982Z] 
[2026-05-27T21:43:44.982Z] test_ops 7/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_7.12_e445128ac9a92065_.log
[2026-05-27T21:43:44.982Z] Running 0 items in this shard:
[2026-05-27T21:43:44.982Z] 
[2026-05-27T21:43:44.982Z] Finished test_ops 7/12 ... [2026-05-27 21:43:43.499801][38089.705123736], took 0.20min
[2026-05-27T21:43:44.982Z] Running test_ops 8/12 ... [2026-05-27 21:43:43.502169][38089.707491386]
[2026-05-27T21:43:44.982Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:43:44.982Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=8', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:43:43.502591]
[2026-05-27T21:43:44.982Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:43:44.982Z] Found job id: None
[2026-05-27T21:43:44.982Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:43:57.117Z] 
[2026-05-27T21:43:57.117Z] test_ops 8/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_8.12_3bef723931ad4d5e_.log
[2026-05-27T21:43:57.117Z] Running 0 items in this shard:
[2026-05-27T21:43:57.117Z] 
[2026-05-27T21:43:57.117Z] Finished test_ops 8/12 ... [2026-05-27 21:43:55.193666][38101.398990715], took 0.19min
[2026-05-27T21:43:57.117Z] Running test_ops 9/12 ... [2026-05-27 21:43:55.195046][38101.400372454]
[2026-05-27T21:43:57.117Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:43:57.117Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=9', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:43:55.195240]
[2026-05-27T21:43:57.117Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:43:57.117Z] Found job id: None
[2026-05-27T21:43:57.117Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:08.627Z] 
[2026-05-27T21:44:08.627Z] test_ops 9/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_9.12_36619d685fd94e86_.log
[2026-05-27T21:44:08.627Z] Running 0 items in this shard:
[2026-05-27T21:44:08.627Z] 
[2026-05-27T21:44:08.627Z] Finished test_ops 9/12 ... [2026-05-27 21:44:06.628278][38112.833603404], took 0.19min
[2026-05-27T21:44:08.627Z] Running test_ops 10/12 ... [2026-05-27 21:44:06.629586][38112.834912335]
[2026-05-27T21:44:08.627Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:08.627Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=10', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:06.629790]
[2026-05-27T21:44:08.627Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:44:08.627Z] Found job id: None
[2026-05-27T21:44:08.627Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:18.097Z] 
[2026-05-27T21:44:18.097Z] test_ops 10/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_10.12_9b1536859a2adcf0_.log
[2026-05-27T21:44:18.097Z] Running 0 items in this shard:
[2026-05-27T21:44:18.097Z] 
[2026-05-27T21:44:18.097Z] Finished test_ops 10/12 ... [2026-05-27 21:44:17.466808][38123.672129782], took 0.18min
[2026-05-27T21:44:18.097Z] Running test_ops 11/12 ... [2026-05-27 21:44:17.469109][38123.674431076]
[2026-05-27T21:44:18.097Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:18.097Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=11', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:17.469485]
[2026-05-27T21:44:18.097Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:44:18.097Z] Found job id: None
[2026-05-27T21:44:18.097Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:28.784Z] 
[2026-05-27T21:44:28.784Z] test_ops 11/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_11.12_cefc996042a27ab8_.log
[2026-05-27T21:44:28.784Z] Running 0 items in this shard:
[2026-05-27T21:44:28.784Z] 
[2026-05-27T21:44:28.784Z] Finished test_ops 11/12 ... [2026-05-27 21:44:28.205902][38134.411224211], took 0.18min
[2026-05-27T21:44:28.784Z] Running test_ops 12/12 ... [2026-05-27 21:44:28.208136][38134.413458809]
[2026-05-27T21:44:28.784Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:28.784Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=12', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:28.208507]
[2026-05-27T21:44:28.784Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:44:28.784Z] Found job id: None
[2026-05-27T21:44:28.784Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:40.327Z] 
[2026-05-27T21:44:40.327Z] test_ops 12/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_12.12_b588111e4e88a61b_.log
[2026-05-27T21:44:40.327Z] Running 0 items in this shard:
[2026-05-27T21:44:40.327Z] 
[2026-05-27T21:44:40.327Z] Finished test_ops 12/12 ... [2026-05-27 21:44:38.651500][38144.856824247], took 0.17min
[2026-05-27T21:44:40.327Z] Running test_ops_gradients 1/2 ... [2026-05-27 21:44:38.653776][38144.859097849]
[2026-05-27T21:44:40.327Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:40.327Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops_gradients.py', '-m', 'serial', '--shard-id=1', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:38.654156]
[2026-05-27T21:44:40.327Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:44:40.327Z] Found job id: None
[2026-05-27T21:44:40.327Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:43.740Z] 
[2026-05-27T21:44:43.740Z] test_ops_gradients 1/2 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_gradients_1.2_8febaeb8c261ed59_.log
[2026-05-27T21:44:43.740Z] Running 0 items in this shard:
[2026-05-27T21:44:43.740Z] 
[2026-05-27T21:44:43.740Z] Finished test_ops_gradients 1/2 ... [2026-05-27 21:44:43.227704][38149.433026175], took 0.08min
[2026-05-27T21:44:43.740Z] Running test_ops_gradients 2/2 ... [2026-05-27 21:44:43.230054][38149.435376453]
[2026-05-27T21:44:43.740Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:43.740Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops_gradients.py', '-m', 'serial', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:43.230437]
[2026-05-27T21:44:43.740Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:44:43.740Z] Found job id: None
[2026-05-27T21:44:43.740Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:48.312Z] 
[2026-05-27T21:44:48.312Z] test_ops_gradients 2/2 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_gradients_2.2_e2b6ec9bb90488d3_.log
[2026-05-27T21:44:48.312Z] Running 0 items in this shard:
[2026-05-27T21:44:48.312Z] 
[2026-05-27T21:44:48.312Z] Finished test_ops_gradients 2/2 ... [2026-05-27 21:44:47.761385][38153.966707288], took 0.08min
[2026-05-27T21:44:48.312Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_modules/test_modules-27fb2fe01fa74c35.xml
[2026-05-27T21:44:48.312Z] Found job id: None
[2026-05-27T21:44:48.312Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-05-27T21:44:51.055Z] Running test_modules 1/5 ... [2026-05-27 21:44:51.001340][38157.206661109]
[2026-05-27T21:44:51.055Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.055Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'not serial', '--shard-id=1', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.001616]
[2026-05-27T21:44:51.055Z] Running test_modules 2/5 ... [2026-05-27 21:44:51.021049][38157.226370338]
[2026-05-27T21:44:51.055Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.055Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'not serial', '--shard-id=2', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.021328]
[2026-05-27T21:44:51.439Z] Running test_modules 3/5 ... [2026-05-27 21:44:51.075895][38157.281219359]
[2026-05-27T21:44:51.439Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.439Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'not serial', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.076155]
[2026-05-27T21:44:51.439Z] Running test_modules 4/5 ... [2026-05-27 21:44:51.100847][38157.306169302]
[2026-05-27T21:44:51.439Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.439Z] Running test_modules 5/5 ... [2026-05-27 21:44:51.101000][38157.306322251]
[2026-05-27T21:44:51.439Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.439Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'not serial', '--shard-id=4', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.101104]
[2026-05-27T21:44:51.439Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_modules.py', '-m', 'not serial', '--shard-id=5', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.101290]
[2026-05-27T21:44:51.439Z] Running test_ops 1/12 ... [2026-05-27 21:44:51.107846][38157.31317039]
[2026-05-27T21:44:51.439Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.439Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'not serial', '--shard-id=1', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.108109]
[2026-05-27T21:44:51.439Z] Running test_ops 2/12 ... [2026-05-27 21:44:51.121819][38157.327139753]
[2026-05-27T21:44:51.439Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.439Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'not serial', '--shard-id=2', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.122167]
[2026-05-27T21:44:51.439Z] Running test_ops 3/12 ... [2026-05-27 21:44:51.273797][38157.479115922]
[2026-05-27T21:44:51.439Z] SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
[2026-05-27T21:44:51.439Z] Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '-m', 'not serial', '--shard-id=3', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2026-05-27 21:44:51.274122]
[2026-05-27T22:02:29.613Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:02:29.913Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:02:49.914Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:02:50.214Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:03:10.214Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:03:10.514Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:03:30.515Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:03:30.815Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:03:50.815Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:03:51.115Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:04:11.116Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:04:11.416Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:04:31.416Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:04:31.717Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:04:51.717Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:04:52.017Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:05:12.018Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:05:12.318Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:05:32.318Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:05:32.618Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:05:52.619Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:05:52.919Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:06:12.919Z] k8s-mi250-1-z5206 seems to be removed or offline (java.lang.InterruptedException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:06:13.219Z] k8s-mi250-1-z5206 is back online
[2026-05-27T22:06:18.774Z] k8s-mi250-1-z5206 seems to be removed or offline (hudson.remoting.RequestAbortedException: java.nio.channels.ClosedChannelException); will wait for 5 min 0 sec for it to come back online
[2026-05-27T22:11:24.766Z] k8s-mi250-1-z5206 has been removed or offline for 5 min 0 sec; assuming it is not coming back, and terminating shell step

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Error signal

Error in error step, with arguments pytorch_inductor_1 failed.

pytorch_inductor_1 failed

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Archive JUnit-formatted test results

Error in junit step.

Unable to create live FilePath for k8s-mi250-1-z5206; k8s-mi250-1-z5206 was marked offline: Connection was broken
Build log
[2026-05-27T22:11:24.944Z] ERROR: Issue with creating launcher for agent k8s-mi250-1-z5206. The agent has not been fully initialized yet

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Error signal

Error in error step, with arguments Failed to publish test reports xml files.

Failed to publish test reports xml files

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Create Zip file

Error in zip step.

Unable to create live FilePath for k8s-mi250-1-z5206; k8s-mi250-1-z5206 was marked offline: Connection was broken

Tests / Test Inductor / Test Inductor / Run pytorch_inductor_1 / Error signal

Error in error step, with arguments Failed to archive test reports xml files.

Failed to archive test reports xml files

Details

  • Kill older PR Builds (1.8 sec)
  • Initialize (1 hr 19 min)
    • Download CI scripts (39 sec)
    • Checkout Pytorch (4 min 14 sec)
    • Check base Docker image existence (10 sec)
    • Pull Docker Image (12 min)
    • Build PyTorch (1 hr 0 min)
  • Tests (7 hr 34 min)
    • Test PyTorch (19 ms)
      • Test PyTorch (2 hr 7 min)
        • Run pytorch_test_1 (1 hr 29 min)
          Error: Found 1 failure(s) in pytorch_reports/python-pytest/test_cuda/test_cuda-29539ab49c79773c.xml report
          Found 1 failure(s) in pytorch_reports/python-pytest/test_cuda/test_cuda-2ddf2a5e0abf14c8.xml report
          - logs
          Error: Some tests are failed or errored - logs
          Error: pytorch_test_1 failed - logs
          Unstable: 2 tests failed - logs
        • Run pytorch_test_2 (37 min)
          Error: Found 1 failure(s) in pytorch_reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-92d6503e72d3a5c7.xml report - logs
          Error: Some tests are failed or errored - logs
          Error: pytorch_test_2 failed - logs
          Unstable: 1 tests failed - logs
    • Test Distributed (27 ms)
      • Test Distributed (7 hr 34 min)
        • Run pytorch_distributed_1 (1 hr 29 min)
          Error: script returned exit code 1 - logs
          Error: pytorch_distributed_1 failed - logs
          Error: No test report files were found. Configuration error? - logs
          Error: Failed to publish test reports xml files - logs
          Error: java.nio.file.AccessDeniedException: /home/jenkins/internal/workspace/orch_pytorch-ci-pipeline_PR-3259/pytorch_reports/pytorch_distributed_1.zip - logs
          Error: Failed to archive test reports xml files - logs
        • Run pytorch_distributed_2 (6 hr 4 min)
          Error: script returned exit code 1 - logs
    • Test Inductor (0.1 sec)
      • Test Inductor (1 hr 30 min)
        • Run pytorch_inductor_1 (1 hr 30 min)
          Error: script returned exit code 1 - logs
          Error: Timeout waiting for agent to come back - logs
          Error: pytorch_inductor_1 failed - logs
          Error: Unable to create live FilePath for k8s-mi250-1-z5206; k8s-mi250-1-z5206 was marked offline: Connection was broken - logs
          Error: Failed to publish test reports xml files - logs
          Error: Unable to create live FilePath for k8s-mi250-1-z5206; k8s-mi250-1-z5206 was marked offline: Connection was broken - logs
          Error: Failed to archive test reports xml files - logs
    • Test PyTorch Slow (0.11 sec)
      • Test PyTorch Slow (7.7 sec)
    • Microbenchmark (16 sec)
      • Microbenchmark (7.7 sec)
  • Post Build (2.8 sec)
  • Declarative: Post Actions (4.8 sec)