Jobsub ID 11267.1@dunegpschedd02.fnal.gov
Jobsub ID | 11267.1@dunegpschedd02.fnal.gov |
Workflow ID | 70 |
Stage ID | 1 |
User name | twalton@fnal.gov |
HTCondor Group | group_dune.prod.mcsim |
Requested | Processors | 1 |
GPU | No |
RSS bytes | 2097152000 (2000 MiB) |
Wall seconds limit | 3600 (1 hours) |
Submitted time | 2025-07-25 17:21:32 |
Site | UK_RAL-Tier1 |
Entry | LIGO_UK_RAL_arc_ce04 |
Last heartbeat | 2025-07-25 17:31:52 |
From worker node | Hostname | dune001-6958869.0-lcg2678.gridpp.rl.ac.uk |
cpuinfo | AMD EPYC 7763 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 2097152000 (2000 MiB) |
Wall seconds limit | 216000 (60 hours) |
GPU | |
Inner Apptainer? | True |
Job state | outputting_failed |
Started | 2025-07-25 17:23:27 |
Input files | neardet-2x2-lar-charge:binary-0020057-2024_11_03_00_05_53_CET.hdf5
|
Jobscript | Exit code | 0 |
Real time | 7m (471s) |
CPU time | 1m (100s = 21%) |
Max RSS bytes | 395210752 (376 MiB) |
Outputting started | 2025-07-25 17:31:20 |
Output files | |
Finished | 2025-07-25 17:31:52 |
List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
, 14.98it/s]
53%|#####2 | 397/756 [00:24<00:23, 14.97it/s]
53%|#####2 | 399/756 [00:24<00:21, 16.26it/s]
53%|#####3 | 401/756 [00:24<00:27, 13.02it/s]
53%|#####3 | 403/756 [00:24<00:27, 12.92it/s]
54%|#####3 | 405/756 [00:24<00:27, 12.72it/s]
54%|#####3 | 407/756 [00:25<00:27, 12.59it/s]
54%|#####4 | 409/756 [00:25<00:27, 12.73it/s]
54%|#####4 | 411/756 [00:25<00:27, 12.77it/s]
55%|#####4 | 413/756 [00:25<00:19, 17.20it/s]
55%|#####4 | 415/756 [00:25<00:20, 16.35it/s]
55%|#####5 | 417/756 [00:25<00:26, 12.63it/s]
55%|#####5 | 419/756 [00:25<00:26, 12.61it/s]
56%|#####5 | 421/756 [00:26<00:23, 14.55it/s]
56%|#####5 | 423/756 [00:26<00:19, 17.43it/s]
56%|#####6 | 425/756 [00:26<00:19, 17.42it/s]
56%|#####6 | 427/756 [00:26<00:18, 17.33it/s]
57%|#####6 | 429/756 [00:26<00:18, 17.28it/s]
57%|#####7 | 431/756 [00:26<00:18, 17.11it/s]
57%|#####7 | 433/756 [00:26<00:18, 17.33it/s]
58%|#####7 | 435/756 [00:26<00:18, 17.25it/s]
58%|#####7 | 437/756 [00:26<00:18, 17.15it/s]
58%|#####8 | 439/756 [00:27<00:18, 17.41it/s]
58%|#####8 | 441/756 [00:27<00:18, 17.15it/s]
59%|#####8 | 443/756 [00:27<00:18, 17.22it/s]
59%|#####8 | 445/756 [00:27<00:17, 17.43it/s]
59%|#####9 | 447/756 [00:27<00:18, 17.03it/s]
59%|#####9 | 449/756 [00:27<00:17, 17.07it/s]
60%|#####9 | 451/756 [00:27<00:17, 17.08it/s]
60%|#####9 | 453/756 [00:27<00:17, 17.36it/s]
60%|###### | 455/756 [00:28<00:17, 17.26it/s]
60%|###### | 457/756 [00:28<00:17, 17.26it/s]
61%|###### | 459/756 [00:28<00:17, 17.16it/s]
61%|###### | 461/756 [00:28<00:17, 17.00it/s]
61%|######1 | 463/756 [00:28<00:17, 17.16it/s]
62%|######1 | 465/756 [00:28<00:16, 17.12it/s]
62%|######1 | 467/756 [00:28<00:16, 17.12it/s]
62%|######2 | 469/756 [00:28<00:18, 15.64it/s]
62%|######2 | 471/756 [00:28<00:16, 17.36it/s]
63%|######2 | 473/756 [00:29<00:16, 17.61it/s]
63%|######2 | 475/756 [00:29<00:16, 17.18it/s]
63%|######3 | 477/756 [00:29<00:22, 12.59it/s]
63%|######3 | 479/756 [00:29<00:17, 15.99it/s]
64%|######3 | 481/756 [00:29<00:15, 17.24it/s]
64%|######3 | 483/756 [00:29<00:15, 17.21it/s]
64%|######4 | 485/756 [00:29<00:15, 17.58it/s]
64%|######4 | 487/756 [00:29<00:15, 17.60it/s]
65%|######4 | 489/756 [00:30<00:15, 17.22it/s]
65%|######4 | 491/756 [00:30<00:15, 17.57it/s]
65%|######5 | 493/756 [00:30<00:15, 17.49it/s]
65%|######5 | 495/756 [00:30<00:15, 17.15it/s]
66%|######5 | 497/756 [00:30<00:15, 17.22it/s]
66%|######6 | 499/756 [00:30<00:14, 17.31it/s]
66%|######6 | 501/756 [00:30<00:14, 17.59it/s]
67%|######6 | 503/756 [00:30<00:14, 17.46it/s]
67%|######6 | 505/756 [00:30<00:14, 17.46it/s]
67%|######7 | 507/756 [00:31<00:14, 17.49it/s]
67%|######7 | 509/756 [00:31<00:14, 17.36it/s]
68%|######7 | 511/756 [00:31<00:14, 17.39it/s]
68%|######7 | 513/756 [00:31<00:14, 17.10it/s]
68%|######8 | 515/756 [00:31<00:14, 16.21it/s]
68%|######8 | 517/756 [00:31<00:13, 17.31it/s]
69%|######8 | 519/756 [00:31<00:14, 15.97it/s]
69%|######8 | 521/756 [00:31<00:13, 17.57it/s]
69%|######9 | 523/756 [00:32<00:16, 14.49it/s]
69%|######9 | 525/756 [00:32<00:13, 17.59it/s]
70%|######9 | 527/756 [00:32<00:13, 17.51it/s]
70%|######9 | 529/756 [00:32<00:13, 17.38it/s]
70%|####### | 531/756 [00:32<00:12, 17.41it/s]
71%|####### | 533/756 [00:32<00:13, 16.07it/s]
71%|####### | 535/756 [00:32<00:14, 15.24it/s]
71%|#######1 | 537/756 [00:32<00:14, 15.37it/s]
71%|#######1 | 539/756 [00:33<00:12, 17.60it/s]
72%|#######1 | 541/756 [00:33<00:12, 17.57it/s]
72%|#######1 | 543/756 [00:33<00:12, 17.47it/s]
72%|#######2 | 545/756 [00:33<00:12, 17.52it/s]
72%|#######2 | 547/756 [00:33<00:15, 13.92it/s]
73%|#######2 | 549/756 [00:33<00:14, 14.34it/s]
73%|#######2 | 551/756 [00:33<00:15, 13.12it/s]
73%|#######3 | 553/756 [00:33<00:15, 13.48it/s]
73%|#######3 | 555/756 [00:34<00:11, 17.84it/s]
74%|#######3 | 557/756 [00:34<00:13, 14.64it/s]
74%|#######3 | 559/756 [00:34<00:14, 13.41it/s]
74%|#######4 | 561/756 [00:34<00:14, 13.17it/s]
74%|#######4 | 563/756 [00:34<00:14, 13.11it/s]
75%|#######4 | 565/756 [00:34<00:14, 13.27it/s]
75%|#######5 | 567/756 [00:34<00:12, 15.37it/s]
75%|#######5 | 569/756 [00:35<00:10, 17.61it/s]
76%|#######5 | 571/756 [00:35<00:10, 17.50it/s]
76%|#######5 | 573/756 [00:35<00:10, 17.54it/s]
76%|#######6 | 575/756 [00:35<00:10, 17.56it/s]
76%|#######6 | 577/756 [00:35<00:10, 17.65it/s]
77%|#######6 | 579/756 [00:35<00:10, 17.51it/s]
77%|#######6 | 581/756 [00:35<00:10, 17.43it/s]
77%|#######7 | 583/756 [00:35<00:09, 17.37it/s]
77%|#######7 | 585/756 [00:35<00:09, 17.62it/s]
78%|#######7 | 587/756 [00:36<00:09, 17.81it/s]
78%|#######7 | 589/756 [00:36<00:09, 17.61it/s]
78%|#######8 | 591/756 [00:36<00:10, 15.88it/s]
78%|#######8 | 593/756 [00:36<00:09, 17.40it/s]
79%|#######8 | 595/756 [00:36<00:09, 17.51it/s]
79%|#######8 | 597/756 [00:36<00:09, 17.46it/s]
79%|#######9 | 599/756 [00:36<00:09, 17.38it/s]
79%|#######9 | 601/756 [00:36<00:08, 17.35it/s]
80%|#######9 | 603/756 [00:37<00:09, 15.82it/s]
80%|######## | 605/756 [00:37<00:08, 17.12it/s]
80%|######## | 607/756 [00:37<00:09, 16.17it/s]
81%|######## | 609/756 [00:37<00:08, 17.37it/s]
81%|######## | 611/756 [00:37<00:08, 16.90it/s]
81%|########1 | 613/756 [00:37<00:08, 17.28it/s]
81%|########1 | 615/756 [00:37<00:08, 17.11it/s]
82%|########1 | 617/756 [00:37<00:08, 16.93it/s]
82%|########1 | 619/756 [00:37<00:08, 16.14it/s]
82%|########2 | 621/756 [00:38<00:08, 16.24it/s]
82%|########2 | 623/756 [00:38<00:08, 15.66it/s]
83%|########2 | 625/756 [00:38<00:09, 13.90it/s]
83%|########2 | 627/756 [00:38<00:07, 16.72it/s]
83%|########3 | 629/756 [00:38<00:09, 12.77it/s]
83%|########3 | 631/756 [00:38<00:09, 12.69it/s]
84%|########3 | 633/756 [00:38<00:09, 13.61it/s]
84%|########3 | 635/756 [00:39<00:09, 12.62it/s]
84%|########4 | 637/756 [00:39<00:08, 13.55it/s]
85%|########4 | 639/756 [00:39<00:06, 16.77it/s]
85%|########4 | 641/756 [00:39<00:06, 16.77it/s]
85%|########5 | 643/756 [00:39<00:06, 16.82it/s]
85%|########5 | 645/756 [00:39<00:06, 16.89it/s]
86%|########5 | 647/756 [00:39<00:06, 16.77it/s]
86%|########5 | 649/756 [00:39<00:06, 16.75it/s]
86%|########6 | 651/756 [00:40<00:06, 15.66it/s]
86%|########6 | 653/756 [00:40<00:06, 16.68it/s]
87%|########6 | 655/756 [00:40<00:06, 16.76it/s]
87%|########6 | 657/756 [00:40<00:05, 16.63it/s]
87%|########7 | 659/756 [00:40<00:05, 16.48it/s]
87%|########7 | 661/756 [00:40<00:05, 16.56it/s]
88%|########7 | 663/756 [00:40<00:06, 13.52it/s]
88%|########7 | 665/756 [00:40<00:07, 12.70it/s]
88%|########8 | 667/756 [00:41<00:05, 15.06it/s]
88%|########8 | 669/756 [00:41<00:05, 16.49it/s]
89%|########8 | 671/756 [00:41<00:05, 16.76it/s]
89%|########9 | 673/756 [00:41<00:04, 16.78it/s]
89%|########9 | 675/756 [00:41<00:04, 16.77it/s]
90%|########9 | 677/756 [00:41<00:04, 16.87it/s]
90%|########9 | 679/756 [00:41<00:04, 16.84it/s]
90%|######### | 681/756 [00:41<00:04, 16.94it/s]
90%|######### | 683/756 [00:42<00:04, 16.76it/s]
91%|######### | 685/756 [00:42<00:04, 16.66it/s]
91%|######### | 687/756 [00:42<00:04, 16.77it/s]
91%|#########1| 689/756 [00:42<00:04, 16.72it/s]
91%|#########1| 691/756 [00:42<00:03, 16.71it/s]
92%|#########1| 693/756 [00:42<00:03, 16.80it/s]
92%|#########1| 695/756 [00:42<00:03, 16.79it/s]
92%|#########2| 697/756 [00:42<00:04, 14.50it/s]
92%|#########2| 699/756 [00:43<00:03, 14.36it/s]
93%|#########2| 701/756 [00:43<00:03, 15.40it/s]
93%|#########2| 703/756 [00:43<00:03, 15.22it/s]
93%|#########3| 705/756 [00:43<00:03, 16.94it/s]
94%|#########3| 707/756 [00:43<00:02, 16.78it/s]
94%|#########3| 709/756 [00:43<00:02, 16.59it/s]
94%|#########4| 711/756 [00:43<00:02, 17.04it/s]
94%|#########4| 713/756 [00:43<00:02, 16.98it/s]
95%|#########4| 715/756 [00:44<00:02, 16.78it/s]
95%|#########4| 717/756 [00:44<00:02, 16.86it/s]
95%|#########5| 719/756 [00:44<00:02, 16.76it/s]
95%|#########5| 721/756 [00:44<00:02, 16.76it/s]
96%|#########5| 723/756 [00:44<00:01, 16.72it/s]
96%|#########5| 725/756 [00:44<00:01, 16.59it/s]
96%|#########6| 727/756 [00:44<00:01, 16.51it/s]
96%|#########6| 729/756 [00:44<00:01, 16.74it/s]
97%|#########6| 731/756 [00:45<00:01, 16.95it/s]
97%|#########6| 733/756 [00:45<00:01, 16.71it/s]
97%|#########7| 735/756 [00:45<00:01, 16.87it/s]
97%|#########7| 737/756 [00:45<00:01, 16.92it/s]
98%|#########7| 739/756 [00:45<00:01, 16.89it/s]
98%|#########8| 741/756 [00:45<00:00, 16.86it/s]
98%|#########8| 743/756 [00:45<00:00, 14.13it/s]
99%|#########8| 745/756 [00:45<00:00, 16.88it/s]
99%|#########8| 747/756 [00:46<00:00, 13.88it/s]
99%|#########9| 749/756 [00:46<00:00, 12.61it/s]
99%|#########9| 751/756 [00:46<00:00, 12.59it/s]
100%|#########9| 753/756 [00:46<00:00, 12.96it/s]
100%|#########9| 755/756 [00:46<00:00, 15.33it/s]
757it [00:46, 16.21it/s]
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/dunend/2x2//releases/v1.5.0/ndlar_prod_scripts/ndlar_reflow/scripts/get_light_event_range.py", line 78, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/dunend/2x2//releases/v1.5.0/ndlar_prod_scripts/ndlar_reflow/scripts/get_light_event_range.py", line 70, in main
start_pos, end_pos = get_limits(chargef_h5,
^^^^^^^^^^^^^^^^^^^^^^
File "/cvmfs/dune.opensciencegrid.org/dunend/2x2//releases/v1.5.0/ndlar_prod_scripts/ndlar_reflow/scripts/get_light_event_range.py", line 38, in get_limits
start_pos = np.where(tstamps_first_l >= tmin_c)[0][0]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^
IndexError: index 0 is out of bounds for axis 0 with size 0
For the light+charge combination workflow, the LIGHT_EVENT_RANGE is [ start is :: end is ]
Failed to get the event range for the input light files