justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 11267.1@dunegpschedd02.fnal.gov

Jobsub ID11267.1@dunegpschedd02.fnal.gov
Workflow ID70
Stage ID1
User nametwalton@fnal.gov
HTCondor Groupgroup_dune.prod.mcsim
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2025-07-25 17:21:32
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2025-07-25 17:31:52
From worker nodeHostnamedune001-6958869.0-lcg2678.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-07-25 17:23:27
Input filesneardet-2x2-lar-charge:binary-0020057-2024_11_03_00_05_53_CET.hdf5
JobscriptExit code0
Real time7m (471s)
CPU time1m (100s = 21%)
Max RSS bytes395210752 (376 MiB)
Outputting started2025-07-25 17:31:20
Output files
Finished2025-07-25 17:31:52
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 14.98it/s]
 53%|#####2    | 397/756 [00:24<00:23, 14.97it/s]
 53%|#####2    | 399/756 [00:24<00:21, 16.26it/s]
 53%|#####3    | 401/756 [00:24<00:27, 13.02it/s]
 53%|#####3    | 403/756 [00:24<00:27, 12.92it/s]
 54%|#####3    | 405/756 [00:24<00:27, 12.72it/s]
 54%|#####3    | 407/756 [00:25<00:27, 12.59it/s]
 54%|#####4    | 409/756 [00:25<00:27, 12.73it/s]
 54%|#####4    | 411/756 [00:25<00:27, 12.77it/s]
 55%|#####4    | 413/756 [00:25<00:19, 17.20it/s]
 55%|#####4    | 415/756 [00:25<00:20, 16.35it/s]
 55%|#####5    | 417/756 [00:25<00:26, 12.63it/s]
 55%|#####5    | 419/756 [00:25<00:26, 12.61it/s]
 56%|#####5    | 421/756 [00:26<00:23, 14.55it/s]
 56%|#####5    | 423/756 [00:26<00:19, 17.43it/s]
 56%|#####6    | 425/756 [00:26<00:19, 17.42it/s]
 56%|#####6    | 427/756 [00:26<00:18, 17.33it/s]
 57%|#####6    | 429/756 [00:26<00:18, 17.28it/s]
 57%|#####7    | 431/756 [00:26<00:18, 17.11it/s]
 57%|#####7    | 433/756 [00:26<00:18, 17.33it/s]
 58%|#####7    | 435/756 [00:26<00:18, 17.25it/s]
 58%|#####7    | 437/756 [00:26<00:18, 17.15it/s]
 58%|#####8    | 439/756 [00:27<00:18, 17.41it/s]
 58%|#####8    | 441/756 [00:27<00:18, 17.15it/s]
 59%|#####8    | 443/756 [00:27<00:18, 17.22it/s]
 59%|#####8    | 445/756 [00:27<00:17, 17.43it/s]
 59%|#####9    | 447/756 [00:27<00:18, 17.03it/s]
 59%|#####9    | 449/756 [00:27<00:17, 17.07it/s]
 60%|#####9    | 451/756 [00:27<00:17, 17.08it/s]
 60%|#####9    | 453/756 [00:27<00:17, 17.36it/s]
 60%|######    | 455/756 [00:28<00:17, 17.26it/s]
 60%|######    | 457/756 [00:28<00:17, 17.26it/s]
 61%|######    | 459/756 [00:28<00:17, 17.16it/s]
 61%|######    | 461/756 [00:28<00:17, 17.00it/s]
 61%|######1   | 463/756 [00:28<00:17, 17.16it/s]
 62%|######1   | 465/756 [00:28<00:16, 17.12it/s]
 62%|######1   | 467/756 [00:28<00:16, 17.12it/s]
 62%|######2   | 469/756 [00:28<00:18, 15.64it/s]
 62%|######2   | 471/756 [00:28<00:16, 17.36it/s]
 63%|######2   | 473/756 [00:29<00:16, 17.61it/s]
 63%|######2   | 475/756 [00:29<00:16, 17.18it/s]
 63%|######3   | 477/756 [00:29<00:22, 12.59it/s]
 63%|######3   | 479/756 [00:29<00:17, 15.99it/s]
 64%|######3   | 481/756 [00:29<00:15, 17.24it/s]
 64%|######3   | 483/756 [00:29<00:15, 17.21it/s]
 64%|######4   | 485/756 [00:29<00:15, 17.58it/s]
 64%|######4   | 487/756 [00:29<00:15, 17.60it/s]
 65%|######4   | 489/756 [00:30<00:15, 17.22it/s]
 65%|######4   | 491/756 [00:30<00:15, 17.57it/s]
 65%|######5   | 493/756 [00:30<00:15, 17.49it/s]
 65%|######5   | 495/756 [00:30<00:15, 17.15it/s]
 66%|######5   | 497/756 [00:30<00:15, 17.22it/s]
 66%|######6   | 499/756 [00:30<00:14, 17.31it/s]
 66%|######6   | 501/756 [00:30<00:14, 17.59it/s]
 67%|######6   | 503/756 [00:30<00:14, 17.46it/s]
 67%|######6   | 505/756 [00:30<00:14, 17.46it/s]
 67%|######7   | 507/756 [00:31<00:14, 17.49it/s]
 67%|######7   | 509/756 [00:31<00:14, 17.36it/s]
 68%|######7   | 511/756 [00:31<00:14, 17.39it/s]
 68%|######7   | 513/756 [00:31<00:14, 17.10it/s]
 68%|######8   | 515/756 [00:31<00:14, 16.21it/s]
 68%|######8   | 517/756 [00:31<00:13, 17.31it/s]
 69%|######8   | 519/756 [00:31<00:14, 15.97it/s]
 69%|######8   | 521/756 [00:31<00:13, 17.57it/s]
 69%|######9   | 523/756 [00:32<00:16, 14.49it/s]
 69%|######9   | 525/756 [00:32<00:13, 17.59it/s]
 70%|######9   | 527/756 [00:32<00:13, 17.51it/s]
 70%|######9   | 529/756 [00:32<00:13, 17.38it/s]
 70%|#######   | 531/756 [00:32<00:12, 17.41it/s]
 71%|#######   | 533/756 [00:32<00:13, 16.07it/s]
 71%|#######   | 535/756 [00:32<00:14, 15.24it/s]
 71%|#######1  | 537/756 [00:32<00:14, 15.37it/s]
 71%|#######1  | 539/756 [00:33<00:12, 17.60it/s]
 72%|#######1  | 541/756 [00:33<00:12, 17.57it/s]
 72%|#######1  | 543/756 [00:33<00:12, 17.47it/s]
 72%|#######2  | 545/756 [00:33<00:12, 17.52it/s]
 72%|#######2  | 547/756 [00:33<00:15, 13.92it/s]
 73%|#######2  | 549/756 [00:33<00:14, 14.34it/s]
 73%|#######2  | 551/756 [00:33<00:15, 13.12it/s]
 73%|#######3  | 553/756 [00:33<00:15, 13.48it/s]
 73%|#######3  | 555/756 [00:34<00:11, 17.84it/s]
 74%|#######3  | 557/756 [00:34<00:13, 14.64it/s]
 74%|#######3  | 559/756 [00:34<00:14, 13.41it/s]
 74%|#######4  | 561/756 [00:34<00:14, 13.17it/s]
 74%|#######4  | 563/756 [00:34<00:14, 13.11it/s]
 75%|#######4  | 565/756 [00:34<00:14, 13.27it/s]
 75%|#######5  | 567/756 [00:34<00:12, 15.37it/s]
 75%|#######5  | 569/756 [00:35<00:10, 17.61it/s]
 76%|#######5  | 571/756 [00:35<00:10, 17.50it/s]
 76%|#######5  | 573/756 [00:35<00:10, 17.54it/s]
 76%|#######6  | 575/756 [00:35<00:10, 17.56it/s]
 76%|#######6  | 577/756 [00:35<00:10, 17.65it/s]
 77%|#######6  | 579/756 [00:35<00:10, 17.51it/s]
 77%|#######6  | 581/756 [00:35<00:10, 17.43it/s]
 77%|#######7  | 583/756 [00:35<00:09, 17.37it/s]
 77%|#######7  | 585/756 [00:35<00:09, 17.62it/s]
 78%|#######7  | 587/756 [00:36<00:09, 17.81it/s]
 78%|#######7  | 589/756 [00:36<00:09, 17.61it/s]
 78%|#######8  | 591/756 [00:36<00:10, 15.88it/s]
 78%|#######8  | 593/756 [00:36<00:09, 17.40it/s]
 79%|#######8  | 595/756 [00:36<00:09, 17.51it/s]
 79%|#######8  | 597/756 [00:36<00:09, 17.46it/s]
 79%|#######9  | 599/756 [00:36<00:09, 17.38it/s]
 79%|#######9  | 601/756 [00:36<00:08, 17.35it/s]
 80%|#######9  | 603/756 [00:37<00:09, 15.82it/s]
 80%|########  | 605/756 [00:37<00:08, 17.12it/s]
 80%|########  | 607/756 [00:37<00:09, 16.17it/s]
 81%|########  | 609/756 [00:37<00:08, 17.37it/s]
 81%|########  | 611/756 [00:37<00:08, 16.90it/s]
 81%|########1 | 613/756 [00:37<00:08, 17.28it/s]
 81%|########1 | 615/756 [00:37<00:08, 17.11it/s]
 82%|########1 | 617/756 [00:37<00:08, 16.93it/s]
 82%|########1 | 619/756 [00:37<00:08, 16.14it/s]
 82%|########2 | 621/756 [00:38<00:08, 16.24it/s]
 82%|########2 | 623/756 [00:38<00:08, 15.66it/s]
 83%|########2 | 625/756 [00:38<00:09, 13.90it/s]
 83%|########2 | 627/756 [00:38<00:07, 16.72it/s]
 83%|########3 | 629/756 [00:38<00:09, 12.77it/s]
 83%|########3 | 631/756 [00:38<00:09, 12.69it/s]
 84%|########3 | 633/756 [00:38<00:09, 13.61it/s]
 84%|########3 | 635/756 [00:39<00:09, 12.62it/s]
 84%|########4 | 637/756 [00:39<00:08, 13.55it/s]
 85%|########4 | 639/756 [00:39<00:06, 16.77it/s]
 85%|########4 | 641/756 [00:39<00:06, 16.77it/s]
 85%|########5 | 643/756 [00:39<00:06, 16.82it/s]
 85%|########5 | 645/756 [00:39<00:06, 16.89it/s]
 86%|########5 | 647/756 [00:39<00:06, 16.77it/s]
 86%|########5 | 649/756 [00:39<00:06, 16.75it/s]
 86%|########6 | 651/756 [00:40<00:06, 15.66it/s]
 86%|########6 | 653/756 [00:40<00:06, 16.68it/s]
 87%|########6 | 655/756 [00:40<00:06, 16.76it/s]
 87%|########6 | 657/756 [00:40<00:05, 16.63it/s]
 87%|########7 | 659/756 [00:40<00:05, 16.48it/s]
 87%|########7 | 661/756 [00:40<00:05, 16.56it/s]
 88%|########7 | 663/756 [00:40<00:06, 13.52it/s]
 88%|########7 | 665/756 [00:40<00:07, 12.70it/s]
 88%|########8 | 667/756 [00:41<00:05, 15.06it/s]
 88%|########8 | 669/756 [00:41<00:05, 16.49it/s]
 89%|########8 | 671/756 [00:41<00:05, 16.76it/s]
 89%|########9 | 673/756 [00:41<00:04, 16.78it/s]
 89%|########9 | 675/756 [00:41<00:04, 16.77it/s]
 90%|########9 | 677/756 [00:41<00:04, 16.87it/s]
 90%|########9 | 679/756 [00:41<00:04, 16.84it/s]
 90%|######### | 681/756 [00:41<00:04, 16.94it/s]
 90%|######### | 683/756 [00:42<00:04, 16.76it/s]
 91%|######### | 685/756 [00:42<00:04, 16.66it/s]
 91%|######### | 687/756 [00:42<00:04, 16.77it/s]
 91%|#########1| 689/756 [00:42<00:04, 16.72it/s]
 91%|#########1| 691/756 [00:42<00:03, 16.71it/s]
 92%|#########1| 693/756 [00:42<00:03, 16.80it/s]
 92%|#########1| 695/756 [00:42<00:03, 16.79it/s]
 92%|#########2| 697/756 [00:42<00:04, 14.50it/s]
 92%|#########2| 699/756 [00:43<00:03, 14.36it/s]
 93%|#########2| 701/756 [00:43<00:03, 15.40it/s]
 93%|#########2| 703/756 [00:43<00:03, 15.22it/s]
 93%|#########3| 705/756 [00:43<00:03, 16.94it/s]
 94%|#########3| 707/756 [00:43<00:02, 16.78it/s]
 94%|#########3| 709/756 [00:43<00:02, 16.59it/s]
 94%|#########4| 711/756 [00:43<00:02, 17.04it/s]
 94%|#########4| 713/756 [00:43<00:02, 16.98it/s]
 95%|#########4| 715/756 [00:44<00:02, 16.78it/s]
 95%|#########4| 717/756 [00:44<00:02, 16.86it/s]
 95%|#########5| 719/756 [00:44<00:02, 16.76it/s]
 95%|#########5| 721/756 [00:44<00:02, 16.76it/s]
 96%|#########5| 723/756 [00:44<00:01, 16.72it/s]
 96%|#########5| 725/756 [00:44<00:01, 16.59it/s]
 96%|#########6| 727/756 [00:44<00:01, 16.51it/s]
 96%|#########6| 729/756 [00:44<00:01, 16.74it/s]
 97%|#########6| 731/756 [00:45<00:01, 16.95it/s]
 97%|#########6| 733/756 [00:45<00:01, 16.71it/s]
 97%|#########7| 735/756 [00:45<00:01, 16.87it/s]
 97%|#########7| 737/756 [00:45<00:01, 16.92it/s]
 98%|#########7| 739/756 [00:45<00:01, 16.89it/s]
 98%|#########8| 741/756 [00:45<00:00, 16.86it/s]
 98%|#########8| 743/756 [00:45<00:00, 14.13it/s]
 99%|#########8| 745/756 [00:45<00:00, 16.88it/s]
 99%|#########8| 747/756 [00:46<00:00, 13.88it/s]
 99%|#########9| 749/756 [00:46<00:00, 12.61it/s]
 99%|#########9| 751/756 [00:46<00:00, 12.59it/s]
100%|#########9| 753/756 [00:46<00:00, 12.96it/s]
100%|#########9| 755/756 [00:46<00:00, 15.33it/s]
757it [00:46, 16.21it/s]                         
Traceback (most recent call last):
  File "/cvmfs/dune.opensciencegrid.org/dunend/2x2//releases/v1.5.0/ndlar_prod_scripts/ndlar_reflow/scripts/get_light_event_range.py", line 78, in <module>
    main()
  File "/cvmfs/dune.opensciencegrid.org/dunend/2x2//releases/v1.5.0/ndlar_prod_scripts/ndlar_reflow/scripts/get_light_event_range.py", line 70, in main
    start_pos, end_pos = get_limits(chargef_h5,
                         ^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/dune.opensciencegrid.org/dunend/2x2//releases/v1.5.0/ndlar_prod_scripts/ndlar_reflow/scripts/get_light_event_range.py", line 38, in get_limits
    start_pos = np.where(tstamps_first_l >= tmin_c)[0][0]
                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^
IndexError: index 0 is out of bounds for axis 0 with size 0
		For the light+charge combination workflow, the LIGHT_EVENT_RANGE is [ start is  :: end is  ]
		Failed to get the event range for the input light files
justIN time: 2025-08-04 21:36:26 UTC       justIN version: 01.04.00