Jobsub ID 252911.125@dunegpschedd02.fnal.gov
| Jobsub ID | 252911.125@dunegpschedd02.fnal.gov |
| Workflow ID | 10785 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 7200 (2 hours) |
| Submitted time | 2025-11-26 10:33:29 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-26 13:52:20 |
| From worker node | Hostname | dunegli-7735362-0-fnpc18003.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-11-26 10:40:01 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1111_237_20230827T033410Z_gen_g4_detsim_hitreco__20240222T233556Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 11m (680s) |
| CPU time | 10m (659s = 96%) |
| Max RSS bytes | 1396674560 (1331 MiB) |
| Outputting started | 2025-11-26 10:51:22 |
| Output files | |
| Finished | 2025-11-26 13:52:20 |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/aa/4d/nu_dune10kt_1x2x6_1111_237_20230827T033410Z_gen_g4_detsim_hitreco__20240222T233556Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1111 subRun: 1 event: 23723 at 26-Nov-2025 10:43:52 UTC
Begin processing the 24th record. run: 1111 subRun: 1 event: 23724 at 26-Nov-2025 10:43:58 UTC
Begin processing the 25th record. run: 1111 subRun: 1 event: 23725 at 26-Nov-2025 10:44:01 UTC
Begin processing the 26th record. run: 1111 subRun: 1 event: 23726 at 26-Nov-2025 10:44:14 UTC
Begin processing the 27th record. run: 1111 subRun: 1 event: 23727 at 26-Nov-2025 10:45:07 UTC
Begin processing the 28th record. run: 1111 subRun: 1 event: 23728 at 26-Nov-2025 10:45:14 UTC
Begin processing the 29th record. run: 1111 subRun: 1 event: 23729 at 26-Nov-2025 10:45:17 UTC
Begin processing the 30th record. run: 1111 subRun: 1 event: 23730 at 26-Nov-2025 10:45:20 UTC
Begin processing the 31st record. run: 1111 subRun: 1 event: 23731 at 26-Nov-2025 10:45:24 UTC
Begin processing the 32nd record. run: 1111 subRun: 1 event: 23732 at 26-Nov-2025 10:45:28 UTC
Begin processing the 33rd record. run: 1111 subRun: 1 event: 23733 at 26-Nov-2025 10:45:31 UTC
Begin processing the 34th record. run: 1111 subRun: 1 event: 23734 at 26-Nov-2025 10:45:34 UTC
Begin processing the 35th record. run: 1111 subRun: 1 event: 23735 at 26-Nov-2025 10:45:37 UTC
Begin processing the 36th record. run: 1111 subRun: 1 event: 23736 at 26-Nov-2025 10:45:41 UTC
Begin processing the 37th record. run: 1111 subRun: 1 event: 23737 at 26-Nov-2025 10:45:45 UTC
Begin processing the 38th record. run: 1111 subRun: 1 event: 23738 at 26-Nov-2025 10:45:48 UTC
Begin processing the 39th record. run: 1111 subRun: 1 event: 23739 at 26-Nov-2025 10:45:51 UTC
Begin processing the 40th record. run: 1111 subRun: 1 event: 23740 at 26-Nov-2025 10:45:57 UTC
Begin processing the 41st record. run: 1111 subRun: 1 event: 23741 at 26-Nov-2025 10:46:01 UTC
Begin processing the 42nd record. run: 1111 subRun: 1 event: 23742 at 26-Nov-2025 10:46:05 UTC
Begin processing the 43rd record. run: 1111 subRun: 1 event: 23743 at 26-Nov-2025 10:46:08 UTC
Begin processing the 44th record. run: 1111 subRun: 1 event: 23744 at 26-Nov-2025 10:46:11 UTC
Begin processing the 45th record. run: 1111 subRun: 1 event: 23745 at 26-Nov-2025 10:46:14 UTC
Begin processing the 46th record. run: 1111 subRun: 1 event: 23746 at 26-Nov-2025 10:46:18 UTC
Begin processing the 47th record. run: 1111 subRun: 1 event: 23747 at 26-Nov-2025 10:46:22 UTC
Begin processing the 48th record. run: 1111 subRun: 1 event: 23748 at 26-Nov-2025 10:46:26 UTC
Begin processing the 49th record. run: 1111 subRun: 1 event: 23749 at 26-Nov-2025 10:46:29 UTC
Begin processing the 50th record. run: 1111 subRun: 1 event: 23750 at 26-Nov-2025 10:46:32 UTC
Begin processing the 51st record. run: 1111 subRun: 1 event: 23751 at 26-Nov-2025 10:46:35 UTC
Begin processing the 52nd record. run: 1111 subRun: 1 event: 23752 at 26-Nov-2025 10:46:38 UTC
Begin processing the 53rd record. run: 1111 subRun: 1 event: 23753 at 26-Nov-2025 10:46:41 UTC
Begin processing the 54th record. run: 1111 subRun: 1 event: 23754 at 26-Nov-2025 10:46:44 UTC
Begin processing the 55th record. run: 1111 subRun: 1 event: 23755 at 26-Nov-2025 10:46:48 UTC
Begin processing the 56th record. run: 1111 subRun: 1 event: 23756 at 26-Nov-2025 10:47:08 UTC
Begin processing the 57th record. run: 1111 subRun: 1 event: 23757 at 26-Nov-2025 10:47:22 UTC
Begin processing the 58th record. run: 1111 subRun: 1 event: 23758 at 26-Nov-2025 10:47:25 UTC
Begin processing the 59th record. run: 1111 subRun: 1 event: 23759 at 26-Nov-2025 10:47:31 UTC
Begin processing the 60th record. run: 1111 subRun: 1 event: 23760 at 26-Nov-2025 10:47:34 UTC
Begin processing the 61st record. run: 1111 subRun: 1 event: 23761 at 26-Nov-2025 10:47:38 UTC
Begin processing the 62nd record. run: 1111 subRun: 1 event: 23762 at 26-Nov-2025 10:47:43 UTC
Begin processing the 63rd record. run: 1111 subRun: 1 event: 23763 at 26-Nov-2025 10:47:48 UTC
Begin processing the 64th record. run: 1111 subRun: 1 event: 23764 at 26-Nov-2025 10:48:00 UTC
Begin processing the 65th record. run: 1111 subRun: 1 event: 23765 at 26-Nov-2025 10:48:03 UTC
Begin processing the 66th record. run: 1111 subRun: 1 event: 23766 at 26-Nov-2025 10:48:06 UTC
Begin processing the 67th record. run: 1111 subRun: 1 event: 23767 at 26-Nov-2025 10:48:09 UTC
Begin processing the 68th record. run: 1111 subRun: 1 event: 23768 at 26-Nov-2025 10:48:14 UTC
Begin processing the 69th record. run: 1111 subRun: 1 event: 23769 at 26-Nov-2025 10:48:17 UTC
Begin processing the 70th record. run: 1111 subRun: 1 event: 23770 at 26-Nov-2025 10:48:20 UTC
Begin processing the 71st record. run: 1111 subRun: 1 event: 23771 at 26-Nov-2025 10:48:23 UTC
Begin processing the 72nd record. run: 1111 subRun: 1 event: 23772 at 26-Nov-2025 10:48:26 UTC
Begin processing the 73rd record. run: 1111 subRun: 1 event: 23773 at 26-Nov-2025 10:48:29 UTC
Begin processing the 74th record. run: 1111 subRun: 1 event: 23774 at 26-Nov-2025 10:48:33 UTC
Begin processing the 75th record. run: 1111 subRun: 1 event: 23775 at 26-Nov-2025 10:48:48 UTC
Begin processing the 76th record. run: 1111 subRun: 1 event: 23776 at 26-Nov-2025 10:48:54 UTC
Begin processing the 77th record. run: 1111 subRun: 1 event: 23777 at 26-Nov-2025 10:49:14 UTC
Begin processing the 78th record. run: 1111 subRun: 1 event: 23778 at 26-Nov-2025 10:49:18 UTC
Begin processing the 79th record. run: 1111 subRun: 1 event: 23779 at 26-Nov-2025 10:49:23 UTC
Begin processing the 80th record. run: 1111 subRun: 1 event: 23780 at 26-Nov-2025 10:49:27 UTC
Begin processing the 81st record. run: 1111 subRun: 1 event: 23781 at 26-Nov-2025 10:49:33 UTC
Begin processing the 82nd record. run: 1111 subRun: 1 event: 23782 at 26-Nov-2025 10:49:37 UTC
Begin processing the 83rd record. run: 1111 subRun: 1 event: 23783 at 26-Nov-2025 10:49:41 UTC
Begin processing the 84th record. run: 1111 subRun: 1 event: 23784 at 26-Nov-2025 10:49:54 UTC
Begin processing the 85th record. run: 1111 subRun: 1 event: 23785 at 26-Nov-2025 10:49:57 UTC
Begin processing the 86th record. run: 1111 subRun: 1 event: 23786 at 26-Nov-2025 10:50:01 UTC
Begin processing the 87th record. run: 1111 subRun: 1 event: 23787 at 26-Nov-2025 10:50:04 UTC
Begin processing the 88th record. run: 1111 subRun: 1 event: 23788 at 26-Nov-2025 10:50:07 UTC
Begin processing the 89th record. run: 1111 subRun: 1 event: 23789 at 26-Nov-2025 10:50:10 UTC
Begin processing the 90th record. run: 1111 subRun: 1 event: 23790 at 26-Nov-2025 10:50:14 UTC
Begin processing the 91st record. run: 1111 subRun: 1 event: 23791 at 26-Nov-2025 10:50:19 UTC
Begin processing the 92nd record. run: 1111 subRun: 1 event: 23792 at 26-Nov-2025 10:50:22 UTC
Begin processing the 93rd record. run: 1111 subRun: 1 event: 23793 at 26-Nov-2025 10:50:25 UTC
Begin processing the 94th record. run: 1111 subRun: 1 event: 23794 at 26-Nov-2025 10:50:28 UTC
Begin processing the 95th record. run: 1111 subRun: 1 event: 23795 at 26-Nov-2025 10:50:33 UTC
Begin processing the 96th record. run: 1111 subRun: 1 event: 23796 at 26-Nov-2025 10:50:36 UTC
Begin processing the 97th record. run: 1111 subRun: 1 event: 23797 at 26-Nov-2025 10:50:40 UTC
Begin processing the 98th record. run: 1111 subRun: 1 event: 23798 at 26-Nov-2025 10:50:44 UTC
Begin processing the 99th record. run: 1111 subRun: 1 event: 23799 at 26-Nov-2025 10:50:47 UTC
Begin processing the 100th record. run: 1111 subRun: 1 event: 23800 at 26-Nov-2025 10:51:17 UTC
26-Nov-2025 10:51:21 UTC Closed output file "nu_dune10kt_1x2x6_1111_237_20230827T033410Z_gen_g4_detsim_hitreco__20240222T233556Z_reco2_reco2.root"
26-Nov-2025 10:51:21 UTC Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/aa/4d/nu_dune10kt_1x2x6_1111_237_20230827T033410Z_gen_g4_detsim_hitreco__20240222T233556Z_reco2.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 2.53095 6.06355 51.4898 3.55423 7.4902 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00141069 0.00768807 0.0294349 0.00327048 0.00655201 100
reco:pandora:StandardPandora 2.52532 6.03901 51.404 3.53824 7.4746 100
[art]:TriggerResults:TriggerResultInserter 1.2644e-05 2.32198e-05 8.2997e-05 2.0043e-05 1.11054e-05 100
end_path:out1:RootOutput 2.866e-06 3.7253e-06 1.7584e-05 3.3915e-06 1.79901e-06 100
end_path:out1:RootOutput(write) 0.00116723 0.0166583 0.102418 0.0112906 0.0184776 100
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2380.65 MB
Peak resident set size usage (VmHWM): 1396.67 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
