Jobsub ID 252911.127@dunegpschedd02.fnal.gov
| Jobsub ID | 252911.127@dunegpschedd02.fnal.gov |
| Workflow ID | 10785 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 7200 (2 hours) |
| Submitted time | 2025-11-26 10:33:29 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-26 13:49:59 |
| From worker node | Hostname | dunegli-7735362-0-fnpc18003.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-11-26 10:39:57 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1100_850_20230826T035905Z_gen_g4_detsim_hitreco__20240229T173706Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 9m (540s) |
| CPU time | 8m (517s = 95%) |
| Max RSS bytes | 1315086336 (1254 MiB) |
| Outputting started | 2025-11-26 10:48:58 |
| Output files | |
| Finished | 2025-11-26 13:49:59 |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
-- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fa/25/nu_dune10kt_1x2x6_1100_850_20230826T035905Z_gen_g4_detsim_hitreco__20240229T173706Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1100 subRun: 1 event: 85023 at 26-Nov-2025 10:42:28 UTC
Begin processing the 24th record. run: 1100 subRun: 1 event: 85024 at 26-Nov-2025 10:42:32 UTC
Begin processing the 25th record. run: 1100 subRun: 1 event: 85025 at 26-Nov-2025 10:42:35 UTC
Begin processing the 26th record. run: 1100 subRun: 1 event: 85026 at 26-Nov-2025 10:42:38 UTC
Begin processing the 27th record. run: 1100 subRun: 1 event: 85027 at 26-Nov-2025 10:42:50 UTC
Begin processing the 28th record. run: 1100 subRun: 1 event: 85028 at 26-Nov-2025 10:42:55 UTC
Begin processing the 29th record. run: 1100 subRun: 1 event: 85029 at 26-Nov-2025 10:42:59 UTC
Begin processing the 30th record. run: 1100 subRun: 1 event: 85030 at 26-Nov-2025 10:43:01 UTC
Begin processing the 31st record. run: 1100 subRun: 1 event: 85031 at 26-Nov-2025 10:43:05 UTC
Begin processing the 32nd record. run: 1100 subRun: 1 event: 85032 at 26-Nov-2025 10:43:08 UTC
Begin processing the 33rd record. run: 1100 subRun: 1 event: 85033 at 26-Nov-2025 10:43:11 UTC
Begin processing the 34th record. run: 1100 subRun: 1 event: 85034 at 26-Nov-2025 10:43:15 UTC
Begin processing the 35th record. run: 1100 subRun: 1 event: 85035 at 26-Nov-2025 10:43:18 UTC
Begin processing the 36th record. run: 1100 subRun: 1 event: 85036 at 26-Nov-2025 10:43:32 UTC
Begin processing the 37th record. run: 1100 subRun: 1 event: 85037 at 26-Nov-2025 10:43:36 UTC
Begin processing the 38th record. run: 1100 subRun: 1 event: 85038 at 26-Nov-2025 10:43:39 UTC
Begin processing the 39th record. run: 1100 subRun: 1 event: 85039 at 26-Nov-2025 10:43:43 UTC
Begin processing the 40th record. run: 1100 subRun: 1 event: 85040 at 26-Nov-2025 10:43:46 UTC
Begin processing the 41st record. run: 1100 subRun: 1 event: 85041 at 26-Nov-2025 10:43:49 UTC
Begin processing the 42nd record. run: 1100 subRun: 1 event: 85042 at 26-Nov-2025 10:43:52 UTC
Begin processing the 43rd record. run: 1100 subRun: 1 event: 85043 at 26-Nov-2025 10:44:03 UTC
Begin processing the 44th record. run: 1100 subRun: 1 event: 85044 at 26-Nov-2025 10:44:06 UTC
Begin processing the 45th record. run: 1100 subRun: 1 event: 85045 at 26-Nov-2025 10:44:09 UTC
Begin processing the 46th record. run: 1100 subRun: 1 event: 85046 at 26-Nov-2025 10:44:13 UTC
Begin processing the 47th record. run: 1100 subRun: 1 event: 85047 at 26-Nov-2025 10:44:17 UTC
Begin processing the 48th record. run: 1100 subRun: 1 event: 85048 at 26-Nov-2025 10:44:20 UTC
Begin processing the 49th record. run: 1100 subRun: 1 event: 85049 at 26-Nov-2025 10:44:34 UTC
Begin processing the 50th record. run: 1100 subRun: 1 event: 85050 at 26-Nov-2025 10:44:38 UTC
Begin processing the 51st record. run: 1100 subRun: 1 event: 85051 at 26-Nov-2025 10:44:46 UTC
Begin processing the 52nd record. run: 1100 subRun: 1 event: 85052 at 26-Nov-2025 10:44:55 UTC
Begin processing the 53rd record. run: 1100 subRun: 1 event: 85053 at 26-Nov-2025 10:44:59 UTC
Begin processing the 54th record. run: 1100 subRun: 1 event: 85054 at 26-Nov-2025 10:45:03 UTC
Begin processing the 55th record. run: 1100 subRun: 1 event: 85055 at 26-Nov-2025 10:45:07 UTC
Begin processing the 56th record. run: 1100 subRun: 1 event: 85056 at 26-Nov-2025 10:45:13 UTC
Begin processing the 57th record. run: 1100 subRun: 1 event: 85057 at 26-Nov-2025 10:45:16 UTC
Begin processing the 58th record. run: 1100 subRun: 1 event: 85058 at 26-Nov-2025 10:45:20 UTC
Begin processing the 59th record. run: 1100 subRun: 1 event: 85059 at 26-Nov-2025 10:45:24 UTC
Begin processing the 60th record. run: 1100 subRun: 1 event: 85060 at 26-Nov-2025 10:45:27 UTC
Begin processing the 61st record. run: 1100 subRun: 1 event: 85061 at 26-Nov-2025 10:45:32 UTC
Begin processing the 62nd record. run: 1100 subRun: 1 event: 85062 at 26-Nov-2025 10:45:35 UTC
Begin processing the 63rd record. run: 1100 subRun: 1 event: 85063 at 26-Nov-2025 10:45:39 UTC
Begin processing the 64th record. run: 1100 subRun: 1 event: 85064 at 26-Nov-2025 10:45:45 UTC
Begin processing the 65th record. run: 1100 subRun: 1 event: 85065 at 26-Nov-2025 10:45:49 UTC
Begin processing the 66th record. run: 1100 subRun: 1 event: 85066 at 26-Nov-2025 10:45:52 UTC
Begin processing the 67th record. run: 1100 subRun: 1 event: 85067 at 26-Nov-2025 10:45:57 UTC
Begin processing the 68th record. run: 1100 subRun: 1 event: 85068 at 26-Nov-2025 10:46:00 UTC
Begin processing the 69th record. run: 1100 subRun: 1 event: 85069 at 26-Nov-2025 10:46:03 UTC
Begin processing the 70th record. run: 1100 subRun: 1 event: 85070 at 26-Nov-2025 10:46:06 UTC
Begin processing the 71st record. run: 1100 subRun: 1 event: 85071 at 26-Nov-2025 10:46:18 UTC
Begin processing the 72nd record. run: 1100 subRun: 1 event: 85072 at 26-Nov-2025 10:46:22 UTC
Begin processing the 73rd record. run: 1100 subRun: 1 event: 85073 at 26-Nov-2025 10:46:25 UTC
Begin processing the 74th record. run: 1100 subRun: 1 event: 85074 at 26-Nov-2025 10:46:33 UTC
Begin processing the 75th record. run: 1100 subRun: 1 event: 85075 at 26-Nov-2025 10:46:37 UTC
Begin processing the 76th record. run: 1100 subRun: 1 event: 85076 at 26-Nov-2025 10:46:40 UTC
Begin processing the 77th record. run: 1100 subRun: 1 event: 85077 at 26-Nov-2025 10:46:44 UTC
Begin processing the 78th record. run: 1100 subRun: 1 event: 85078 at 26-Nov-2025 10:46:47 UTC
Begin processing the 79th record. run: 1100 subRun: 1 event: 85079 at 26-Nov-2025 10:47:00 UTC
Begin processing the 80th record. run: 1100 subRun: 1 event: 85080 at 26-Nov-2025 10:47:04 UTC
Begin processing the 81st record. run: 1100 subRun: 1 event: 85081 at 26-Nov-2025 10:47:08 UTC
Begin processing the 82nd record. run: 1100 subRun: 1 event: 85082 at 26-Nov-2025 10:47:12 UTC
Begin processing the 83rd record. run: 1100 subRun: 1 event: 85083 at 26-Nov-2025 10:47:16 UTC
Begin processing the 84th record. run: 1100 subRun: 1 event: 85084 at 26-Nov-2025 10:47:19 UTC
Begin processing the 85th record. run: 1100 subRun: 1 event: 85085 at 26-Nov-2025 10:47:22 UTC
Begin processing the 86th record. run: 1100 subRun: 1 event: 85086 at 26-Nov-2025 10:47:26 UTC
Begin processing the 87th record. run: 1100 subRun: 1 event: 85087 at 26-Nov-2025 10:47:30 UTC
Begin processing the 88th record. run: 1100 subRun: 1 event: 85088 at 26-Nov-2025 10:47:35 UTC
Begin processing the 89th record. run: 1100 subRun: 1 event: 85089 at 26-Nov-2025 10:47:45 UTC
Begin processing the 90th record. run: 1100 subRun: 1 event: 85090 at 26-Nov-2025 10:47:49 UTC
Begin processing the 91st record. run: 1100 subRun: 1 event: 85091 at 26-Nov-2025 10:48:12 UTC
Begin processing the 92nd record. run: 1100 subRun: 1 event: 85092 at 26-Nov-2025 10:48:17 UTC
Begin processing the 93rd record. run: 1100 subRun: 1 event: 85093 at 26-Nov-2025 10:48:22 UTC
Begin processing the 94th record. run: 1100 subRun: 1 event: 85094 at 26-Nov-2025 10:48:28 UTC
Begin processing the 95th record. run: 1100 subRun: 1 event: 85095 at 26-Nov-2025 10:48:31 UTC
Begin processing the 96th record. run: 1100 subRun: 1 event: 85096 at 26-Nov-2025 10:48:36 UTC
Begin processing the 97th record. run: 1100 subRun: 1 event: 85097 at 26-Nov-2025 10:48:39 UTC
Begin processing the 98th record. run: 1100 subRun: 1 event: 85098 at 26-Nov-2025 10:48:43 UTC
Begin processing the 99th record. run: 1100 subRun: 1 event: 85099 at 26-Nov-2025 10:48:47 UTC
Begin processing the 100th record. run: 1100 subRun: 1 event: 85100 at 26-Nov-2025 10:48:50 UTC
26-Nov-2025 10:48:57 UTC Closed output file "nu_dune10kt_1x2x6_1100_850_20230826T035905Z_gen_g4_detsim_hitreco__20240229T173706Z_reco2_reco2.root"
26-Nov-2025 10:48:57 UTC Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fa/25/nu_dune10kt_1x2x6_1100_850_20230826T035905Z_gen_g4_detsim_hitreco__20240229T173706Z_reco2.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 0.013613 4.66569 22.3211 3.53139 3.03561 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00159324 0.00290759 0.00560589 0.00306586 0.000747076 100
reco:pandora:StandardPandora 0.0104054 4.64844 22.2417 3.5179 3.02197 100
[art]:TriggerResults:TriggerResultInserter 1.2423e-05 2.46137e-05 0.000118976 1.9968e-05 1.55156e-05 100
end_path:out1:RootOutput 2.514e-06 4.19246e-06 1.8976e-05 3.4765e-06 2.25822e-06 100
end_path:out1:RootOutput(write) 0.00100721 0.0141377 0.0757513 0.00992754 0.0144325 100
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2301.1 MB
Peak resident set size usage (VmHWM): 1315.09 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
