justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 277818.0@dunegpschedd01.fnal.gov

Jobsub ID277818.0@dunegpschedd01.fnal.gov
Workflow ID11841
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-14 15:14:42
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2026-01-14 15:46:54
From worker nodeHostnamemh-7763-16.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-14 15:16:19
Input filesfardet-hd:nu_dune10kt_1x2x6_1421_991_20230827T094115Z_gen_g4_detsim_hitreco__20240223T222127Z_reco2.root
JobscriptExit code0
Real time30m (1805s)
CPU time5m (327s = 18%)
Max RSS bytes1111162880 (1059 MiB)
Outputting started2026-01-14 15:46:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nu_0/fnal/11841/1/001/Validation_nu_dune10kt_1x2x6_1421_991_20230827T094115Z_gen_g4_detsim_hitreco__20240223T222127Z_reco2.root
Finished2026-01-14 15:46:54
Saved logsjustin-logs:277818.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7b/e7/nu_dune10kt_1x2x6_1421_991_20230827T094115Z_gen_g4_detsim_hitreco__20240223T222127Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1421 subRun: 1 event: 99123 at 14-Jan-2026 07:36:15 PST
Begin processing the 24th record. run: 1421 subRun: 1 event: 99124 at 14-Jan-2026 07:36:21 PST
Begin processing the 25th record. run: 1421 subRun: 1 event: 99125 at 14-Jan-2026 07:36:25 PST
Begin processing the 26th record. run: 1421 subRun: 1 event: 99126 at 14-Jan-2026 07:36:34 PST
Begin processing the 27th record. run: 1421 subRun: 1 event: 99127 at 14-Jan-2026 07:36:38 PST
Begin processing the 28th record. run: 1421 subRun: 1 event: 99128 at 14-Jan-2026 07:36:43 PST
Begin processing the 29th record. run: 1421 subRun: 1 event: 99129 at 14-Jan-2026 07:36:53 PST
Begin processing the 30th record. run: 1421 subRun: 1 event: 99130 at 14-Jan-2026 07:37:03 PST
Begin processing the 31st record. run: 1421 subRun: 1 event: 99131 at 14-Jan-2026 07:37:08 PST
Begin processing the 32nd record. run: 1421 subRun: 1 event: 99132 at 14-Jan-2026 07:37:13 PST
Begin processing the 33rd record. run: 1421 subRun: 1 event: 99133 at 14-Jan-2026 07:37:17 PST
Begin processing the 34th record. run: 1421 subRun: 1 event: 99134 at 14-Jan-2026 07:37:20 PST
Begin processing the 35th record. run: 1421 subRun: 1 event: 99135 at 14-Jan-2026 07:37:24 PST
Begin processing the 36th record. run: 1421 subRun: 1 event: 99136 at 14-Jan-2026 07:37:30 PST
Begin processing the 37th record. run: 1421 subRun: 1 event: 99137 at 14-Jan-2026 07:37:41 PST
Begin processing the 38th record. run: 1421 subRun: 1 event: 99138 at 14-Jan-2026 07:37:46 PST
Begin processing the 39th record. run: 1421 subRun: 1 event: 99139 at 14-Jan-2026 07:37:50 PST
Begin processing the 40th record. run: 1421 subRun: 1 event: 99140 at 14-Jan-2026 07:37:55 PST
Begin processing the 41st record. run: 1421 subRun: 1 event: 99141 at 14-Jan-2026 07:37:58 PST
Begin processing the 42nd record. run: 1421 subRun: 1 event: 99142 at 14-Jan-2026 07:38:01 PST
Begin processing the 43rd record. run: 1421 subRun: 1 event: 99143 at 14-Jan-2026 07:38:12 PST
Begin processing the 44th record. run: 1421 subRun: 1 event: 99144 at 14-Jan-2026 07:38:22 PST
Begin processing the 45th record. run: 1421 subRun: 1 event: 99145 at 14-Jan-2026 07:38:26 PST
Begin processing the 46th record. run: 1421 subRun: 1 event: 99146 at 14-Jan-2026 07:38:30 PST
Begin processing the 47th record. run: 1421 subRun: 1 event: 99147 at 14-Jan-2026 07:38:43 PST
Begin processing the 48th record. run: 1421 subRun: 1 event: 99148 at 14-Jan-2026 07:38:48 PST
Begin processing the 49th record. run: 1421 subRun: 1 event: 99149 at 14-Jan-2026 07:38:52 PST
Begin processing the 50th record. run: 1421 subRun: 1 event: 99150 at 14-Jan-2026 07:38:55 PST
Begin processing the 51st record. run: 1421 subRun: 1 event: 99151 at 14-Jan-2026 07:39:00 PST
Begin processing the 52nd record. run: 1421 subRun: 1 event: 99152 at 14-Jan-2026 07:39:06 PST
Begin processing the 53rd record. run: 1421 subRun: 1 event: 99153 at 14-Jan-2026 07:39:09 PST
Begin processing the 54th record. run: 1421 subRun: 1 event: 99154 at 14-Jan-2026 07:39:12 PST
Begin processing the 55th record. run: 1421 subRun: 1 event: 99155 at 14-Jan-2026 07:39:29 PST
Begin processing the 56th record. run: 1421 subRun: 1 event: 99156 at 14-Jan-2026 07:39:38 PST
Begin processing the 57th record. run: 1421 subRun: 1 event: 99157 at 14-Jan-2026 07:39:48 PST
Begin processing the 58th record. run: 1421 subRun: 1 event: 99158 at 14-Jan-2026 07:39:56 PST
Begin processing the 59th record. run: 1421 subRun: 1 event: 99159 at 14-Jan-2026 07:40:03 PST
Begin processing the 60th record. run: 1421 subRun: 1 event: 99160 at 14-Jan-2026 07:40:06 PST
Begin processing the 61st record. run: 1421 subRun: 1 event: 99161 at 14-Jan-2026 07:40:14 PST
Begin processing the 62nd record. run: 1421 subRun: 1 event: 99162 at 14-Jan-2026 07:40:18 PST
Begin processing the 63rd record. run: 1421 subRun: 1 event: 99163 at 14-Jan-2026 07:40:25 PST
Begin processing the 64th record. run: 1421 subRun: 1 event: 99164 at 14-Jan-2026 07:40:30 PST
Begin processing the 65th record. run: 1421 subRun: 1 event: 99165 at 14-Jan-2026 07:40:35 PST
Begin processing the 66th record. run: 1421 subRun: 1 event: 99166 at 14-Jan-2026 07:41:06 PST
Begin processing the 67th record. run: 1421 subRun: 1 event: 99167 at 14-Jan-2026 07:41:12 PST
Begin processing the 68th record. run: 1421 subRun: 1 event: 99168 at 14-Jan-2026 07:41:15 PST
Begin processing the 69th record. run: 1421 subRun: 1 event: 99169 at 14-Jan-2026 07:41:18 PST
Begin processing the 70th record. run: 1421 subRun: 1 event: 99170 at 14-Jan-2026 07:41:22 PST
Begin processing the 71st record. run: 1421 subRun: 1 event: 99171 at 14-Jan-2026 07:41:26 PST
Begin processing the 72nd record. run: 1421 subRun: 1 event: 99172 at 14-Jan-2026 07:41:29 PST
Begin processing the 73rd record. run: 1421 subRun: 1 event: 99173 at 14-Jan-2026 07:41:34 PST
Begin processing the 74th record. run: 1421 subRun: 1 event: 99174 at 14-Jan-2026 07:41:38 PST
Begin processing the 75th record. run: 1421 subRun: 1 event: 99175 at 14-Jan-2026 07:41:45 PST
Begin processing the 76th record. run: 1421 subRun: 1 event: 99176 at 14-Jan-2026 07:41:51 PST
Begin processing the 77th record. run: 1421 subRun: 1 event: 99177 at 14-Jan-2026 07:42:41 PST
Begin processing the 78th record. run: 1421 subRun: 1 event: 99178 at 14-Jan-2026 07:42:45 PST
Begin processing the 79th record. run: 1421 subRun: 1 event: 99179 at 14-Jan-2026 07:42:50 PST
Begin processing the 80th record. run: 1421 subRun: 1 event: 99180 at 14-Jan-2026 07:43:17 PST
Begin processing the 81st record. run: 1421 subRun: 1 event: 99181 at 14-Jan-2026 07:43:21 PST
Begin processing the 82nd record. run: 1421 subRun: 1 event: 99182 at 14-Jan-2026 07:43:25 PST
Begin processing the 83rd record. run: 1421 subRun: 1 event: 99183 at 14-Jan-2026 07:43:30 PST
Begin processing the 84th record. run: 1421 subRun: 1 event: 99184 at 14-Jan-2026 07:43:33 PST
Begin processing the 85th record. run: 1421 subRun: 1 event: 99185 at 14-Jan-2026 07:43:35 PST
Begin processing the 86th record. run: 1421 subRun: 1 event: 99186 at 14-Jan-2026 07:43:54 PST
Begin processing the 87th record. run: 1421 subRun: 1 event: 99187 at 14-Jan-2026 07:44:00 PST
Begin processing the 88th record. run: 1421 subRun: 1 event: 99188 at 14-Jan-2026 07:44:28 PST
Begin processing the 89th record. run: 1421 subRun: 1 event: 99189 at 14-Jan-2026 07:44:33 PST
Begin processing the 90th record. run: 1421 subRun: 1 event: 99190 at 14-Jan-2026 07:44:39 PST
Begin processing the 91st record. run: 1421 subRun: 1 event: 99191 at 14-Jan-2026 07:44:43 PST
Begin processing the 92nd record. run: 1421 subRun: 1 event: 99192 at 14-Jan-2026 07:44:48 PST
Begin processing the 93rd record. run: 1421 subRun: 1 event: 99193 at 14-Jan-2026 07:45:05 PST
Begin processing the 94th record. run: 1421 subRun: 1 event: 99194 at 14-Jan-2026 07:45:14 PST
Begin processing the 95th record. run: 1421 subRun: 1 event: 99195 at 14-Jan-2026 07:45:45 PST
Begin processing the 96th record. run: 1421 subRun: 1 event: 99196 at 14-Jan-2026 07:45:48 PST
Begin processing the 97th record. run: 1421 subRun: 1 event: 99197 at 14-Jan-2026 07:45:52 PST
Begin processing the 98th record. run: 1421 subRun: 1 event: 99198 at 14-Jan-2026 07:45:59 PST
Begin processing the 99th record. run: 1421 subRun: 1 event: 99199 at 14-Jan-2026 07:46:04 PST
Begin processing the 100th record. run: 1421 subRun: 1 event: 99200 at 14-Jan-2026 07:46:13 PST
14-Jan-2026 07:46:23 PST  Closed output file "nu_dune10kt_1x2x6_1421_991_20230827T094115Z_gen_g4_detsim_hitreco__20240223T222127Z_reco2_reco2.root"
14-Jan-2026 07:46:23 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7b/e7/nu_dune10kt_1x2x6_1421_991_20230827T094115Z_gen_g4_detsim_hitreco__20240223T222127Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.66945       3.09469       24.2456       2.34983       2.92675        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0604094     0.138272      0.734645      0.114526      0.0895558       100    
reco:pandora:StandardPandora                    1.56944       2.94152       24.0449       2.21306       2.91879        100    
[art]:TriggerResults:TriggerResultInserter     1.378e-05    3.4785e-05    0.000142588   2.86445e-05   1.92287e-05      100    
end_path:out1:RootOutput                       3.309e-06    6.04882e-06    4.015e-05     4.415e-06    5.34296e-06      100    
end_path:out1:RootOutput(write)               0.00159374     0.0146003     0.0870657     0.0103576     0.0153385       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2156.97 MB
  Peak resident set size usage (VmHWM): 1111.16 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 05:58:27 UTC       justIN version: 01.06.00