justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 298473.52@dunegpschedd01.fnal.gov

Jobsub ID298473.52@dunegpschedd01.fnal.gov
Workflow ID12158
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-21 10:18:40
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2026-01-21 12:28:30
From worker nodeHostnamemh-7763-12.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-21 10:30:16
Input filesfardet-hd:nue_dune10kt_1x2x6_1120_222_20230828T043343Z_gen_g4_detsim_hitreco__20240221T024704Z_reco2.root
JobscriptExit code0
Real time1h (7063s)
CPU time19m (1172s = 16%)
Max RSS bytes1553256448 (1481 MiB)
Outputting started2026-01-21 12:28:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nue_2/fnal/12158/1/001/Validation_nue_dune10kt_1x2x6_1120_222_20230828T043343Z_gen_g4_detsim_hitreco__20240221T024704Z_reco2.root
Finished2026-01-21 12:28:30
Saved logsjustin-logs:298473.52-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a8/f9/nue_dune10kt_1x2x6_1120_222_20230828T043343Z_gen_g4_detsim_hitreco__20240221T024704Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1120 subRun: 1 event: 22223 at 21-Jan-2026 03:49:13 PST
Begin processing the 24th record. run: 1120 subRun: 1 event: 22224 at 21-Jan-2026 03:49:18 PST
Begin processing the 25th record. run: 1120 subRun: 1 event: 22225 at 21-Jan-2026 03:49:31 PST
Begin processing the 26th record. run: 1120 subRun: 1 event: 22226 at 21-Jan-2026 03:50:50 PST
Begin processing the 27th record. run: 1120 subRun: 1 event: 22227 at 21-Jan-2026 03:51:42 PST
Begin processing the 28th record. run: 1120 subRun: 1 event: 22228 at 21-Jan-2026 03:51:47 PST
Begin processing the 29th record. run: 1120 subRun: 1 event: 22229 at 21-Jan-2026 03:52:01 PST
Begin processing the 30th record. run: 1120 subRun: 1 event: 22230 at 21-Jan-2026 03:52:54 PST
Begin processing the 31st record. run: 1120 subRun: 1 event: 22231 at 21-Jan-2026 03:54:41 PST
Begin processing the 32nd record. run: 1120 subRun: 1 event: 22232 at 21-Jan-2026 03:54:46 PST
Begin processing the 33rd record. run: 1120 subRun: 1 event: 22233 at 21-Jan-2026 03:54:54 PST
Begin processing the 34th record. run: 1120 subRun: 1 event: 22234 at 21-Jan-2026 03:55:49 PST
Begin processing the 35th record. run: 1120 subRun: 1 event: 22235 at 21-Jan-2026 03:55:55 PST
Begin processing the 36th record. run: 1120 subRun: 1 event: 22236 at 21-Jan-2026 03:56:23 PST
Begin processing the 37th record. run: 1120 subRun: 1 event: 22237 at 21-Jan-2026 03:56:31 PST
Begin processing the 38th record. run: 1120 subRun: 1 event: 22238 at 21-Jan-2026 03:56:35 PST
Begin processing the 39th record. run: 1120 subRun: 1 event: 22239 at 21-Jan-2026 03:56:40 PST
Begin processing the 40th record. run: 1120 subRun: 1 event: 22240 at 21-Jan-2026 03:56:46 PST
Begin processing the 41st record. run: 1120 subRun: 1 event: 22241 at 21-Jan-2026 03:58:17 PST
Begin processing the 42nd record. run: 1120 subRun: 1 event: 22242 at 21-Jan-2026 03:58:38 PST
Begin processing the 43rd record. run: 1120 subRun: 1 event: 22243 at 21-Jan-2026 04:02:52 PST
Begin processing the 44th record. run: 1120 subRun: 1 event: 22244 at 21-Jan-2026 04:02:58 PST
Begin processing the 45th record. run: 1120 subRun: 1 event: 22245 at 21-Jan-2026 04:03:08 PST
Begin processing the 46th record. run: 1120 subRun: 1 event: 22246 at 21-Jan-2026 04:03:16 PST
Begin processing the 47th record. run: 1120 subRun: 1 event: 22247 at 21-Jan-2026 04:03:28 PST
Begin processing the 48th record. run: 1120 subRun: 1 event: 22248 at 21-Jan-2026 04:03:34 PST
Begin processing the 49th record. run: 1120 subRun: 1 event: 22249 at 21-Jan-2026 04:04:01 PST
Begin processing the 50th record. run: 1120 subRun: 1 event: 22250 at 21-Jan-2026 04:04:08 PST
Begin processing the 51st record. run: 1120 subRun: 1 event: 22251 at 21-Jan-2026 04:11:05 PST
Begin processing the 52nd record. run: 1120 subRun: 1 event: 22252 at 21-Jan-2026 04:11:13 PST
Begin processing the 53rd record. run: 1120 subRun: 1 event: 22253 at 21-Jan-2026 04:11:19 PST
Begin processing the 54th record. run: 1120 subRun: 1 event: 22254 at 21-Jan-2026 04:11:27 PST
Begin processing the 55th record. run: 1120 subRun: 1 event: 22255 at 21-Jan-2026 04:11:31 PST
Begin processing the 56th record. run: 1120 subRun: 1 event: 22256 at 21-Jan-2026 04:11:47 PST
Begin processing the 57th record. run: 1120 subRun: 1 event: 22257 at 21-Jan-2026 04:12:04 PST
Begin processing the 58th record. run: 1120 subRun: 1 event: 22258 at 21-Jan-2026 04:12:32 PST
Begin processing the 59th record. run: 1120 subRun: 1 event: 22259 at 21-Jan-2026 04:12:53 PST
Begin processing the 60th record. run: 1120 subRun: 1 event: 22260 at 21-Jan-2026 04:12:58 PST
Begin processing the 61st record. run: 1120 subRun: 1 event: 22261 at 21-Jan-2026 04:13:08 PST
Begin processing the 62nd record. run: 1120 subRun: 1 event: 22262 at 21-Jan-2026 04:13:30 PST
Begin processing the 63rd record. run: 1120 subRun: 1 event: 22263 at 21-Jan-2026 04:13:45 PST
Begin processing the 64th record. run: 1120 subRun: 1 event: 22264 at 21-Jan-2026 04:13:49 PST
Begin processing the 65th record. run: 1120 subRun: 1 event: 22265 at 21-Jan-2026 04:13:59 PST
Begin processing the 66th record. run: 1120 subRun: 1 event: 22266 at 21-Jan-2026 04:14:08 PST
Begin processing the 67th record. run: 1120 subRun: 1 event: 22267 at 21-Jan-2026 04:14:14 PST
Begin processing the 68th record. run: 1120 subRun: 1 event: 22268 at 21-Jan-2026 04:14:35 PST
Begin processing the 69th record. run: 1120 subRun: 1 event: 22269 at 21-Jan-2026 04:14:44 PST
Begin processing the 70th record. run: 1120 subRun: 1 event: 22270 at 21-Jan-2026 04:15:01 PST
Begin processing the 71st record. run: 1120 subRun: 1 event: 22271 at 21-Jan-2026 04:15:09 PST
Begin processing the 72nd record. run: 1120 subRun: 1 event: 22272 at 21-Jan-2026 04:15:57 PST
Begin processing the 73rd record. run: 1120 subRun: 1 event: 22273 at 21-Jan-2026 04:16:04 PST
Begin processing the 74th record. run: 1120 subRun: 1 event: 22274 at 21-Jan-2026 04:16:09 PST
Begin processing the 75th record. run: 1120 subRun: 1 event: 22275 at 21-Jan-2026 04:16:25 PST
Begin processing the 76th record. run: 1120 subRun: 1 event: 22276 at 21-Jan-2026 04:16:48 PST
Begin processing the 77th record. run: 1120 subRun: 1 event: 22277 at 21-Jan-2026 04:16:55 PST
Begin processing the 78th record. run: 1120 subRun: 1 event: 22278 at 21-Jan-2026 04:17:21 PST
Begin processing the 79th record. run: 1120 subRun: 1 event: 22279 at 21-Jan-2026 04:17:27 PST
Begin processing the 80th record. run: 1120 subRun: 1 event: 22280 at 21-Jan-2026 04:17:38 PST
Begin processing the 81st record. run: 1120 subRun: 1 event: 22281 at 21-Jan-2026 04:18:15 PST
Begin processing the 82nd record. run: 1120 subRun: 1 event: 22282 at 21-Jan-2026 04:18:29 PST
Begin processing the 83rd record. run: 1120 subRun: 1 event: 22283 at 21-Jan-2026 04:18:36 PST
Begin processing the 84th record. run: 1120 subRun: 1 event: 22284 at 21-Jan-2026 04:19:00 PST
Begin processing the 85th record. run: 1120 subRun: 1 event: 22285 at 21-Jan-2026 04:19:12 PST
Begin processing the 86th record. run: 1120 subRun: 1 event: 22286 at 21-Jan-2026 04:19:16 PST
Begin processing the 87th record. run: 1120 subRun: 1 event: 22287 at 21-Jan-2026 04:20:11 PST
Begin processing the 88th record. run: 1120 subRun: 1 event: 22288 at 21-Jan-2026 04:20:54 PST
Begin processing the 89th record. run: 1120 subRun: 1 event: 22289 at 21-Jan-2026 04:21:08 PST
Begin processing the 90th record. run: 1120 subRun: 1 event: 22290 at 21-Jan-2026 04:21:15 PST
Begin processing the 91st record. run: 1120 subRun: 1 event: 22291 at 21-Jan-2026 04:21:27 PST
Begin processing the 92nd record. run: 1120 subRun: 1 event: 22292 at 21-Jan-2026 04:24:39 PST
Begin processing the 93rd record. run: 1120 subRun: 1 event: 22293 at 21-Jan-2026 04:24:53 PST
Begin processing the 94th record. run: 1120 subRun: 1 event: 22294 at 21-Jan-2026 04:25:04 PST
Begin processing the 95th record. run: 1120 subRun: 1 event: 22295 at 21-Jan-2026 04:25:22 PST
Begin processing the 96th record. run: 1120 subRun: 1 event: 22296 at 21-Jan-2026 04:25:32 PST
Begin processing the 97th record. run: 1120 subRun: 1 event: 22297 at 21-Jan-2026 04:25:37 PST
Begin processing the 98th record. run: 1120 subRun: 1 event: 22298 at 21-Jan-2026 04:26:59 PST
Begin processing the 99th record. run: 1120 subRun: 1 event: 22299 at 21-Jan-2026 04:27:41 PST
Begin processing the 100th record. run: 1120 subRun: 1 event: 22300 at 21-Jan-2026 04:27:49 PST
21-Jan-2026 04:27:59 PST  Closed output file "nue_dune10kt_1x2x6_1120_222_20230828T043343Z_gen_g4_detsim_hitreco__20240221T024704Z_reco2_reco2.root"
21-Jan-2026 04:27:59 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a8/f9/nue_dune10kt_1x2x6_1120_222_20230828T043343Z_gen_g4_detsim_hitreco__20240221T024704Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.80628       17.506        329.086       5.68125       41.1696        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0624079     0.117228      0.442742      0.109524      0.0456476       100    
reco:pandora:StandardPandora                    2.69376       17.3683       328.781       5.54562       41.1445        100    
[art]:TriggerResults:TriggerResultInserter     1.322e-05    2.67321e-05   0.000102959    2.33e-05     1.35863e-05      100    
end_path:out1:RootOutput                       3.09e-06     6.37148e-06    1.421e-05    4.9645e-06    2.54303e-06      100    
end_path:out1:RootOutput(write)               0.00151935     0.0202174     0.199939     0.00977417     0.0298145       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2572.1 MB
  Peak resident set size usage (VmHWM): 1553.26 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-05 13:51:03 UTC       justIN version: 01.06.00