justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 236755.145@dunegpschedd02.fnal.gov

Jobsub ID236755.145@dunegpschedd02.fnal.gov
Workflow ID9557
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-11-03 16:47:06
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-11-03 17:13:18
From worker nodeHostnametds508.pic.es
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 17:01:27
Input filesfardet-hd:nu_dune10kt_1x2x6_1102_163_20230826T063854Z_gen_g4_detsim_hitreco__20240229T194415Z_reco2.root
JobscriptExit code0
Real time11m (683s)
CPU time5m (345s = 50%)
Max RSS bytes1262063616 (1203 MiB)
Outputting started2025-11-03 17:12:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_2/fnal/09557/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1102_163_20230826T063854Z_gen_g4_detsim_hitreco__20240229T194415Z_reco2.root
Finished2025-11-03 17:13:18
Saved logsjustin-logs:236755.145-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

-----------
Input PFN = root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3c/75/nu_dune10kt_1x2x6_1102_163_20230826T063854Z_gen_g4_detsim_hitreco__20240229T194415Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1102 subRun: 1 event: 16323 at 03-Nov-2025 18:07:47 CET
Begin processing the 24th record. run: 1102 subRun: 1 event: 16324 at 03-Nov-2025 18:07:51 CET
Begin processing the 25th record. run: 1102 subRun: 1 event: 16325 at 03-Nov-2025 18:07:55 CET
Begin processing the 26th record. run: 1102 subRun: 1 event: 16326 at 03-Nov-2025 18:07:58 CET
Begin processing the 27th record. run: 1102 subRun: 1 event: 16327 at 03-Nov-2025 18:08:01 CET
Begin processing the 28th record. run: 1102 subRun: 1 event: 16328 at 03-Nov-2025 18:08:05 CET
Begin processing the 29th record. run: 1102 subRun: 1 event: 16329 at 03-Nov-2025 18:08:08 CET
Begin processing the 30th record. run: 1102 subRun: 1 event: 16330 at 03-Nov-2025 18:08:11 CET
Begin processing the 31st record. run: 1102 subRun: 1 event: 16331 at 03-Nov-2025 18:08:14 CET
Begin processing the 32nd record. run: 1102 subRun: 1 event: 16332 at 03-Nov-2025 18:08:19 CET
Begin processing the 33rd record. run: 1102 subRun: 1 event: 16333 at 03-Nov-2025 18:08:26 CET
Begin processing the 34th record. run: 1102 subRun: 1 event: 16334 at 03-Nov-2025 18:08:31 CET
Begin processing the 35th record. run: 1102 subRun: 1 event: 16335 at 03-Nov-2025 18:08:35 CET
Begin processing the 36th record. run: 1102 subRun: 1 event: 16336 at 03-Nov-2025 18:08:39 CET
Begin processing the 37th record. run: 1102 subRun: 1 event: 16337 at 03-Nov-2025 18:08:43 CET
Begin processing the 38th record. run: 1102 subRun: 1 event: 16338 at 03-Nov-2025 18:08:48 CET
Begin processing the 39th record. run: 1102 subRun: 1 event: 16339 at 03-Nov-2025 18:08:52 CET
Begin processing the 40th record. run: 1102 subRun: 1 event: 16340 at 03-Nov-2025 18:08:56 CET
Begin processing the 41st record. run: 1102 subRun: 1 event: 16341 at 03-Nov-2025 18:09:00 CET
Begin processing the 42nd record. run: 1102 subRun: 1 event: 16342 at 03-Nov-2025 18:09:04 CET
Begin processing the 43rd record. run: 1102 subRun: 1 event: 16343 at 03-Nov-2025 18:09:08 CET
Begin processing the 44th record. run: 1102 subRun: 1 event: 16344 at 03-Nov-2025 18:09:13 CET
Begin processing the 45th record. run: 1102 subRun: 1 event: 16345 at 03-Nov-2025 18:09:18 CET
Begin processing the 46th record. run: 1102 subRun: 1 event: 16346 at 03-Nov-2025 18:09:26 CET
Begin processing the 47th record. run: 1102 subRun: 1 event: 16347 at 03-Nov-2025 18:09:30 CET
Begin processing the 48th record. run: 1102 subRun: 1 event: 16348 at 03-Nov-2025 18:09:34 CET
Begin processing the 49th record. run: 1102 subRun: 1 event: 16349 at 03-Nov-2025 18:09:40 CET
Begin processing the 50th record. run: 1102 subRun: 1 event: 16350 at 03-Nov-2025 18:09:45 CET
Begin processing the 51st record. run: 1102 subRun: 1 event: 16351 at 03-Nov-2025 18:09:49 CET
Begin processing the 52nd record. run: 1102 subRun: 1 event: 16352 at 03-Nov-2025 18:09:53 CET
Begin processing the 53rd record. run: 1102 subRun: 1 event: 16353 at 03-Nov-2025 18:09:57 CET
Begin processing the 54th record. run: 1102 subRun: 1 event: 16354 at 03-Nov-2025 18:10:02 CET
Begin processing the 55th record. run: 1102 subRun: 1 event: 16355 at 03-Nov-2025 18:10:08 CET
Begin processing the 56th record. run: 1102 subRun: 1 event: 16356 at 03-Nov-2025 18:10:12 CET
Begin processing the 57th record. run: 1102 subRun: 1 event: 16357 at 03-Nov-2025 18:10:16 CET
Begin processing the 58th record. run: 1102 subRun: 1 event: 16358 at 03-Nov-2025 18:10:21 CET
Begin processing the 59th record. run: 1102 subRun: 1 event: 16359 at 03-Nov-2025 18:10:25 CET
Begin processing the 60th record. run: 1102 subRun: 1 event: 16360 at 03-Nov-2025 18:10:29 CET
Begin processing the 61st record. run: 1102 subRun: 1 event: 16361 at 03-Nov-2025 18:10:33 CET
Begin processing the 62nd record. run: 1102 subRun: 1 event: 16362 at 03-Nov-2025 18:10:36 CET
Begin processing the 63rd record. run: 1102 subRun: 1 event: 16363 at 03-Nov-2025 18:10:40 CET
Begin processing the 64th record. run: 1102 subRun: 1 event: 16364 at 03-Nov-2025 18:10:43 CET
Begin processing the 65th record. run: 1102 subRun: 1 event: 16365 at 03-Nov-2025 18:10:47 CET
Begin processing the 66th record. run: 1102 subRun: 1 event: 16366 at 03-Nov-2025 18:10:50 CET
Begin processing the 67th record. run: 1102 subRun: 1 event: 16367 at 03-Nov-2025 18:10:54 CET
Begin processing the 68th record. run: 1102 subRun: 1 event: 16368 at 03-Nov-2025 18:10:57 CET
Begin processing the 69th record. run: 1102 subRun: 1 event: 16369 at 03-Nov-2025 18:11:00 CET
Begin processing the 70th record. run: 1102 subRun: 1 event: 16370 at 03-Nov-2025 18:11:03 CET
Begin processing the 71st record. run: 1102 subRun: 1 event: 16371 at 03-Nov-2025 18:11:07 CET
Begin processing the 72nd record. run: 1102 subRun: 1 event: 16372 at 03-Nov-2025 18:11:11 CET
Begin processing the 73rd record. run: 1102 subRun: 1 event: 16373 at 03-Nov-2025 18:11:13 CET
Begin processing the 74th record. run: 1102 subRun: 1 event: 16374 at 03-Nov-2025 18:11:16 CET
Begin processing the 75th record. run: 1102 subRun: 1 event: 16375 at 03-Nov-2025 18:11:19 CET
Begin processing the 76th record. run: 1102 subRun: 1 event: 16376 at 03-Nov-2025 18:11:23 CET
Begin processing the 77th record. run: 1102 subRun: 1 event: 16377 at 03-Nov-2025 18:11:26 CET
Begin processing the 78th record. run: 1102 subRun: 1 event: 16378 at 03-Nov-2025 18:11:29 CET
Begin processing the 79th record. run: 1102 subRun: 1 event: 16379 at 03-Nov-2025 18:11:32 CET
Begin processing the 80th record. run: 1102 subRun: 1 event: 16380 at 03-Nov-2025 18:11:36 CET
Begin processing the 81st record. run: 1102 subRun: 1 event: 16381 at 03-Nov-2025 18:11:40 CET
Begin processing the 82nd record. run: 1102 subRun: 1 event: 16382 at 03-Nov-2025 18:11:43 CET
Begin processing the 83rd record. run: 1102 subRun: 1 event: 16383 at 03-Nov-2025 18:11:47 CET
Begin processing the 84th record. run: 1102 subRun: 1 event: 16384 at 03-Nov-2025 18:11:51 CET
Begin processing the 85th record. run: 1102 subRun: 1 event: 16385 at 03-Nov-2025 18:11:54 CET
Begin processing the 86th record. run: 1102 subRun: 1 event: 16386 at 03-Nov-2025 18:11:58 CET
Begin processing the 87th record. run: 1102 subRun: 1 event: 16387 at 03-Nov-2025 18:12:01 CET
Begin processing the 88th record. run: 1102 subRun: 1 event: 16388 at 03-Nov-2025 18:12:04 CET
Begin processing the 89th record. run: 1102 subRun: 1 event: 16389 at 03-Nov-2025 18:12:08 CET
Begin processing the 90th record. run: 1102 subRun: 1 event: 16390 at 03-Nov-2025 18:12:12 CET
Begin processing the 91st record. run: 1102 subRun: 1 event: 16391 at 03-Nov-2025 18:12:15 CET
Begin processing the 92nd record. run: 1102 subRun: 1 event: 16392 at 03-Nov-2025 18:12:18 CET
Begin processing the 93rd record. run: 1102 subRun: 1 event: 16393 at 03-Nov-2025 18:12:22 CET
Begin processing the 94th record. run: 1102 subRun: 1 event: 16394 at 03-Nov-2025 18:12:25 CET
Begin processing the 95th record. run: 1102 subRun: 1 event: 16395 at 03-Nov-2025 18:12:29 CET
Begin processing the 96th record. run: 1102 subRun: 1 event: 16396 at 03-Nov-2025 18:12:32 CET
Begin processing the 97th record. run: 1102 subRun: 1 event: 16397 at 03-Nov-2025 18:12:36 CET
Begin processing the 98th record. run: 1102 subRun: 1 event: 16398 at 03-Nov-2025 18:12:39 CET
Begin processing the 99th record. run: 1102 subRun: 1 event: 16399 at 03-Nov-2025 18:12:42 CET
Begin processing the 100th record. run: 1102 subRun: 1 event: 16400 at 03-Nov-2025 18:12:46 CET
03-Nov-2025 18:12:50 CET  Closed output file "nu_dune10kt_1x2x6_1102_163_20230826T063854Z_gen_g4_detsim_hitreco__20240229T194415Z_reco2_reco2.root"
03-Nov-2025 18:12:50 CET  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3c/75/nu_dune10kt_1x2x6_1102_163_20230826T063854Z_gen_g4_detsim_hitreco__20240229T194415Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.36178       3.20196       7.57779       2.93851      0.798162        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0496162     0.0805603      0.12124      0.0755668     0.0109904       100    
reco:pandora:StandardPandora                    2.28404       3.1165        7.48918       2.84677      0.799718        100    
[art]:TriggerResults:TriggerResultInserter     1.065e-05    2.5329e-05    0.000460769   1.8239e-05    4.48765e-05      100    
end_path:out1:RootOutput                       2.374e-06    3.62976e-06   2.2543e-05    3.3815e-06    2.13164e-06      100    
end_path:out1:RootOutput(write)                0.0009651    0.00468111     0.0185277    0.00364045    0.00346378       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2263.17 MB
  Peak resident set size usage (VmHWM): 1262.06 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2025-11-04 07:30:38 UTC       justIN version: 01.05.01