justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232081.150@dunegpschedd01.fnal.gov

Jobsub ID232081.150@dunegpschedd01.fnal.gov
Workflow ID8775
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-10-09 12:20:46
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-10-09 12:59:56
From worker nodeHostnamewn1207090.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-09 12:30:45
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2.root
JobscriptExit code0
Real time28m (1717s)
CPU time25m (1551s = 90%)
Max RSS bytes1388765184 (1324 MiB)
Outputting started2025-10-09 12:59:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/atm_hierarchy_val/fnal/08775/1/001/DLHierarchyValidationFile_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2.root
Finished2025-10-09 12:59:56
Saved logsjustin-logs:232081.150-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

co__20240507T214721Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 6404651 subRun: 1 event: 80023 at 09-Oct-2025 13:35:18 BST
Begin processing the 24th record. run: 6404651 subRun: 1 event: 80024 at 09-Oct-2025 13:35:20 BST
Begin processing the 25th record. run: 6404651 subRun: 1 event: 80025 at 09-Oct-2025 13:35:22 BST
Begin processing the 26th record. run: 6404651 subRun: 1 event: 80026 at 09-Oct-2025 13:35:24 BST
Begin processing the 27th record. run: 6404651 subRun: 1 event: 80027 at 09-Oct-2025 13:35:27 BST
Begin processing the 28th record. run: 6404651 subRun: 1 event: 80028 at 09-Oct-2025 13:35:30 BST
Begin processing the 29th record. run: 6404651 subRun: 1 event: 80029 at 09-Oct-2025 13:35:32 BST
Begin processing the 30th record. run: 6404651 subRun: 1 event: 80030 at 09-Oct-2025 13:35:34 BST
Begin processing the 31st record. run: 6404651 subRun: 1 event: 80031 at 09-Oct-2025 13:35:37 BST
Begin processing the 32nd record. run: 6404651 subRun: 1 event: 80032 at 09-Oct-2025 13:35:39 BST
Begin processing the 33rd record. run: 6404651 subRun: 1 event: 80033 at 09-Oct-2025 13:35:41 BST
Begin processing the 34th record. run: 6404651 subRun: 1 event: 80034 at 09-Oct-2025 13:35:43 BST
Begin processing the 35th record. run: 6404651 subRun: 1 event: 80035 at 09-Oct-2025 13:35:46 BST
Begin processing the 36th record. run: 6404651 subRun: 1 event: 80036 at 09-Oct-2025 13:35:48 BST
Begin processing the 37th record. run: 6404651 subRun: 1 event: 80037 at 09-Oct-2025 13:35:51 BST
Begin processing the 38th record. run: 6404651 subRun: 1 event: 80038 at 09-Oct-2025 13:35:53 BST
Begin processing the 39th record. run: 6404651 subRun: 1 event: 80039 at 09-Oct-2025 13:35:56 BST
Begin processing the 40th record. run: 6404651 subRun: 1 event: 80040 at 09-Oct-2025 13:51:00 BST
Begin processing the 41st record. run: 6404651 subRun: 1 event: 80041 at 09-Oct-2025 13:51:02 BST
Begin processing the 42nd record. run: 6404651 subRun: 1 event: 80042 at 09-Oct-2025 13:51:05 BST
Begin processing the 43rd record. run: 6404651 subRun: 1 event: 80043 at 09-Oct-2025 13:51:07 BST
Begin processing the 44th record. run: 6404651 subRun: 1 event: 80044 at 09-Oct-2025 13:51:09 BST
Begin processing the 45th record. run: 6404651 subRun: 1 event: 80045 at 09-Oct-2025 13:51:11 BST
Begin processing the 46th record. run: 6404651 subRun: 1 event: 80046 at 09-Oct-2025 13:51:14 BST
Begin processing the 47th record. run: 6404651 subRun: 1 event: 80047 at 09-Oct-2025 13:51:34 BST
Begin processing the 48th record. run: 6404651 subRun: 1 event: 80048 at 09-Oct-2025 13:51:36 BST
Begin processing the 49th record. run: 6404651 subRun: 1 event: 80049 at 09-Oct-2025 13:51:39 BST
Begin processing the 50th record. run: 6404651 subRun: 1 event: 80050 at 09-Oct-2025 13:51:41 BST
Begin processing the 51st record. run: 6404651 subRun: 1 event: 80051 at 09-Oct-2025 13:51:43 BST
Begin processing the 52nd record. run: 6404651 subRun: 1 event: 80052 at 09-Oct-2025 13:51:45 BST
Begin processing the 53rd record. run: 6404651 subRun: 1 event: 80053 at 09-Oct-2025 13:51:56 BST
Begin processing the 54th record. run: 6404651 subRun: 1 event: 80054 at 09-Oct-2025 13:51:58 BST
Begin processing the 55th record. run: 6404651 subRun: 1 event: 80055 at 09-Oct-2025 13:52:01 BST
Begin processing the 56th record. run: 6404651 subRun: 1 event: 80056 at 09-Oct-2025 13:52:20 BST
Begin processing the 57th record. run: 6404651 subRun: 1 event: 80057 at 09-Oct-2025 13:52:22 BST
Begin processing the 58th record. run: 6404651 subRun: 1 event: 80058 at 09-Oct-2025 13:52:25 BST
Begin processing the 59th record. run: 6404651 subRun: 1 event: 80059 at 09-Oct-2025 13:52:28 BST
Begin processing the 60th record. run: 6404651 subRun: 1 event: 80060 at 09-Oct-2025 13:52:51 BST
Begin processing the 61st record. run: 6404651 subRun: 1 event: 80061 at 09-Oct-2025 13:56:05 BST
Begin processing the 62nd record. run: 6404651 subRun: 1 event: 80062 at 09-Oct-2025 13:56:45 BST
Begin processing the 63rd record. run: 6404651 subRun: 1 event: 80063 at 09-Oct-2025 13:56:47 BST
Begin processing the 64th record. run: 6404651 subRun: 1 event: 80064 at 09-Oct-2025 13:56:50 BST
Begin processing the 65th record. run: 6404651 subRun: 1 event: 80065 at 09-Oct-2025 13:56:53 BST
Begin processing the 66th record. run: 6404651 subRun: 1 event: 80066 at 09-Oct-2025 13:56:55 BST
Begin processing the 67th record. run: 6404651 subRun: 1 event: 80067 at 09-Oct-2025 13:56:57 BST
Begin processing the 68th record. run: 6404651 subRun: 1 event: 80068 at 09-Oct-2025 13:56:59 BST
Begin processing the 69th record. run: 6404651 subRun: 1 event: 80069 at 09-Oct-2025 13:57:02 BST
Begin processing the 70th record. run: 6404651 subRun: 1 event: 80070 at 09-Oct-2025 13:57:04 BST
Begin processing the 71st record. run: 6404651 subRun: 1 event: 80071 at 09-Oct-2025 13:57:06 BST
Begin processing the 72nd record. run: 6404651 subRun: 1 event: 80072 at 09-Oct-2025 13:57:32 BST
Begin processing the 73rd record. run: 6404651 subRun: 1 event: 80073 at 09-Oct-2025 13:57:35 BST
Begin processing the 74th record. run: 6404651 subRun: 1 event: 80074 at 09-Oct-2025 13:57:37 BST
Begin processing the 75th record. run: 6404651 subRun: 1 event: 80075 at 09-Oct-2025 13:57:40 BST
Begin processing the 76th record. run: 6404651 subRun: 1 event: 80076 at 09-Oct-2025 13:57:42 BST
Begin processing the 77th record. run: 6404651 subRun: 1 event: 80077 at 09-Oct-2025 13:57:45 BST
Begin processing the 78th record. run: 6404651 subRun: 1 event: 80078 at 09-Oct-2025 13:57:47 BST
Begin processing the 79th record. run: 6404651 subRun: 1 event: 80079 at 09-Oct-2025 13:57:49 BST
Begin processing the 80th record. run: 6404651 subRun: 1 event: 80080 at 09-Oct-2025 13:57:51 BST
Begin processing the 81st record. run: 6404651 subRun: 1 event: 80081 at 09-Oct-2025 13:57:53 BST
Begin processing the 82nd record. run: 6404651 subRun: 1 event: 80082 at 09-Oct-2025 13:57:56 BST
Begin processing the 83rd record. run: 6404651 subRun: 1 event: 80083 at 09-Oct-2025 13:57:58 BST
Begin processing the 84th record. run: 6404651 subRun: 1 event: 80084 at 09-Oct-2025 13:58:01 BST
Begin processing the 85th record. run: 6404651 subRun: 1 event: 80085 at 09-Oct-2025 13:58:03 BST
Begin processing the 86th record. run: 6404651 subRun: 1 event: 80086 at 09-Oct-2025 13:58:06 BST
Begin processing the 87th record. run: 6404651 subRun: 1 event: 80087 at 09-Oct-2025 13:58:09 BST
Begin processing the 88th record. run: 6404651 subRun: 1 event: 80088 at 09-Oct-2025 13:58:11 BST
Begin processing the 89th record. run: 6404651 subRun: 1 event: 80089 at 09-Oct-2025 13:58:14 BST
Begin processing the 90th record. run: 6404651 subRun: 1 event: 80090 at 09-Oct-2025 13:58:17 BST
Begin processing the 91st record. run: 6404651 subRun: 1 event: 80091 at 09-Oct-2025 13:58:36 BST
Begin processing the 92nd record. run: 6404651 subRun: 1 event: 80092 at 09-Oct-2025 13:58:38 BST
Begin processing the 93rd record. run: 6404651 subRun: 1 event: 80093 at 09-Oct-2025 13:58:59 BST
Begin processing the 94th record. run: 6404651 subRun: 1 event: 80094 at 09-Oct-2025 13:59:02 BST
Begin processing the 95th record. run: 6404651 subRun: 1 event: 80095 at 09-Oct-2025 13:59:05 BST
Begin processing the 96th record. run: 6404651 subRun: 1 event: 80096 at 09-Oct-2025 13:59:08 BST
Begin processing the 97th record. run: 6404651 subRun: 1 event: 80097 at 09-Oct-2025 13:59:10 BST
Begin processing the 98th record. run: 6404651 subRun: 1 event: 80098 at 09-Oct-2025 13:59:12 BST
Begin processing the 99th record. run: 6404651 subRun: 1 event: 80099 at 09-Oct-2025 13:59:15 BST
Begin processing the 100th record. run: 6404651 subRun: 1 event: 80100 at 09-Oct-2025 13:59:17 BST
09-Oct-2025 13:59:22 BST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_reco2.root"
09-Oct-2025 13:59:22 BST  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3b/8b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.58695       15.0139       902.312       2.11097       91.2885        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0107829     0.0346804      0.25536      0.0269666     0.029792        100    
reco:pandora:StandardPandora                    1.5697        14.9625       902.116       2.0681         91.27         100    
[art]:TriggerResults:TriggerResultInserter    1.4307e-05    3.12666e-05   0.000144653   2.31485e-05   2.20472e-05      100    
end_path:out1:RootOutput                       3.607e-06    4.68039e-06   2.7351e-05     4.403e-06    2.32511e-06      100    
end_path:out1:RootOutput(write)               0.00123723     0.0164478     0.187602     0.00465369     0.0297606       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2386.39 MB
  Peak resident set size usage (VmHWM): 1388.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-11-04 18:23:01 UTC       justIN version: 01.05.01