justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242416.47@dunegpschedd01.fnal.gov

Jobsub ID242416.47@dunegpschedd01.fnal.gov
Workflow ID9556
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-11-03 16:45:05
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2025-11-03 17:20:10
From worker nodeHostnamewn-lb-02.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 17:12:58
Input filesfardet-hd:nu_dune10kt_1x2x6_1102_691_20230826T070401Z_gen_g4_detsim_hitreco__20240229T172827Z_reco2.root
JobscriptExit code0
Real time6m (397s)
CPU time6m (376s = 94%)
Max RSS bytes1275097088 (1216 MiB)
Outputting started2025-11-03 17:19:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_1/fnal/09556/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1102_691_20230826T070401Z_gen_g4_detsim_hitreco__20240229T172827Z_reco2.root
Finished2025-11-03 17:20:10
Saved logsjustin-logs:242416.47-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/7c/40/nu_dune10kt_1x2x6_1102_691_20230826T070401Z_gen_g4_detsim_hitreco__20240229T172827Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1102 subRun: 1 event: 69123 at 03-Nov-2025 18:15:24 CET
Begin processing the 24th record. run: 1102 subRun: 1 event: 69124 at 03-Nov-2025 18:15:26 CET
Begin processing the 25th record. run: 1102 subRun: 1 event: 69125 at 03-Nov-2025 18:15:29 CET
Begin processing the 26th record. run: 1102 subRun: 1 event: 69126 at 03-Nov-2025 18:15:32 CET
Begin processing the 27th record. run: 1102 subRun: 1 event: 69127 at 03-Nov-2025 18:15:36 CET
Begin processing the 28th record. run: 1102 subRun: 1 event: 69128 at 03-Nov-2025 18:15:39 CET
Begin processing the 29th record. run: 1102 subRun: 1 event: 69129 at 03-Nov-2025 18:15:44 CET
Begin processing the 30th record. run: 1102 subRun: 1 event: 69130 at 03-Nov-2025 18:15:47 CET
Begin processing the 31st record. run: 1102 subRun: 1 event: 69131 at 03-Nov-2025 18:15:50 CET
Begin processing the 32nd record. run: 1102 subRun: 1 event: 69132 at 03-Nov-2025 18:15:53 CET
Begin processing the 33rd record. run: 1102 subRun: 1 event: 69133 at 03-Nov-2025 18:15:56 CET
Begin processing the 34th record. run: 1102 subRun: 1 event: 69134 at 03-Nov-2025 18:15:59 CET
Begin processing the 35th record. run: 1102 subRun: 1 event: 69135 at 03-Nov-2025 18:16:02 CET
Begin processing the 36th record. run: 1102 subRun: 1 event: 69136 at 03-Nov-2025 18:16:05 CET
Begin processing the 37th record. run: 1102 subRun: 1 event: 69137 at 03-Nov-2025 18:16:08 CET
Begin processing the 38th record. run: 1102 subRun: 1 event: 69138 at 03-Nov-2025 18:16:11 CET
Begin processing the 39th record. run: 1102 subRun: 1 event: 69139 at 03-Nov-2025 18:16:14 CET
Begin processing the 40th record. run: 1102 subRun: 1 event: 69140 at 03-Nov-2025 18:16:16 CET
Begin processing the 41st record. run: 1102 subRun: 1 event: 69141 at 03-Nov-2025 18:16:20 CET
Begin processing the 42nd record. run: 1102 subRun: 1 event: 69142 at 03-Nov-2025 18:16:23 CET
Begin processing the 43rd record. run: 1102 subRun: 1 event: 69143 at 03-Nov-2025 18:16:26 CET
Begin processing the 44th record. run: 1102 subRun: 1 event: 69144 at 03-Nov-2025 18:16:29 CET
Begin processing the 45th record. run: 1102 subRun: 1 event: 69145 at 03-Nov-2025 18:16:32 CET
Begin processing the 46th record. run: 1102 subRun: 1 event: 69146 at 03-Nov-2025 18:16:35 CET
Begin processing the 47th record. run: 1102 subRun: 1 event: 69147 at 03-Nov-2025 18:16:37 CET
Begin processing the 48th record. run: 1102 subRun: 1 event: 69148 at 03-Nov-2025 18:16:40 CET
Begin processing the 49th record. run: 1102 subRun: 1 event: 69149 at 03-Nov-2025 18:16:43 CET
Begin processing the 50th record. run: 1102 subRun: 1 event: 69150 at 03-Nov-2025 18:16:46 CET
Begin processing the 51st record. run: 1102 subRun: 1 event: 69151 at 03-Nov-2025 18:16:49 CET
Begin processing the 52nd record. run: 1102 subRun: 1 event: 69152 at 03-Nov-2025 18:16:52 CET
Begin processing the 53rd record. run: 1102 subRun: 1 event: 69153 at 03-Nov-2025 18:16:55 CET
Begin processing the 54th record. run: 1102 subRun: 1 event: 69154 at 03-Nov-2025 18:16:58 CET
Begin processing the 55th record. run: 1102 subRun: 1 event: 69155 at 03-Nov-2025 18:17:01 CET
Begin processing the 56th record. run: 1102 subRun: 1 event: 69156 at 03-Nov-2025 18:17:04 CET
Begin processing the 57th record. run: 1102 subRun: 1 event: 69157 at 03-Nov-2025 18:17:07 CET
Begin processing the 58th record. run: 1102 subRun: 1 event: 69158 at 03-Nov-2025 18:17:10 CET
Begin processing the 59th record. run: 1102 subRun: 1 event: 69159 at 03-Nov-2025 18:17:14 CET
Begin processing the 60th record. run: 1102 subRun: 1 event: 69160 at 03-Nov-2025 18:17:17 CET
Begin processing the 61st record. run: 1102 subRun: 1 event: 69161 at 03-Nov-2025 18:17:20 CET
Begin processing the 62nd record. run: 1102 subRun: 1 event: 69162 at 03-Nov-2025 18:17:23 CET
Begin processing the 63rd record. run: 1102 subRun: 1 event: 69163 at 03-Nov-2025 18:17:26 CET
Begin processing the 64th record. run: 1102 subRun: 1 event: 69164 at 03-Nov-2025 18:17:29 CET
Begin processing the 65th record. run: 1102 subRun: 1 event: 69165 at 03-Nov-2025 18:17:33 CET
Begin processing the 66th record. run: 1102 subRun: 1 event: 69166 at 03-Nov-2025 18:17:35 CET
Begin processing the 67th record. run: 1102 subRun: 1 event: 69167 at 03-Nov-2025 18:17:38 CET
Begin processing the 68th record. run: 1102 subRun: 1 event: 69168 at 03-Nov-2025 18:17:41 CET
Begin processing the 69th record. run: 1102 subRun: 1 event: 69169 at 03-Nov-2025 18:17:46 CET
Begin processing the 70th record. run: 1102 subRun: 1 event: 69170 at 03-Nov-2025 18:17:49 CET
Begin processing the 71st record. run: 1102 subRun: 1 event: 69171 at 03-Nov-2025 18:17:53 CET
Begin processing the 72nd record. run: 1102 subRun: 1 event: 69172 at 03-Nov-2025 18:17:56 CET
Begin processing the 73rd record. run: 1102 subRun: 1 event: 69173 at 03-Nov-2025 18:17:59 CET
Begin processing the 74th record. run: 1102 subRun: 1 event: 69174 at 03-Nov-2025 18:18:02 CET
Begin processing the 75th record. run: 1102 subRun: 1 event: 69175 at 03-Nov-2025 18:18:07 CET
Begin processing the 76th record. run: 1102 subRun: 1 event: 69176 at 03-Nov-2025 18:18:11 CET
Begin processing the 77th record. run: 1102 subRun: 1 event: 69177 at 03-Nov-2025 18:18:14 CET
Begin processing the 78th record. run: 1102 subRun: 1 event: 69178 at 03-Nov-2025 18:18:18 CET
Begin processing the 79th record. run: 1102 subRun: 1 event: 69179 at 03-Nov-2025 18:18:21 CET
Begin processing the 80th record. run: 1102 subRun: 1 event: 69180 at 03-Nov-2025 18:18:25 CET
Begin processing the 81st record. run: 1102 subRun: 1 event: 69181 at 03-Nov-2025 18:18:28 CET
Begin processing the 82nd record. run: 1102 subRun: 1 event: 69182 at 03-Nov-2025 18:18:31 CET
Begin processing the 83rd record. run: 1102 subRun: 1 event: 69183 at 03-Nov-2025 18:18:34 CET
Begin processing the 84th record. run: 1102 subRun: 1 event: 69184 at 03-Nov-2025 18:18:38 CET
Begin processing the 85th record. run: 1102 subRun: 1 event: 69185 at 03-Nov-2025 18:18:41 CET
Begin processing the 86th record. run: 1102 subRun: 1 event: 69186 at 03-Nov-2025 18:18:45 CET
Begin processing the 87th record. run: 1102 subRun: 1 event: 69187 at 03-Nov-2025 18:18:48 CET
Begin processing the 88th record. run: 1102 subRun: 1 event: 69188 at 03-Nov-2025 18:18:51 CET
Begin processing the 89th record. run: 1102 subRun: 1 event: 69189 at 03-Nov-2025 18:18:54 CET
Begin processing the 90th record. run: 1102 subRun: 1 event: 69190 at 03-Nov-2025 18:18:58 CET
Begin processing the 91st record. run: 1102 subRun: 1 event: 69191 at 03-Nov-2025 18:19:01 CET
Begin processing the 92nd record. run: 1102 subRun: 1 event: 69192 at 03-Nov-2025 18:19:04 CET
Begin processing the 93rd record. run: 1102 subRun: 1 event: 69193 at 03-Nov-2025 18:19:07 CET
Begin processing the 94th record. run: 1102 subRun: 1 event: 69194 at 03-Nov-2025 18:19:11 CET
Begin processing the 95th record. run: 1102 subRun: 1 event: 69195 at 03-Nov-2025 18:19:14 CET
Begin processing the 96th record. run: 1102 subRun: 1 event: 69196 at 03-Nov-2025 18:19:17 CET
Begin processing the 97th record. run: 1102 subRun: 1 event: 69197 at 03-Nov-2025 18:19:20 CET
Begin processing the 98th record. run: 1102 subRun: 1 event: 69198 at 03-Nov-2025 18:19:24 CET
Begin processing the 99th record. run: 1102 subRun: 1 event: 69199 at 03-Nov-2025 18:19:28 CET
Begin processing the 100th record. run: 1102 subRun: 1 event: 69200 at 03-Nov-2025 18:19:31 CET
03-Nov-2025 18:19:35 CET  Closed output file "nu_dune10kt_1x2x6_1102_691_20230826T070401Z_gen_g4_detsim_hitreco__20240229T172827Z_reco2_reco2.root"
03-Nov-2025 18:19:35 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/7c/40/nu_dune10kt_1x2x6_1102_691_20230826T070401Z_gen_g4_detsim_hitreco__20240229T172827Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.71599       3.16739       7.60255       3.05072      0.613167        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00475944     0.0504327      1.75752      0.0262386     0.186322        100    
reco:pandora:StandardPandora                    2.68732       3.11196       7.56172       3.01327      0.595118        100    
[art]:TriggerResults:TriggerResultInserter    1.5252e-05    2.31358e-05   0.000111747   2.16675e-05   1.02287e-05      100    
end_path:out1:RootOutput                       4.708e-06    5.8171e-06    1.9699e-05     5.478e-06    1.78496e-06      100    
end_path:out1:RootOutput(write)               0.00130821    0.00473302     0.0156439    0.00385752    0.00305033       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2253.9 MB
  Peak resident set size usage (VmHWM): 1275.1 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2025-11-04 01:41:32 UTC       justIN version: 01.05.01