justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242416.9@dunegpschedd01.fnal.gov

Jobsub ID242416.9@dunegpschedd01.fnal.gov
Workflow ID9556
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-11-03 16:45:05
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-11-03 17:26:10
From worker nodeHostnamecomp19-02
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 17:11:55
Input filesfardet-hd:nu_dune10kt_1x2x6_1100_490_20230826T034414Z_gen_g4_detsim_hitreco__20240229T174337Z_reco2.root
JobscriptExit code0
Real time13m (831s)
CPU time4m (283s = 34%)
Max RSS bytes1270276096 (1211 MiB)
Outputting started2025-11-03 17:25:47
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_1/fnal/09556/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1100_490_20230826T034414Z_gen_g4_detsim_hitreco__20240229T174337Z_reco2.root
Finished2025-11-03 17:26:10
Saved logsjustin-logs:242416.9-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

-----------
Input PFN = root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/e2/7c/nu_dune10kt_1x2x6_1100_490_20230826T034414Z_gen_g4_detsim_hitreco__20240229T174337Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1100 subRun: 1 event: 49023 at 03-Nov-2025 17:20:06 GMT
Begin processing the 24th record. run: 1100 subRun: 1 event: 49024 at 03-Nov-2025 17:20:09 GMT
Begin processing the 25th record. run: 1100 subRun: 1 event: 49025 at 03-Nov-2025 17:20:12 GMT
Begin processing the 26th record. run: 1100 subRun: 1 event: 49026 at 03-Nov-2025 17:20:15 GMT
Begin processing the 27th record. run: 1100 subRun: 1 event: 49027 at 03-Nov-2025 17:20:18 GMT
Begin processing the 28th record. run: 1100 subRun: 1 event: 49028 at 03-Nov-2025 17:20:22 GMT
Begin processing the 29th record. run: 1100 subRun: 1 event: 49029 at 03-Nov-2025 17:20:25 GMT
Begin processing the 30th record. run: 1100 subRun: 1 event: 49030 at 03-Nov-2025 17:20:28 GMT
Begin processing the 31st record. run: 1100 subRun: 1 event: 49031 at 03-Nov-2025 17:20:31 GMT
Begin processing the 32nd record. run: 1100 subRun: 1 event: 49032 at 03-Nov-2025 17:20:38 GMT
Begin processing the 33rd record. run: 1100 subRun: 1 event: 49033 at 03-Nov-2025 17:20:42 GMT
Begin processing the 34th record. run: 1100 subRun: 1 event: 49034 at 03-Nov-2025 17:20:54 GMT
Begin processing the 35th record. run: 1100 subRun: 1 event: 49035 at 03-Nov-2025 17:20:58 GMT
Begin processing the 36th record. run: 1100 subRun: 1 event: 49036 at 03-Nov-2025 17:21:01 GMT
Begin processing the 37th record. run: 1100 subRun: 1 event: 49037 at 03-Nov-2025 17:21:03 GMT
Begin processing the 38th record. run: 1100 subRun: 1 event: 49038 at 03-Nov-2025 17:21:06 GMT
Begin processing the 39th record. run: 1100 subRun: 1 event: 49039 at 03-Nov-2025 17:21:09 GMT
Begin processing the 40th record. run: 1100 subRun: 1 event: 49040 at 03-Nov-2025 17:21:11 GMT
Begin processing the 41st record. run: 1100 subRun: 1 event: 49041 at 03-Nov-2025 17:21:16 GMT
Begin processing the 42nd record. run: 1100 subRun: 1 event: 49042 at 03-Nov-2025 17:21:19 GMT
Begin processing the 43rd record. run: 1100 subRun: 1 event: 49043 at 03-Nov-2025 17:21:23 GMT
Begin processing the 44th record. run: 1100 subRun: 1 event: 49044 at 03-Nov-2025 17:21:28 GMT
Begin processing the 45th record. run: 1100 subRun: 1 event: 49045 at 03-Nov-2025 17:21:31 GMT
Begin processing the 46th record. run: 1100 subRun: 1 event: 49046 at 03-Nov-2025 17:21:34 GMT
Begin processing the 47th record. run: 1100 subRun: 1 event: 49047 at 03-Nov-2025 17:21:37 GMT
Begin processing the 48th record. run: 1100 subRun: 1 event: 49048 at 03-Nov-2025 17:21:40 GMT
Begin processing the 49th record. run: 1100 subRun: 1 event: 49049 at 03-Nov-2025 17:21:44 GMT
Begin processing the 50th record. run: 1100 subRun: 1 event: 49050 at 03-Nov-2025 17:21:47 GMT
Begin processing the 51st record. run: 1100 subRun: 1 event: 49051 at 03-Nov-2025 17:21:51 GMT
Begin processing the 52nd record. run: 1100 subRun: 1 event: 49052 at 03-Nov-2025 17:21:54 GMT
Begin processing the 53rd record. run: 1100 subRun: 1 event: 49053 at 03-Nov-2025 17:21:57 GMT
Begin processing the 54th record. run: 1100 subRun: 1 event: 49054 at 03-Nov-2025 17:22:02 GMT
Begin processing the 55th record. run: 1100 subRun: 1 event: 49055 at 03-Nov-2025 17:22:05 GMT
Begin processing the 56th record. run: 1100 subRun: 1 event: 49056 at 03-Nov-2025 17:22:09 GMT
Begin processing the 57th record. run: 1100 subRun: 1 event: 49057 at 03-Nov-2025 17:22:21 GMT
Begin processing the 58th record. run: 1100 subRun: 1 event: 49058 at 03-Nov-2025 17:22:26 GMT
Begin processing the 59th record. run: 1100 subRun: 1 event: 49059 at 03-Nov-2025 17:22:29 GMT
Begin processing the 60th record. run: 1100 subRun: 1 event: 49060 at 03-Nov-2025 17:22:36 GMT
Begin processing the 61st record. run: 1100 subRun: 1 event: 49061 at 03-Nov-2025 17:22:39 GMT
Begin processing the 62nd record. run: 1100 subRun: 1 event: 49062 at 03-Nov-2025 17:22:43 GMT
Begin processing the 63rd record. run: 1100 subRun: 1 event: 49063 at 03-Nov-2025 17:22:48 GMT
Begin processing the 64th record. run: 1100 subRun: 1 event: 49064 at 03-Nov-2025 17:22:53 GMT
Begin processing the 65th record. run: 1100 subRun: 1 event: 49065 at 03-Nov-2025 17:22:55 GMT
Begin processing the 66th record. run: 1100 subRun: 1 event: 49066 at 03-Nov-2025 17:22:59 GMT
Begin processing the 67th record. run: 1100 subRun: 1 event: 49067 at 03-Nov-2025 17:23:03 GMT
Begin processing the 68th record. run: 1100 subRun: 1 event: 49068 at 03-Nov-2025 17:23:06 GMT
Begin processing the 69th record. run: 1100 subRun: 1 event: 49069 at 03-Nov-2025 17:23:10 GMT
Begin processing the 70th record. run: 1100 subRun: 1 event: 49070 at 03-Nov-2025 17:23:15 GMT
Begin processing the 71st record. run: 1100 subRun: 1 event: 49071 at 03-Nov-2025 17:23:17 GMT
Begin processing the 72nd record. run: 1100 subRun: 1 event: 49072 at 03-Nov-2025 17:23:22 GMT
Begin processing the 73rd record. run: 1100 subRun: 1 event: 49073 at 03-Nov-2025 17:23:26 GMT
Begin processing the 74th record. run: 1100 subRun: 1 event: 49074 at 03-Nov-2025 17:23:31 GMT
Begin processing the 75th record. run: 1100 subRun: 1 event: 49075 at 03-Nov-2025 17:23:34 GMT
Begin processing the 76th record. run: 1100 subRun: 1 event: 49076 at 03-Nov-2025 17:23:37 GMT
Begin processing the 77th record. run: 1100 subRun: 1 event: 49077 at 03-Nov-2025 17:23:42 GMT
Begin processing the 78th record. run: 1100 subRun: 1 event: 49078 at 03-Nov-2025 17:23:48 GMT
Begin processing the 79th record. run: 1100 subRun: 1 event: 49079 at 03-Nov-2025 17:23:50 GMT
Begin processing the 80th record. run: 1100 subRun: 1 event: 49080 at 03-Nov-2025 17:23:53 GMT
Begin processing the 81st record. run: 1100 subRun: 1 event: 49081 at 03-Nov-2025 17:23:56 GMT
Begin processing the 82nd record. run: 1100 subRun: 1 event: 49082 at 03-Nov-2025 17:24:00 GMT
Begin processing the 83rd record. run: 1100 subRun: 1 event: 49083 at 03-Nov-2025 17:24:02 GMT
Begin processing the 84th record. run: 1100 subRun: 1 event: 49084 at 03-Nov-2025 17:24:07 GMT
Begin processing the 85th record. run: 1100 subRun: 1 event: 49085 at 03-Nov-2025 17:24:12 GMT
Begin processing the 86th record. run: 1100 subRun: 1 event: 49086 at 03-Nov-2025 17:24:16 GMT
Begin processing the 87th record. run: 1100 subRun: 1 event: 49087 at 03-Nov-2025 17:24:21 GMT
Begin processing the 88th record. run: 1100 subRun: 1 event: 49088 at 03-Nov-2025 17:24:25 GMT
Begin processing the 89th record. run: 1100 subRun: 1 event: 49089 at 03-Nov-2025 17:24:27 GMT
Begin processing the 90th record. run: 1100 subRun: 1 event: 49090 at 03-Nov-2025 17:24:31 GMT
Begin processing the 91st record. run: 1100 subRun: 1 event: 49091 at 03-Nov-2025 17:24:49 GMT
Begin processing the 92nd record. run: 1100 subRun: 1 event: 49092 at 03-Nov-2025 17:24:53 GMT
Begin processing the 93rd record. run: 1100 subRun: 1 event: 49093 at 03-Nov-2025 17:24:56 GMT
Begin processing the 94th record. run: 1100 subRun: 1 event: 49094 at 03-Nov-2025 17:25:09 GMT
Begin processing the 95th record. run: 1100 subRun: 1 event: 49095 at 03-Nov-2025 17:25:13 GMT
Begin processing the 96th record. run: 1100 subRun: 1 event: 49096 at 03-Nov-2025 17:25:16 GMT
Begin processing the 97th record. run: 1100 subRun: 1 event: 49097 at 03-Nov-2025 17:25:22 GMT
Begin processing the 98th record. run: 1100 subRun: 1 event: 49098 at 03-Nov-2025 17:25:28 GMT
Begin processing the 99th record. run: 1100 subRun: 1 event: 49099 at 03-Nov-2025 17:25:35 GMT
Begin processing the 100th record. run: 1100 subRun: 1 event: 49100 at 03-Nov-2025 17:25:39 GMT
03-Nov-2025 17:25:45 GMT  Closed output file "nu_dune10kt_1x2x6_1100_490_20230826T034414Z_gen_g4_detsim_hitreco__20240229T174337Z_reco2_reco2.root"
03-Nov-2025 17:25:45 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/e2/7c/nu_dune10kt_1x2x6_1100_490_20230826T034414Z_gen_g4_detsim_hitreco__20240229T174337Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.128325       2.42545       5.27493       2.3411       0.491438        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0240597     0.043328      0.117636      0.0393909     0.0171979       100    
reco:pandora:StandardPandora                   0.0948712      2.37849       5.2223        2.29193      0.488716        100    
[art]:TriggerResults:TriggerResultInserter    1.0819e-05    1.73642e-05   0.000111451   1.5387e-05    1.14157e-05      100    
end_path:out1:RootOutput                       1.883e-06    3.12246e-06   1.6195e-05     2.562e-06    1.70625e-06      100    
end_path:out1:RootOutput(write)               0.000933408   0.00347591     0.0124942    0.00284869    0.00222725       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2257.94 MB
  Peak resident set size usage (VmHWM): 1270.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2025-11-04 01:55:03 UTC       justIN version: 01.05.01