justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242416.56@dunegpschedd01.fnal.gov

Jobsub ID242416.56@dunegpschedd01.fnal.gov
Workflow ID9556
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-11-03 16:45:05
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2025-11-03 17:18:30
From worker nodeHostnamewn-da-11.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 17:13:00
Input filesfardet-hd:nu_dune10kt_1x2x6_1062_230_20230823T120708Z_gen_g4_detsim_hitreco__20240229T184635Z_reco2.root
JobscriptExit code0
Real time5m (302s)
CPU time4m (290s = 96%)
Max RSS bytes1330835456 (1269 MiB)
Outputting started2025-11-03 17:18:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_1/fnal/09556/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1062_230_20230823T120708Z_gen_g4_detsim_hitreco__20240229T184635Z_reco2.root
Finished2025-11-03 17:18:30
Saved logsjustin-logs:242416.56-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/cc/af/nu_dune10kt_1x2x6_1062_230_20230823T120708Z_gen_g4_detsim_hitreco__20240229T184635Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1062 subRun: 1 event: 23023 at 03-Nov-2025 18:14:51 CET
Begin processing the 24th record. run: 1062 subRun: 1 event: 23024 at 03-Nov-2025 18:14:53 CET
Begin processing the 25th record. run: 1062 subRun: 1 event: 23025 at 03-Nov-2025 18:14:56 CET
Begin processing the 26th record. run: 1062 subRun: 1 event: 23026 at 03-Nov-2025 18:14:58 CET
Begin processing the 27th record. run: 1062 subRun: 1 event: 23027 at 03-Nov-2025 18:15:00 CET
Begin processing the 28th record. run: 1062 subRun: 1 event: 23028 at 03-Nov-2025 18:15:02 CET
Begin processing the 29th record. run: 1062 subRun: 1 event: 23029 at 03-Nov-2025 18:15:04 CET
Begin processing the 30th record. run: 1062 subRun: 1 event: 23030 at 03-Nov-2025 18:15:06 CET
Begin processing the 31st record. run: 1062 subRun: 1 event: 23031 at 03-Nov-2025 18:15:09 CET
Begin processing the 32nd record. run: 1062 subRun: 1 event: 23032 at 03-Nov-2025 18:15:11 CET
Begin processing the 33rd record. run: 1062 subRun: 1 event: 23033 at 03-Nov-2025 18:15:14 CET
Begin processing the 34th record. run: 1062 subRun: 1 event: 23034 at 03-Nov-2025 18:15:16 CET
Begin processing the 35th record. run: 1062 subRun: 1 event: 23035 at 03-Nov-2025 18:15:18 CET
Begin processing the 36th record. run: 1062 subRun: 1 event: 23036 at 03-Nov-2025 18:15:21 CET
Begin processing the 37th record. run: 1062 subRun: 1 event: 23037 at 03-Nov-2025 18:15:24 CET
Begin processing the 38th record. run: 1062 subRun: 1 event: 23038 at 03-Nov-2025 18:15:26 CET
Begin processing the 39th record. run: 1062 subRun: 1 event: 23039 at 03-Nov-2025 18:15:30 CET
Begin processing the 40th record. run: 1062 subRun: 1 event: 23040 at 03-Nov-2025 18:15:32 CET
Begin processing the 41st record. run: 1062 subRun: 1 event: 23041 at 03-Nov-2025 18:15:35 CET
Begin processing the 42nd record. run: 1062 subRun: 1 event: 23042 at 03-Nov-2025 18:15:37 CET
Begin processing the 43rd record. run: 1062 subRun: 1 event: 23043 at 03-Nov-2025 18:15:39 CET
Begin processing the 44th record. run: 1062 subRun: 1 event: 23044 at 03-Nov-2025 18:15:42 CET
Begin processing the 45th record. run: 1062 subRun: 1 event: 23045 at 03-Nov-2025 18:15:44 CET
Begin processing the 46th record. run: 1062 subRun: 1 event: 23046 at 03-Nov-2025 18:15:47 CET
Begin processing the 47th record. run: 1062 subRun: 1 event: 23047 at 03-Nov-2025 18:15:49 CET
Begin processing the 48th record. run: 1062 subRun: 1 event: 23048 at 03-Nov-2025 18:15:51 CET
Begin processing the 49th record. run: 1062 subRun: 1 event: 23049 at 03-Nov-2025 18:15:53 CET
Begin processing the 50th record. run: 1062 subRun: 1 event: 23050 at 03-Nov-2025 18:15:56 CET
Begin processing the 51st record. run: 1062 subRun: 1 event: 23051 at 03-Nov-2025 18:15:58 CET
Begin processing the 52nd record. run: 1062 subRun: 1 event: 23052 at 03-Nov-2025 18:16:00 CET
Begin processing the 53rd record. run: 1062 subRun: 1 event: 23053 at 03-Nov-2025 18:16:03 CET
Begin processing the 54th record. run: 1062 subRun: 1 event: 23054 at 03-Nov-2025 18:16:05 CET
Begin processing the 55th record. run: 1062 subRun: 1 event: 23055 at 03-Nov-2025 18:16:07 CET
Begin processing the 56th record. run: 1062 subRun: 1 event: 23056 at 03-Nov-2025 18:16:10 CET
Begin processing the 57th record. run: 1062 subRun: 1 event: 23057 at 03-Nov-2025 18:16:12 CET
Begin processing the 58th record. run: 1062 subRun: 1 event: 23058 at 03-Nov-2025 18:16:14 CET
Begin processing the 59th record. run: 1062 subRun: 1 event: 23059 at 03-Nov-2025 18:16:16 CET
Begin processing the 60th record. run: 1062 subRun: 1 event: 23060 at 03-Nov-2025 18:16:20 CET
Begin processing the 61st record. run: 1062 subRun: 1 event: 23061 at 03-Nov-2025 18:16:22 CET
Begin processing the 62nd record. run: 1062 subRun: 1 event: 23062 at 03-Nov-2025 18:16:25 CET
Begin processing the 63rd record. run: 1062 subRun: 1 event: 23063 at 03-Nov-2025 18:16:27 CET
Begin processing the 64th record. run: 1062 subRun: 1 event: 23064 at 03-Nov-2025 18:16:29 CET
Begin processing the 65th record. run: 1062 subRun: 1 event: 23065 at 03-Nov-2025 18:16:31 CET
Begin processing the 66th record. run: 1062 subRun: 1 event: 23066 at 03-Nov-2025 18:16:34 CET
Begin processing the 67th record. run: 1062 subRun: 1 event: 23067 at 03-Nov-2025 18:16:36 CET
Begin processing the 68th record. run: 1062 subRun: 1 event: 23068 at 03-Nov-2025 18:16:39 CET
Begin processing the 69th record. run: 1062 subRun: 1 event: 23069 at 03-Nov-2025 18:16:41 CET
Begin processing the 70th record. run: 1062 subRun: 1 event: 23070 at 03-Nov-2025 18:16:43 CET
Begin processing the 71st record. run: 1062 subRun: 1 event: 23071 at 03-Nov-2025 18:16:46 CET
Begin processing the 72nd record. run: 1062 subRun: 1 event: 23072 at 03-Nov-2025 18:16:48 CET
Begin processing the 73rd record. run: 1062 subRun: 1 event: 23073 at 03-Nov-2025 18:16:51 CET
Begin processing the 74th record. run: 1062 subRun: 1 event: 23074 at 03-Nov-2025 18:16:53 CET
Begin processing the 75th record. run: 1062 subRun: 1 event: 23075 at 03-Nov-2025 18:16:56 CET
Begin processing the 76th record. run: 1062 subRun: 1 event: 23076 at 03-Nov-2025 18:16:58 CET
Begin processing the 77th record. run: 1062 subRun: 1 event: 23077 at 03-Nov-2025 18:17:01 CET
Begin processing the 78th record. run: 1062 subRun: 1 event: 23078 at 03-Nov-2025 18:17:06 CET
Begin processing the 79th record. run: 1062 subRun: 1 event: 23079 at 03-Nov-2025 18:17:09 CET
Begin processing the 80th record. run: 1062 subRun: 1 event: 23080 at 03-Nov-2025 18:17:12 CET
Begin processing the 81st record. run: 1062 subRun: 1 event: 23081 at 03-Nov-2025 18:17:14 CET
Begin processing the 82nd record. run: 1062 subRun: 1 event: 23082 at 03-Nov-2025 18:17:16 CET
Begin processing the 83rd record. run: 1062 subRun: 1 event: 23083 at 03-Nov-2025 18:17:18 CET
Begin processing the 84th record. run: 1062 subRun: 1 event: 23084 at 03-Nov-2025 18:17:20 CET
Begin processing the 85th record. run: 1062 subRun: 1 event: 23085 at 03-Nov-2025 18:17:23 CET
Begin processing the 86th record. run: 1062 subRun: 1 event: 23086 at 03-Nov-2025 18:17:25 CET
Begin processing the 87th record. run: 1062 subRun: 1 event: 23087 at 03-Nov-2025 18:17:27 CET
Begin processing the 88th record. run: 1062 subRun: 1 event: 23088 at 03-Nov-2025 18:17:29 CET
Begin processing the 89th record. run: 1062 subRun: 1 event: 23089 at 03-Nov-2025 18:17:31 CET
Begin processing the 90th record. run: 1062 subRun: 1 event: 23090 at 03-Nov-2025 18:17:34 CET
Begin processing the 91st record. run: 1062 subRun: 1 event: 23091 at 03-Nov-2025 18:17:36 CET
Begin processing the 92nd record. run: 1062 subRun: 1 event: 23092 at 03-Nov-2025 18:17:39 CET
Begin processing the 93rd record. run: 1062 subRun: 1 event: 23093 at 03-Nov-2025 18:17:41 CET
Begin processing the 94th record. run: 1062 subRun: 1 event: 23094 at 03-Nov-2025 18:17:44 CET
Begin processing the 95th record. run: 1062 subRun: 1 event: 23095 at 03-Nov-2025 18:17:46 CET
Begin processing the 96th record. run: 1062 subRun: 1 event: 23096 at 03-Nov-2025 18:17:49 CET
Begin processing the 97th record. run: 1062 subRun: 1 event: 23097 at 03-Nov-2025 18:17:51 CET
Begin processing the 98th record. run: 1062 subRun: 1 event: 23098 at 03-Nov-2025 18:17:55 CET
Begin processing the 99th record. run: 1062 subRun: 1 event: 23099 at 03-Nov-2025 18:17:57 CET
Begin processing the 100th record. run: 1062 subRun: 1 event: 23100 at 03-Nov-2025 18:17:59 CET
03-Nov-2025 18:18:02 CET  Closed output file "nu_dune10kt_1x2x6_1062_230_20230823T120708Z_gen_g4_detsim_hitreco__20240229T184635Z_reco2_reco2.root"
03-Nov-2025 18:18:02 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/cc/af/nu_dune10kt_1x2x6_1062_230_20230823T120708Z_gen_g4_detsim_hitreco__20240229T184635Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.01897       2.35654       4.87899       2.23954       0.42154        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00220627     0.0194765     0.0731471     0.0187656     0.0125598       100    
reco:pandora:StandardPandora                    2.01509       2.33272       4.8299        2.21185      0.418371        100    
[art]:TriggerResults:TriggerResultInserter    1.1091e-05    1.8184e-05    5.9264e-05    1.6681e-05    6.7733e-06       100    
end_path:out1:RootOutput                       3.486e-06    4.62176e-06   1.6401e-05    4.5185e-06    1.26609e-06      100    
end_path:out1:RootOutput(write)               0.00100879    0.00411822     0.0281293    0.00342283    0.00349413       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2309.84 MB
  Peak resident set size usage (VmHWM): 1330.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2025-11-04 01:40:00 UTC       justIN version: 01.05.01