justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242413.144@dunegpschedd01.fnal.gov

Jobsub ID242413.144@dunegpschedd01.fnal.gov
Workflow ID9555
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-11-03 16:39:03
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp_multicore
Last heartbeat2025-11-03 16:48:51
From worker nodeHostnamewn-sate-028.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 16:40:27
Input filesfardet-hd:nu_dune10kt_1x2x6_1410_327_20230826T123342Z_gen_g4_detsim_hitreco__20240229T185136Z_reco2.root
JobscriptExit code0
Real time8m (485s)
CPU time5m (349s = 71%)
Max RSS bytes1271033856 (1212 MiB)
Outputting started2025-11-03 16:48:33
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_0/fnal/09555/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1410_327_20230826T123342Z_gen_g4_detsim_hitreco__20240229T185136Z_reco2.root
Finished2025-11-03 16:48:51
Saved logsjustin-logs:242413.144-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

---------------
Input PFN = root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/5b/59/nu_dune10kt_1x2x6_1410_327_20230826T123342Z_gen_g4_detsim_hitreco__20240229T185136Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1410 subRun: 1 event: 32723 at 03-Nov-2025 17:43:57 CET
Begin processing the 24th record. run: 1410 subRun: 1 event: 32724 at 03-Nov-2025 17:44:00 CET
Begin processing the 25th record. run: 1410 subRun: 1 event: 32725 at 03-Nov-2025 17:44:03 CET
Begin processing the 26th record. run: 1410 subRun: 1 event: 32726 at 03-Nov-2025 17:44:07 CET
Begin processing the 27th record. run: 1410 subRun: 1 event: 32727 at 03-Nov-2025 17:44:11 CET
Begin processing the 28th record. run: 1410 subRun: 1 event: 32728 at 03-Nov-2025 17:44:14 CET
Begin processing the 29th record. run: 1410 subRun: 1 event: 32729 at 03-Nov-2025 17:44:18 CET
Begin processing the 30th record. run: 1410 subRun: 1 event: 32730 at 03-Nov-2025 17:44:21 CET
Begin processing the 31st record. run: 1410 subRun: 1 event: 32731 at 03-Nov-2025 17:44:24 CET
Begin processing the 32nd record. run: 1410 subRun: 1 event: 32732 at 03-Nov-2025 17:44:28 CET
Begin processing the 33rd record. run: 1410 subRun: 1 event: 32733 at 03-Nov-2025 17:44:31 CET
Begin processing the 34th record. run: 1410 subRun: 1 event: 32734 at 03-Nov-2025 17:44:34 CET
Begin processing the 35th record. run: 1410 subRun: 1 event: 32735 at 03-Nov-2025 17:44:38 CET
Begin processing the 36th record. run: 1410 subRun: 1 event: 32736 at 03-Nov-2025 17:44:42 CET
Begin processing the 37th record. run: 1410 subRun: 1 event: 32737 at 03-Nov-2025 17:44:45 CET
Begin processing the 38th record. run: 1410 subRun: 1 event: 32738 at 03-Nov-2025 17:44:48 CET
Begin processing the 39th record. run: 1410 subRun: 1 event: 32739 at 03-Nov-2025 17:44:51 CET
Begin processing the 40th record. run: 1410 subRun: 1 event: 32740 at 03-Nov-2025 17:44:55 CET
Begin processing the 41st record. run: 1410 subRun: 1 event: 32741 at 03-Nov-2025 17:44:59 CET
Begin processing the 42nd record. run: 1410 subRun: 1 event: 32742 at 03-Nov-2025 17:45:02 CET
Begin processing the 43rd record. run: 1410 subRun: 1 event: 32743 at 03-Nov-2025 17:45:06 CET
Begin processing the 44th record. run: 1410 subRun: 1 event: 32744 at 03-Nov-2025 17:45:09 CET
Begin processing the 45th record. run: 1410 subRun: 1 event: 32745 at 03-Nov-2025 17:45:13 CET
Begin processing the 46th record. run: 1410 subRun: 1 event: 32746 at 03-Nov-2025 17:45:16 CET
Begin processing the 47th record. run: 1410 subRun: 1 event: 32747 at 03-Nov-2025 17:45:20 CET
Begin processing the 48th record. run: 1410 subRun: 1 event: 32748 at 03-Nov-2025 17:45:23 CET
Begin processing the 49th record. run: 1410 subRun: 1 event: 32749 at 03-Nov-2025 17:45:27 CET
Begin processing the 50th record. run: 1410 subRun: 1 event: 32750 at 03-Nov-2025 17:45:30 CET
Begin processing the 51st record. run: 1410 subRun: 1 event: 32751 at 03-Nov-2025 17:45:34 CET
Begin processing the 52nd record. run: 1410 subRun: 1 event: 32752 at 03-Nov-2025 17:45:37 CET
Begin processing the 53rd record. run: 1410 subRun: 1 event: 32753 at 03-Nov-2025 17:45:41 CET
Begin processing the 54th record. run: 1410 subRun: 1 event: 32754 at 03-Nov-2025 17:45:44 CET
Begin processing the 55th record. run: 1410 subRun: 1 event: 32755 at 03-Nov-2025 17:45:47 CET
Begin processing the 56th record. run: 1410 subRun: 1 event: 32756 at 03-Nov-2025 17:45:51 CET
Begin processing the 57th record. run: 1410 subRun: 1 event: 32757 at 03-Nov-2025 17:45:54 CET
Begin processing the 58th record. run: 1410 subRun: 1 event: 32758 at 03-Nov-2025 17:45:57 CET
Begin processing the 59th record. run: 1410 subRun: 1 event: 32759 at 03-Nov-2025 17:46:01 CET
Begin processing the 60th record. run: 1410 subRun: 1 event: 32760 at 03-Nov-2025 17:46:05 CET
Begin processing the 61st record. run: 1410 subRun: 1 event: 32761 at 03-Nov-2025 17:46:08 CET
Begin processing the 62nd record. run: 1410 subRun: 1 event: 32762 at 03-Nov-2025 17:46:16 CET
Begin processing the 63rd record. run: 1410 subRun: 1 event: 32763 at 03-Nov-2025 17:46:19 CET
Begin processing the 64th record. run: 1410 subRun: 1 event: 32764 at 03-Nov-2025 17:46:22 CET
Begin processing the 65th record. run: 1410 subRun: 1 event: 32765 at 03-Nov-2025 17:46:26 CET
Begin processing the 66th record. run: 1410 subRun: 1 event: 32766 at 03-Nov-2025 17:46:29 CET
Begin processing the 67th record. run: 1410 subRun: 1 event: 32767 at 03-Nov-2025 17:46:33 CET
Begin processing the 68th record. run: 1410 subRun: 1 event: 32768 at 03-Nov-2025 17:46:36 CET
Begin processing the 69th record. run: 1410 subRun: 1 event: 32769 at 03-Nov-2025 17:46:40 CET
Begin processing the 70th record. run: 1410 subRun: 1 event: 32770 at 03-Nov-2025 17:46:44 CET
Begin processing the 71st record. run: 1410 subRun: 1 event: 32771 at 03-Nov-2025 17:46:47 CET
Begin processing the 72nd record. run: 1410 subRun: 1 event: 32772 at 03-Nov-2025 17:46:51 CET
Begin processing the 73rd record. run: 1410 subRun: 1 event: 32773 at 03-Nov-2025 17:46:54 CET
Begin processing the 74th record. run: 1410 subRun: 1 event: 32774 at 03-Nov-2025 17:46:57 CET
Begin processing the 75th record. run: 1410 subRun: 1 event: 32775 at 03-Nov-2025 17:47:00 CET
Begin processing the 76th record. run: 1410 subRun: 1 event: 32776 at 03-Nov-2025 17:47:04 CET
Begin processing the 77th record. run: 1410 subRun: 1 event: 32777 at 03-Nov-2025 17:47:07 CET
Begin processing the 78th record. run: 1410 subRun: 1 event: 32778 at 03-Nov-2025 17:47:11 CET
Begin processing the 79th record. run: 1410 subRun: 1 event: 32779 at 03-Nov-2025 17:47:14 CET
Begin processing the 80th record. run: 1410 subRun: 1 event: 32780 at 03-Nov-2025 17:47:18 CET
Begin processing the 81st record. run: 1410 subRun: 1 event: 32781 at 03-Nov-2025 17:47:21 CET
Begin processing the 82nd record. run: 1410 subRun: 1 event: 32782 at 03-Nov-2025 17:47:25 CET
Begin processing the 83rd record. run: 1410 subRun: 1 event: 32783 at 03-Nov-2025 17:47:28 CET
Begin processing the 84th record. run: 1410 subRun: 1 event: 32784 at 03-Nov-2025 17:47:32 CET
Begin processing the 85th record. run: 1410 subRun: 1 event: 32785 at 03-Nov-2025 17:47:35 CET
Begin processing the 86th record. run: 1410 subRun: 1 event: 32786 at 03-Nov-2025 17:47:39 CET
Begin processing the 87th record. run: 1410 subRun: 1 event: 32787 at 03-Nov-2025 17:47:43 CET
Begin processing the 88th record. run: 1410 subRun: 1 event: 32788 at 03-Nov-2025 17:47:47 CET
Begin processing the 89th record. run: 1410 subRun: 1 event: 32789 at 03-Nov-2025 17:47:51 CET
Begin processing the 90th record. run: 1410 subRun: 1 event: 32790 at 03-Nov-2025 17:47:54 CET
Begin processing the 91st record. run: 1410 subRun: 1 event: 32791 at 03-Nov-2025 17:47:58 CET
Begin processing the 92nd record. run: 1410 subRun: 1 event: 32792 at 03-Nov-2025 17:48:02 CET
Begin processing the 93rd record. run: 1410 subRun: 1 event: 32793 at 03-Nov-2025 17:48:05 CET
Begin processing the 94th record. run: 1410 subRun: 1 event: 32794 at 03-Nov-2025 17:48:09 CET
Begin processing the 95th record. run: 1410 subRun: 1 event: 32795 at 03-Nov-2025 17:48:12 CET
Begin processing the 96th record. run: 1410 subRun: 1 event: 32796 at 03-Nov-2025 17:48:15 CET
Begin processing the 97th record. run: 1410 subRun: 1 event: 32797 at 03-Nov-2025 17:48:18 CET
Begin processing the 98th record. run: 1410 subRun: 1 event: 32798 at 03-Nov-2025 17:48:22 CET
Begin processing the 99th record. run: 1410 subRun: 1 event: 32799 at 03-Nov-2025 17:48:25 CET
Begin processing the 100th record. run: 1410 subRun: 1 event: 32800 at 03-Nov-2025 17:48:29 CET
03-Nov-2025 17:48:32 CET  Closed output file "nu_dune10kt_1x2x6_1410_327_20230826T123342Z_gen_g4_detsim_hitreco__20240229T185136Z_reco2_reco2.root"
03-Nov-2025 17:48:32 CET  Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/5b/59/nu_dune10kt_1x2x6_1410_327_20230826T123342Z_gen_g4_detsim_hitreco__20240229T185136Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.86469       3.14076       6.81823       3.05673      0.447817        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0275529     0.0427027     0.083674      0.0408667    0.00928305       100    
reco:pandora:StandardPandora                    2.81888       3.09333       6.76228       3.00901      0.446714        100    
[art]:TriggerResults:TriggerResultInserter    1.3305e-05    1.86652e-05   5.7107e-05    1.8129e-05    5.11155e-06      100    
end_path:out1:RootOutput                       2.905e-06     3.753e-06     1.602e-05     3.587e-06    1.30501e-06      100    
end_path:out1:RootOutput(write)               0.00103173     0.0045152     0.0183375    0.00436778    0.00282133       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2249.88 MB
  Peak resident set size usage (VmHWM): 1271.03 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2025-11-05 07:24:44 UTC       justIN version: 01.05.01