justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242413.35@dunegpschedd01.fnal.gov

Jobsub ID242413.35@dunegpschedd01.fnal.gov
Workflow ID9555
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-11-03 16:39:03
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-11-03 16:46:47
From worker nodeHostnamehnode75.pic.es
cpuinfoAMD EPYC 7443P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 16:39:49
Input filesfardet-hd:nu_dune10kt_1x2x6_1412_867_20230826T153537Z_gen_g4_detsim_hitreco__20240227T211922Z_reco2.root
JobscriptExit code0
Real time6m (395s)
CPU time4m (243s = 61%)
Max RSS bytes1273278464 (1214 MiB)
Outputting started2025-11-03 16:46:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_0/fnal/09555/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1412_867_20230826T153537Z_gen_g4_detsim_hitreco__20240227T211922Z_reco2.root
Finished2025-11-03 16:46:47
Saved logsjustin-logs:242413.35-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/fardet-hd/90/81/nu_dune10kt_1x2x6_1412_867_20230826T153537Z_gen_g4_detsim_hitreco__20240227T211922Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1412 subRun: 1 event: 86723 at 03-Nov-2025 17:41:39 CET
Begin processing the 24th record. run: 1412 subRun: 1 event: 86724 at 03-Nov-2025 17:43:43 CET
Begin processing the 25th record. run: 1412 subRun: 1 event: 86725 at 03-Nov-2025 17:43:45 CET
Begin processing the 26th record. run: 1412 subRun: 1 event: 86726 at 03-Nov-2025 17:43:46 CET
Begin processing the 27th record. run: 1412 subRun: 1 event: 86727 at 03-Nov-2025 17:43:48 CET
Begin processing the 28th record. run: 1412 subRun: 1 event: 86728 at 03-Nov-2025 17:43:50 CET
Begin processing the 29th record. run: 1412 subRun: 1 event: 86729 at 03-Nov-2025 17:43:52 CET
Begin processing the 30th record. run: 1412 subRun: 1 event: 86730 at 03-Nov-2025 17:43:53 CET
Begin processing the 31st record. run: 1412 subRun: 1 event: 86731 at 03-Nov-2025 17:43:55 CET
Begin processing the 32nd record. run: 1412 subRun: 1 event: 86732 at 03-Nov-2025 17:43:57 CET
Begin processing the 33rd record. run: 1412 subRun: 1 event: 86733 at 03-Nov-2025 17:43:59 CET
Begin processing the 34th record. run: 1412 subRun: 1 event: 86734 at 03-Nov-2025 17:44:01 CET
Begin processing the 35th record. run: 1412 subRun: 1 event: 86735 at 03-Nov-2025 17:44:04 CET
Begin processing the 36th record. run: 1412 subRun: 1 event: 86736 at 03-Nov-2025 17:44:06 CET
Begin processing the 37th record. run: 1412 subRun: 1 event: 86737 at 03-Nov-2025 17:44:08 CET
Begin processing the 38th record. run: 1412 subRun: 1 event: 86738 at 03-Nov-2025 17:44:10 CET
Begin processing the 39th record. run: 1412 subRun: 1 event: 86739 at 03-Nov-2025 17:44:12 CET
Begin processing the 40th record. run: 1412 subRun: 1 event: 86740 at 03-Nov-2025 17:44:14 CET
Begin processing the 41st record. run: 1412 subRun: 1 event: 86741 at 03-Nov-2025 17:44:16 CET
Begin processing the 42nd record. run: 1412 subRun: 1 event: 86742 at 03-Nov-2025 17:44:17 CET
Begin processing the 43rd record. run: 1412 subRun: 1 event: 86743 at 03-Nov-2025 17:44:19 CET
Begin processing the 44th record. run: 1412 subRun: 1 event: 86744 at 03-Nov-2025 17:44:21 CET
Begin processing the 45th record. run: 1412 subRun: 1 event: 86745 at 03-Nov-2025 17:44:24 CET
Begin processing the 46th record. run: 1412 subRun: 1 event: 86746 at 03-Nov-2025 17:44:26 CET
Begin processing the 47th record. run: 1412 subRun: 1 event: 86747 at 03-Nov-2025 17:44:28 CET
Begin processing the 48th record. run: 1412 subRun: 1 event: 86748 at 03-Nov-2025 17:44:30 CET
Begin processing the 49th record. run: 1412 subRun: 1 event: 86749 at 03-Nov-2025 17:44:32 CET
Begin processing the 50th record. run: 1412 subRun: 1 event: 86750 at 03-Nov-2025 17:44:34 CET
Begin processing the 51st record. run: 1412 subRun: 1 event: 86751 at 03-Nov-2025 17:44:40 CET
Begin processing the 52nd record. run: 1412 subRun: 1 event: 86752 at 03-Nov-2025 17:44:42 CET
Begin processing the 53rd record. run: 1412 subRun: 1 event: 86753 at 03-Nov-2025 17:44:44 CET
Begin processing the 54th record. run: 1412 subRun: 1 event: 86754 at 03-Nov-2025 17:44:46 CET
Begin processing the 55th record. run: 1412 subRun: 1 event: 86755 at 03-Nov-2025 17:44:49 CET
Begin processing the 56th record. run: 1412 subRun: 1 event: 86756 at 03-Nov-2025 17:44:51 CET
Begin processing the 57th record. run: 1412 subRun: 1 event: 86757 at 03-Nov-2025 17:44:53 CET
Begin processing the 58th record. run: 1412 subRun: 1 event: 86758 at 03-Nov-2025 17:44:55 CET
Begin processing the 59th record. run: 1412 subRun: 1 event: 86759 at 03-Nov-2025 17:44:57 CET
Begin processing the 60th record. run: 1412 subRun: 1 event: 86760 at 03-Nov-2025 17:44:59 CET
Begin processing the 61st record. run: 1412 subRun: 1 event: 86761 at 03-Nov-2025 17:45:01 CET
Begin processing the 62nd record. run: 1412 subRun: 1 event: 86762 at 03-Nov-2025 17:45:04 CET
Begin processing the 63rd record. run: 1412 subRun: 1 event: 86763 at 03-Nov-2025 17:45:05 CET
Begin processing the 64th record. run: 1412 subRun: 1 event: 86764 at 03-Nov-2025 17:45:08 CET
Begin processing the 65th record. run: 1412 subRun: 1 event: 86765 at 03-Nov-2025 17:45:10 CET
Begin processing the 66th record. run: 1412 subRun: 1 event: 86766 at 03-Nov-2025 17:45:12 CET
Begin processing the 67th record. run: 1412 subRun: 1 event: 86767 at 03-Nov-2025 17:45:14 CET
Begin processing the 68th record. run: 1412 subRun: 1 event: 86768 at 03-Nov-2025 17:45:15 CET
Begin processing the 69th record. run: 1412 subRun: 1 event: 86769 at 03-Nov-2025 17:45:17 CET
Begin processing the 70th record. run: 1412 subRun: 1 event: 86770 at 03-Nov-2025 17:45:19 CET
Begin processing the 71st record. run: 1412 subRun: 1 event: 86771 at 03-Nov-2025 17:45:21 CET
Begin processing the 72nd record. run: 1412 subRun: 1 event: 86772 at 03-Nov-2025 17:45:23 CET
Begin processing the 73rd record. run: 1412 subRun: 1 event: 86773 at 03-Nov-2025 17:45:26 CET
Begin processing the 74th record. run: 1412 subRun: 1 event: 86774 at 03-Nov-2025 17:45:28 CET
Begin processing the 75th record. run: 1412 subRun: 1 event: 86775 at 03-Nov-2025 17:45:30 CET
Begin processing the 76th record. run: 1412 subRun: 1 event: 86776 at 03-Nov-2025 17:45:32 CET
Begin processing the 77th record. run: 1412 subRun: 1 event: 86777 at 03-Nov-2025 17:45:34 CET
Begin processing the 78th record. run: 1412 subRun: 1 event: 86778 at 03-Nov-2025 17:45:36 CET
Begin processing the 79th record. run: 1412 subRun: 1 event: 86779 at 03-Nov-2025 17:45:38 CET
Begin processing the 80th record. run: 1412 subRun: 1 event: 86780 at 03-Nov-2025 17:45:41 CET
Begin processing the 81st record. run: 1412 subRun: 1 event: 86781 at 03-Nov-2025 17:45:43 CET
Begin processing the 82nd record. run: 1412 subRun: 1 event: 86782 at 03-Nov-2025 17:45:45 CET
Begin processing the 83rd record. run: 1412 subRun: 1 event: 86783 at 03-Nov-2025 17:45:47 CET
Begin processing the 84th record. run: 1412 subRun: 1 event: 86784 at 03-Nov-2025 17:45:49 CET
Begin processing the 85th record. run: 1412 subRun: 1 event: 86785 at 03-Nov-2025 17:45:51 CET
Begin processing the 86th record. run: 1412 subRun: 1 event: 86786 at 03-Nov-2025 17:45:53 CET
Begin processing the 87th record. run: 1412 subRun: 1 event: 86787 at 03-Nov-2025 17:45:55 CET
Begin processing the 88th record. run: 1412 subRun: 1 event: 86788 at 03-Nov-2025 17:45:58 CET
Begin processing the 89th record. run: 1412 subRun: 1 event: 86789 at 03-Nov-2025 17:46:00 CET
Begin processing the 90th record. run: 1412 subRun: 1 event: 86790 at 03-Nov-2025 17:46:02 CET
Begin processing the 91st record. run: 1412 subRun: 1 event: 86791 at 03-Nov-2025 17:46:04 CET
Begin processing the 92nd record. run: 1412 subRun: 1 event: 86792 at 03-Nov-2025 17:46:06 CET
Begin processing the 93rd record. run: 1412 subRun: 1 event: 86793 at 03-Nov-2025 17:46:08 CET
Begin processing the 94th record. run: 1412 subRun: 1 event: 86794 at 03-Nov-2025 17:46:09 CET
Begin processing the 95th record. run: 1412 subRun: 1 event: 86795 at 03-Nov-2025 17:46:11 CET
Begin processing the 96th record. run: 1412 subRun: 1 event: 86796 at 03-Nov-2025 17:46:12 CET
Begin processing the 97th record. run: 1412 subRun: 1 event: 86797 at 03-Nov-2025 17:46:16 CET
Begin processing the 98th record. run: 1412 subRun: 1 event: 86798 at 03-Nov-2025 17:46:18 CET
Begin processing the 99th record. run: 1412 subRun: 1 event: 86799 at 03-Nov-2025 17:46:20 CET
Begin processing the 100th record. run: 1412 subRun: 1 event: 86800 at 03-Nov-2025 17:46:22 CET
03-Nov-2025 17:46:24 CET  Closed output file "nu_dune10kt_1x2x6_1412_867_20230826T153537Z_gen_g4_detsim_hitreco__20240227T211922Z_reco2_reco2.root"
03-Nov-2025 17:46:24 CET  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/fardet-hd/90/81/nu_dune10kt_1x2x6_1412_867_20230826T153537Z_gen_g4_detsim_hitreco__20240227T211922Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.39306       3.39464       123.027       2.01631       12.0871        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000802366    0.0032898     0.0307189    0.00130845    0.00500622       100    
reco:pandora:StandardPandora                    1.39053       3.38802       123.016       2.0066        12.0865        100    
[art]:TriggerResults:TriggerResultInserter     9.31e-06     1.42972e-05   4.3961e-05    1.32755e-05   4.76754e-06      100    
end_path:out1:RootOutput                       2.18e-06     2.92581e-06   1.2131e-05      2.8e-06     9.78166e-07      100    
end_path:out1:RootOutput(write)               0.000844746   0.00316946     0.0124236    0.00257719    0.00203411       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2261 MB
  Peak resident set size usage (VmHWM): 1273.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2025-11-05 09:13:21 UTC       justIN version: 01.05.01