justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 28524.1@dunegpschedd01.fnal.gov

Jobsub ID28524.1@dunegpschedd01.fnal.gov
Workflow ID1580
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-08-19 12:47:56
SiteUS_UChicago
EntryEngage_US_MWT2_iut2_gk02_condce_mcore
Last heartbeat2025-08-19 12:56:43
From worker nodeHostnameuct2-c519.mwt2.org
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-19 12:49:39
Input filesfardet-hd:nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2.root
JobscriptExit code0
Real time6m (406s)
CPU time5m (355s = 87%)
Max RSS bytes1290067968 (1230 MiB)
Outputting started2025-08-19 12:56:26
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/01580/1/003/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/01580/1/003/CheatingKalmanSplittingV_nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/01580/1/003/CheatingKalmanSplittingW_nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2.root
Finished2025-08-19 12:56:43
Saved logsjustin-logs:28524.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/74/nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1431 subRun: 1 event: 85023 at 19-Aug-2025 07:52:21 CDT
Begin processing the 24th record. run: 1431 subRun: 1 event: 85024 at 19-Aug-2025 07:52:26 CDT
Begin processing the 25th record. run: 1431 subRun: 1 event: 85025 at 19-Aug-2025 07:52:29 CDT
Begin processing the 26th record. run: 1431 subRun: 1 event: 85026 at 19-Aug-2025 07:52:32 CDT
Begin processing the 27th record. run: 1431 subRun: 1 event: 85027 at 19-Aug-2025 07:52:36 CDT
Begin processing the 28th record. run: 1431 subRun: 1 event: 85028 at 19-Aug-2025 07:52:39 CDT
Begin processing the 29th record. run: 1431 subRun: 1 event: 85029 at 19-Aug-2025 07:52:41 CDT
Begin processing the 30th record. run: 1431 subRun: 1 event: 85030 at 19-Aug-2025 07:52:44 CDT
Begin processing the 31st record. run: 1431 subRun: 1 event: 85031 at 19-Aug-2025 07:52:47 CDT
Begin processing the 32nd record. run: 1431 subRun: 1 event: 85032 at 19-Aug-2025 07:52:50 CDT
Begin processing the 33rd record. run: 1431 subRun: 1 event: 85033 at 19-Aug-2025 07:52:53 CDT
Begin processing the 34th record. run: 1431 subRun: 1 event: 85034 at 19-Aug-2025 07:52:56 CDT
Begin processing the 35th record. run: 1431 subRun: 1 event: 85035 at 19-Aug-2025 07:52:59 CDT
Begin processing the 36th record. run: 1431 subRun: 1 event: 85036 at 19-Aug-2025 07:53:02 CDT
Begin processing the 37th record. run: 1431 subRun: 1 event: 85037 at 19-Aug-2025 07:53:04 CDT
Begin processing the 38th record. run: 1431 subRun: 1 event: 85038 at 19-Aug-2025 07:53:08 CDT
Begin processing the 39th record. run: 1431 subRun: 1 event: 85039 at 19-Aug-2025 07:53:11 CDT
Begin processing the 40th record. run: 1431 subRun: 1 event: 85040 at 19-Aug-2025 07:53:15 CDT
Begin processing the 41st record. run: 1431 subRun: 1 event: 85041 at 19-Aug-2025 07:53:17 CDT
Begin processing the 42nd record. run: 1431 subRun: 1 event: 85042 at 19-Aug-2025 07:53:20 CDT
Begin processing the 43rd record. run: 1431 subRun: 1 event: 85043 at 19-Aug-2025 07:53:24 CDT
Begin processing the 44th record. run: 1431 subRun: 1 event: 85044 at 19-Aug-2025 07:53:27 CDT
Begin processing the 45th record. run: 1431 subRun: 1 event: 85045 at 19-Aug-2025 07:53:30 CDT
Begin processing the 46th record. run: 1431 subRun: 1 event: 85046 at 19-Aug-2025 07:53:33 CDT
Begin processing the 47th record. run: 1431 subRun: 1 event: 85047 at 19-Aug-2025 07:53:35 CDT
Begin processing the 48th record. run: 1431 subRun: 1 event: 85048 at 19-Aug-2025 07:53:40 CDT
Begin processing the 49th record. run: 1431 subRun: 1 event: 85049 at 19-Aug-2025 07:53:43 CDT
Begin processing the 50th record. run: 1431 subRun: 1 event: 85050 at 19-Aug-2025 07:53:46 CDT
Begin processing the 51st record. run: 1431 subRun: 1 event: 85051 at 19-Aug-2025 07:53:49 CDT
Begin processing the 52nd record. run: 1431 subRun: 1 event: 85052 at 19-Aug-2025 07:53:51 CDT
Begin processing the 53rd record. run: 1431 subRun: 1 event: 85053 at 19-Aug-2025 07:53:55 CDT
Begin processing the 54th record. run: 1431 subRun: 1 event: 85054 at 19-Aug-2025 07:53:57 CDT
Begin processing the 55th record. run: 1431 subRun: 1 event: 85055 at 19-Aug-2025 07:54:01 CDT
Begin processing the 56th record. run: 1431 subRun: 1 event: 85056 at 19-Aug-2025 07:54:04 CDT
Begin processing the 57th record. run: 1431 subRun: 1 event: 85057 at 19-Aug-2025 07:54:06 CDT
Begin processing the 58th record. run: 1431 subRun: 1 event: 85058 at 19-Aug-2025 07:54:08 CDT
Begin processing the 59th record. run: 1431 subRun: 1 event: 85059 at 19-Aug-2025 07:54:14 CDT
Begin processing the 60th record. run: 1431 subRun: 1 event: 85060 at 19-Aug-2025 07:54:17 CDT
Begin processing the 61st record. run: 1431 subRun: 1 event: 85061 at 19-Aug-2025 07:54:22 CDT
Begin processing the 62nd record. run: 1431 subRun: 1 event: 85062 at 19-Aug-2025 07:54:25 CDT
Begin processing the 63rd record. run: 1431 subRun: 1 event: 85063 at 19-Aug-2025 07:54:27 CDT
Begin processing the 64th record. run: 1431 subRun: 1 event: 85064 at 19-Aug-2025 07:54:30 CDT
Begin processing the 65th record. run: 1431 subRun: 1 event: 85065 at 19-Aug-2025 07:54:33 CDT
Begin processing the 66th record. run: 1431 subRun: 1 event: 85066 at 19-Aug-2025 07:54:36 CDT
Begin processing the 67th record. run: 1431 subRun: 1 event: 85067 at 19-Aug-2025 07:54:40 CDT
Begin processing the 68th record. run: 1431 subRun: 1 event: 85068 at 19-Aug-2025 07:54:43 CDT
Begin processing the 69th record. run: 1431 subRun: 1 event: 85069 at 19-Aug-2025 07:54:45 CDT
Begin processing the 70th record. run: 1431 subRun: 1 event: 85070 at 19-Aug-2025 07:54:48 CDT
Begin processing the 71st record. run: 1431 subRun: 1 event: 85071 at 19-Aug-2025 07:54:51 CDT
Begin processing the 72nd record. run: 1431 subRun: 1 event: 85072 at 19-Aug-2025 07:54:54 CDT
Begin processing the 73rd record. run: 1431 subRun: 1 event: 85073 at 19-Aug-2025 07:54:59 CDT
Begin processing the 74th record. run: 1431 subRun: 1 event: 85074 at 19-Aug-2025 07:55:01 CDT
Begin processing the 75th record. run: 1431 subRun: 1 event: 85075 at 19-Aug-2025 07:55:04 CDT
Begin processing the 76th record. run: 1431 subRun: 1 event: 85076 at 19-Aug-2025 07:55:08 CDT
Begin processing the 77th record. run: 1431 subRun: 1 event: 85077 at 19-Aug-2025 07:55:11 CDT
Begin processing the 78th record. run: 1431 subRun: 1 event: 85078 at 19-Aug-2025 07:55:14 CDT
Begin processing the 79th record. run: 1431 subRun: 1 event: 85079 at 19-Aug-2025 07:55:17 CDT
Begin processing the 80th record. run: 1431 subRun: 1 event: 85080 at 19-Aug-2025 07:55:20 CDT
Begin processing the 81st record. run: 1431 subRun: 1 event: 85081 at 19-Aug-2025 07:55:22 CDT
Begin processing the 82nd record. run: 1431 subRun: 1 event: 85082 at 19-Aug-2025 07:55:25 CDT
Begin processing the 83rd record. run: 1431 subRun: 1 event: 85083 at 19-Aug-2025 07:55:28 CDT
Begin processing the 84th record. run: 1431 subRun: 1 event: 85084 at 19-Aug-2025 07:55:32 CDT
Begin processing the 85th record. run: 1431 subRun: 1 event: 85085 at 19-Aug-2025 07:55:34 CDT
Begin processing the 86th record. run: 1431 subRun: 1 event: 85086 at 19-Aug-2025 07:55:37 CDT
Begin processing the 87th record. run: 1431 subRun: 1 event: 85087 at 19-Aug-2025 07:55:40 CDT
Begin processing the 88th record. run: 1431 subRun: 1 event: 85088 at 19-Aug-2025 07:55:43 CDT
Begin processing the 89th record. run: 1431 subRun: 1 event: 85089 at 19-Aug-2025 07:55:45 CDT
Begin processing the 90th record. run: 1431 subRun: 1 event: 85090 at 19-Aug-2025 07:55:48 CDT
Begin processing the 91st record. run: 1431 subRun: 1 event: 85091 at 19-Aug-2025 07:55:51 CDT
Begin processing the 92nd record. run: 1431 subRun: 1 event: 85092 at 19-Aug-2025 07:55:54 CDT
Begin processing the 93rd record. run: 1431 subRun: 1 event: 85093 at 19-Aug-2025 07:55:58 CDT
Begin processing the 94th record. run: 1431 subRun: 1 event: 85094 at 19-Aug-2025 07:56:01 CDT
Begin processing the 95th record. run: 1431 subRun: 1 event: 85095 at 19-Aug-2025 07:56:04 CDT
Begin processing the 96th record. run: 1431 subRun: 1 event: 85096 at 19-Aug-2025 07:56:08 CDT
Begin processing the 97th record. run: 1431 subRun: 1 event: 85097 at 19-Aug-2025 07:56:11 CDT
Begin processing the 98th record. run: 1431 subRun: 1 event: 85098 at 19-Aug-2025 07:56:14 CDT
Begin processing the 99th record. run: 1431 subRun: 1 event: 85099 at 19-Aug-2025 07:56:18 CDT
Begin processing the 100th record. run: 1431 subRun: 1 event: 85100 at 19-Aug-2025 07:56:21 CDT
19-Aug-2025 07:56:24 CDT  Closed output file "nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2_reco2.root"
19-Aug-2025 07:56:24 CDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/74/nu_dune10kt_1x2x6_1431_850_20230828T034013Z_gen_g4_detsim_hitreco__20240222T221429Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.98093       2.87832       6.2063        2.67109      0.638931        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0069651     0.0464857      1.07776      0.0256361     0.115351        100    
reco:pandora:StandardPandora                    1.95408       2.82587       6.17153       2.63512      0.633385        100    
[art]:TriggerResults:TriggerResultInserter    1.2022e-05    2.77022e-05   0.000284057   2.28685e-05   2.93491e-05      100    
end_path:out1:RootOutput                       3.316e-06    5.68645e-06   3.0127e-05     4.293e-06    3.22999e-06      100    
end_path:out1:RootOutput(write)               0.00151849    0.00563268     0.0245823    0.00421049    0.00414316       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2275.02 MB
  Peak resident set size usage (VmHWM): 1290.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-09-19 15:13:59 UTC       justIN version: 01.05.00