Jobsub ID 42003.2@dunegpschedd01.fnal.gov

Jobsub ID	42003.2@dunegpschedd01.fnal.gov
Workflow ID	2246
Stage ID	1
User name	osbiston@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-07 00:43:20
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-09-07 05:11:29
From worker node	Hostname	dunegli-6756886-0-fnpc22024.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-07 00:44:36
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T055905Z_gen_000980_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (15996s)
	CPU time	4h (15820s = 98%)
	Max RSS bytes	3049037824 (2907 MiB)
Outputting started	2025-09-07 05:11:12
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/02246/1/001/mydetsimreco1reco2_20250907T004451Z.root
Finished	2025-09-07 05:11:29
Saved logs	justin-logs:42003.2-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

t"
07-Sep-2025 02:27:50 UTC  Opened input file "matt_detsim.root"
Begin processing the 1st record. run: 4883 subRun: 0 event: 9791 at 07-Sep-2025 02:27:50 UTC
07-Sep-2025 02:27:54 UTC  Opened output file with pattern "matt_reco1.root"
Begin processing the 2nd record. run: 4883 subRun: 0 event: 9792 at 07-Sep-2025 02:28:09 UTC
Begin processing the 3rd record. run: 4883 subRun: 0 event: 9793 at 07-Sep-2025 02:28:13 UTC
Begin processing the 4th record. run: 4883 subRun: 0 event: 9794 at 07-Sep-2025 02:28:17 UTC
Begin processing the 5th record. run: 4883 subRun: 0 event: 9795 at 07-Sep-2025 02:28:21 UTC
Begin processing the 6th record. run: 4883 subRun: 0 event: 9796 at 07-Sep-2025 02:28:24 UTC
Begin processing the 7th record. run: 4883 subRun: 0 event: 9797 at 07-Sep-2025 02:28:29 UTC
Begin processing the 8th record. run: 4883 subRun: 0 event: 9798 at 07-Sep-2025 02:28:32 UTC
Begin processing the 9th record. run: 4883 subRun: 0 event: 9799 at 07-Sep-2025 02:28:36 UTC
Begin processing the 10th record. run: 4883 subRun: 0 event: 9800 at 07-Sep-2025 02:28:40 UTC
07-Sep-2025 02:28:45 UTC  Closed output file "matt_reco1.root"
07-Sep-2025 02:28:45 UTC  Closed input file "matt_detsim.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.76597       1.81507       1.97178       1.79597      0.0561184       10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000388776   0.00059978    0.000970795   0.000462289   0.000216173      10     
reco:gaushit:GausHitFinder                     0.199529      0.207509      0.214412      0.206765     0.00448939       10     
reco:ophit10ppm:OpHitFinder                     1.48168       1.51981       1.66845       1.49973      0.0526265       10     
[art]:TriggerResults:TriggerResultInserter    1.6802e-05    2.21239e-05   4.9183e-05    1.81545e-05   9.38526e-06      10     
end_path:out1:RootOutput                       3.748e-06    9.1956e-06    4.8281e-05    4.9745e-06    1.30394e-05      10     
end_path:out1:RootOutput(write)                0.0836909     0.0868385     0.0897731     0.0866379    0.00176781       10     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 20209.5 MB
  Peak resident set size usage (VmHWM): 2217.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1927, 2426
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.139107, 
Output 1: 0.0771146, 0.0978558, 0.174263, 0.650766, 
Output 2: 0.0323203, 0.117752, 0.834876, 0.0150524, 
Output 3: 0.973229, 0.0216736, 0.00195397, 0.0031436, 
Output 4: 0.509189, 0.422146, 0.0593774, 0.00928669, 
Output 5: 0.186501, 0.446346, 0.292179, 0.0749744, 
Output 6: 0.0423545, 0.120003, 0.110561, 0.727081, 

Begin processing the 8th record. run: 4883 subRun: 0 event: 9798 at 07-Sep-2025 04:23:40 UTC
Boundary wire vector sizes: 6769, 6690, 6552
minwire 0: 33
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1498, 1997
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0799778, 
Output 1: 0.0451117, 0.0642743, 0.127442, 0.763172, 
Output 2: 0.0274413, 0.16477, 0.792442, 0.0153469, 
Output 3: 0.92297, 0.0578679, 0.00970062, 0.00946195, 
Output 4: 0.316444, 0.525248, 0.140882, 0.0174264, 
Output 5: 0.533326, 0.336226, 0.108468, 0.0219806, 
Output 6: 0.0297337, 0.086828, 0.0928751, 0.790563, 

Begin processing the 9th record. run: 4883 subRun: 0 event: 9799 at 07-Sep-2025 04:39:00 UTC
Boundary wire vector sizes: 6607, 6573, 6519
minwire 0: 78
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 703, 1202
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.139367, 
Output 1: 0.181167, 0.0808896, 0.250833, 0.48711, 
Output 2: 0.0394201, 0.0904315, 0.852494, 0.0176543, 
Output 3: 0.962658, 0.0304227, 0.00289924, 0.00402056, 
Output 4: 0.485607, 0.4579, 0.0485655, 0.00792701, 
Output 5: 0.179022, 0.379406, 0.315679, 0.125893, 
Output 6: 0.136741, 0.223596, 0.131418, 0.508245, 

Begin processing the 10th record. run: 4883 subRun: 0 event: 9800 at 07-Sep-2025 04:55:01 UTC
Boundary wire vector sizes: 6562, 6535, 6428
minwire 0: 10
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1378, 1877
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.10784, 
Output 1: 0.0617568, 0.0624697, 0.166885, 0.708888, 
Output 2: 0.0765835, 0.181691, 0.710903, 0.0308227, 
Output 3: 0.973762, 0.013379, 0.00253619, 0.0103231, 
Output 4: 0.34132, 0.602447, 0.0513738, 0.00485942, 
Output 5: 0.666305, 0.289347, 0.0353388, 0.00900908, 
Output 6: 0.0178663, 0.0464801, 0.0559369, 0.879717, 

07-Sep-2025 05:11:11 UTC  Closed output file "mydetsimreco1reco2_20250907T004451Z.root"
07-Sep-2025 05:11:11 UTC  Closed input file "matt_reco1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              865.46        968.456       1040.06       970.258       49.5765        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000572602   0.00713113     0.0128484    0.00708662     0.003902        10     
reco:pandora:StandardPandora                            862.266       967.126       1038.91       969.172       50.006         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00172609     0.044058      0.148629      0.0360261     0.0462333       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000839968   0.00477214     0.0184937    0.00319467    0.00493253       10     
reco:pandoracalo:Calorimetry                          0.00024836     0.0140909     0.0640451    0.000496759    0.0231139       10     
reco:pandorapid:Chi2ParticleID                        6.2699e-05    0.000228068   0.00150252    8.6619e-05    0.000425299      10     
reco:cvnmap:CVNMapper                                  0.029936      0.0387378     0.0538808     0.0362298    0.00654685       10     
reco:cvneva:CVNEvaluator                               0.739734      0.955408       2.6595       0.769261      0.568175        10     
reco:energyrecnumu:EnergyReco                         0.00366601     0.0286642     0.0370584     0.0342431     0.0123295       10     
reco:energyrecnue:EnergyReco                          0.00092543    0.00307988    0.00600323     0.0015536    0.00221635       10     
reco:energyrecnc:EnergyReco                           0.00532248      0.01576      0.048146     0.00582103     0.015731        10     
[art]:TriggerResults:TriggerResultInserter            1.3035e-05    2.51886e-05   0.000104247   1.6656e-05    2.6416e-05       10     
end_path:out1:RootOutput                               8.226e-06    1.30538e-05   3.9826e-05    1.0139e-05    8.96479e-06      10     
end_path:out1:RootOutput(write)                        0.210052      0.217272      0.236488      0.215575     0.00766114       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21761.9 MB
  Peak resident set size usage (VmHWM): 3049.04 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0