justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266896.0@dunegpschedd01.fnal.gov

Jobsub ID266896.0@dunegpschedd01.fnal.gov
Workflow ID11110
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 16:38:19
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 03:52:20
From worker nodeHostnamedunegli-8029107-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 16:39:56
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T212918Z_gen_004037_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (40329s)
CPU time11h (39940s = 99%)
Max RSS bytes2739752960 (2612 MiB)
Outputting started2025-12-12 03:52:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11110/1/001/analysisLowE_20251211T163958Z.root
Finished2025-12-12 03:52:20
Saved logsjustin-logs:266896.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ermination failure: 0, 499
Classifier summary: 
Output 0: 0.102923, 
Output 1: 0.0281091, 0.0631569, 0.101557, 0.807177, 
Output 2: 0.119403, 0.320062, 0.482129, 0.078407, 
Output 3: 0.961387, 0.021772, 0.0045623, 0.0122788, 
Output 4: 0.353445, 0.603599, 0.0407674, 0.00218836, 
Output 5: 0.828935, 0.146142, 0.0190681, 0.0058552, 
Output 6: 0.0108861, 0.0361889, 0.05289, 0.900035, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 40370 at 12-Dec-2025 03:21:47 UTC
Boundary wire vector sizes: 7280, 7147, 6892
minwire 0: 31
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.113626, 
Output 1: 0.0376648, 0.0509773, 0.137548, 0.77381, 
Output 2: 0.110852, 0.30826, 0.531844, 0.0490446, 
Output 3: 0.948179, 0.0388385, 0.00525319, 0.00772894, 
Output 4: 0.247969, 0.683365, 0.0650184, 0.00364692, 
Output 5: 0.785187, 0.196114, 0.0157337, 0.00296568, 
Output 6: 0.00678148, 0.0309734, 0.0509926, 0.911252, 

12-Dec-2025 03:51:25 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:51:25 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/52/66/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T212918Z_gen_004037_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1775.25       3996.8        5387.09       4554.95       1138.12        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0038933     0.0155061     0.0336491     0.0147476    0.00996015       10     
reco:pandora:StandardPandora                            1773.98       3993.88       5384.06       4548.66       1137.15        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000446154    0.0515073     0.308495      0.0052858     0.0912714       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000349693   0.00660216     0.0272812    0.00278873     0.0090912       10     
reco:pandoracalo:Calorimetry                          0.000251913    0.0104209     0.0346358    0.00348286     0.0125952       10     
reco:pandorapid:Chi2ParticleID                         7.109e-05    0.000771403   0.00509945    0.000250002   0.00146223       10     
reco:cvnmap:CVNMapper                                  0.0365014     0.0900699     0.141025      0.0904405     0.0335183       10     
reco:cvneva:CVNEvaluator                               0.810207       2.2042        8.31284       1.60064       2.10042        10     
reco:energyrecnumu:EnergyReco                         0.00677755     0.0751112     0.145962      0.0803678     0.0457669       10     
reco:energyrecnue:EnergyReco                          0.000917468   0.00700689     0.0129961    0.00791256    0.00308851       10     
reco:energyrecnc:EnergyReco                           0.00692705     0.0590284     0.186927      0.0175546     0.0628731       10     
[art]:TriggerResults:TriggerResultInserter             1.795e-05    8.39198e-05   0.000311773   6.2081e-05    8.25932e-05      10     
end_path:out1:RootOutput                               7.32e-06     3.03555e-05   9.6181e-05    2.24755e-05   2.56901e-05      10     
end_path:out1:RootOutput(write)                        0.271026      0.399668      0.526139      0.414191      0.0962802       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21687.4 MB
  Peak resident set size usage (VmHWM): 2739.75 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 49.3352 | hit correction : 1.41458
hit initial : 384.249 | hit correction : 1.41205
hit initial : 369.202 | hit correction : 1.41163
 *** Total Charge : 3134.32
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 7th record. run: 5026 subRun: 0 event: 40367 at 12-Dec-2025 03:51:54 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 0.597642
Completed MCParticle Loop
True Neutrino Energy: 5.97522
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 40368 at 12-Dec-2025 03:51:57 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 42.736
Completed MCParticle Loop
True Neutrino Energy: 48.1145
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 40369 at 12-Dec-2025 03:51:59 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  39
Added hit list length: 39 | Max was set to: -3.40282e+38
This pfp has size:  9
True Electron Energy: 40.8242
Completed MCParticle Loop
True Neutrino Energy: 46.2286
 Size of all hits: 39
hit initial : 37.8873 | hit correction : 1.43031
hit initial : 30.4565 | hit correction : 1.4351
hit initial : 25.8005 | hit correction : 1.43033
hit initial : 114.699 | hit correction : 1.43627
hit initial : 27.824 | hit correction : 1.43021
hit initial : 138.101 | hit correction : 1.43626
hit initial : 38.9512 | hit correction : 1.43627
hit initial : 103.347 | hit correction : 1.43509
hit initial : 186.565 | hit correction : 1.43476
hit initial : 236.45 | hit correction : 1.43414
hit initial : 239.681 | hit correction : 1.43363
hit initial : 276.835 | hit correction : 1.43306
 *** Total Charge : 2089.05
 Looking at view: 0 | Number of hits in view: 12
hit initial : 67.0538 | hit correction : 1.43508
hit initial : 39.4781 | hit correction : 1.43627
hit initial : 168.447 | hit correction : 1.42961
hit initial : 22.9305 | hit correction : 1.42939
hit initial : 28.0993 | hit correction : 1.43033
hit initial : 87.5755 | hit correction : 1.43627
hit initial : 120.694 | hit correction : 1.43626
hit initial : 197.611 | hit correction : 1.43476
hit initial : 320.117 | hit correction : 1.43404
hit initial : 354.812 | hit correction : 1.43338
hit initial : 129.002 | hit correction : 1.43331
hit initial : 11.116 | hit correction : 1.43257
hit initial : 316.362 | hit correction : 1.4322
hit initial : 320.919 | hit correction : 1.43124
hit initial : 309.921 | hit correction : 1.43015
 *** Total Charge : 3573.47
 Looking at view: 1 | Number of hits in view: 15
hit initial : 115.422 | hit correction : 1.43629
hit initial : 109.303 | hit correction : 1.43625
hit initial : 35.1762 | hit correction : 1.43623
hit initial : 36.9196 | hit correction : 1.43626
hit initial : 58.8478 | hit correction : 1.4351
hit initial : 153.11 | hit correction : 1.43491
hit initial : 438.383 | hit correction : 1.43409
hit initial : 305.979 | hit correction : 1.43337
hit initial : 124.61 | hit correction : 1.43238
hit initial : 151.124 | hit correction : 1.4316
hit initial : 273.396 | hit correction : 1.43148
hit initial : 29.1156 | hit correction : 1.43049
 *** Total Charge : 2625.58
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 10th record. run: 5026 subRun: 0 event: 40370 at 12-Dec-2025 03:52:02 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.568
True Electron Energy: 29.5771
Completed MCParticle Loop
True Neutrino Energy: 34.9669
 Size of all hits: 0
12-Dec-2025 03:52:05 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0640953     0.0754674     0.0945792     0.0760237     0.0100247       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000348703   0.000543848   0.00111694    0.000472394   0.000229505      10     
end_path:ana:AnalyzeEvents         0.0634044     0.0747646     0.0930403     0.0755128    0.00985747       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.8 MB
  Peak resident set size usage (VmHWM): 1537.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:10 UTC       justIN version: 01.06.00