justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266856.0@dunegpschedd01.fnal.gov

Jobsub ID266856.0@dunegpschedd01.fnal.gov
Workflow ID11110
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 15:56:17
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 03:48:57
From worker nodeHostnamedunegli-8029139-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 15:57:43
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T023929Z_gen_004144_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (42658s)
CPU time11h (42164s = 98%)
Max RSS bytes2918961152 (2783 MiB)
Outputting started2025-12-12 03:48:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11110/1/001/analysisLowE_20251211T155745Z.root
Finished2025-12-12 03:48:57
Saved logsjustin-logs:266856.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.118453, 
Output 1: 0.0943631, 0.13862, 0.153467, 0.61355, 
Output 2: 0.0504807, 0.17383, 0.755948, 0.0197421, 
Output 3: 0.974555, 0.0182515, 0.00201291, 0.00518104, 
Output 4: 0.602807, 0.352201, 0.0389684, 0.00602316, 
Output 5: 0.333288, 0.506599, 0.132014, 0.0280989, 
Output 6: 0.0425706, 0.103196, 0.0975546, 0.756679, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 41440 at 12-Dec-2025 03:12:59 UTC
Boundary wire vector sizes: 7010, 6894, 6823
minwire 0: 6
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.126583, 
Output 1: 0.0725429, 0.0730533, 0.200734, 0.65367, 
Output 2: 0.014822, 0.084205, 0.891605, 0.0093684, 
Output 3: 0.952083, 0.0360499, 0.00584268, 0.00602456, 
Output 4: 0.368716, 0.468237, 0.137818, 0.025228, 
Output 5: 0.156145, 0.374817, 0.379784, 0.0892536, 
Output 6: 0.0570058, 0.130917, 0.113501, 0.698576, 

12-Dec-2025 03:47:57 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:47:57 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a6/a5/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T023929Z_gen_004144_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2094.8        4223.81       5227.29       4550.74        970.8         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00759909     0.0174101     0.0328272     0.0162073    0.00753646       10     
reco:pandora:StandardPandora                            2093.41       4220.93       5223.97       4548.31       969.829        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0021288     0.0659806     0.295411      0.0235091     0.0867145       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00101668     0.0103913     0.0638135    0.00356533     0.0182535       10     
reco:pandoracalo:Calorimetry                          0.000315783    0.0382719     0.0856741     0.0273386     0.0362801       10     
reco:pandorapid:Chi2ParticleID                        6.0441e-05    0.000444393   0.00214171    0.000150476   0.000631277      10     
reco:cvnmap:CVNMapper                                  0.0378408     0.0848648     0.195273      0.0744095     0.0422534       10     
reco:cvneva:CVNEvaluator                               0.834284       2.08379       6.59121       1.61444       1.61084        10     
reco:energyrecnumu:EnergyReco                         0.00851856     0.0764794     0.148358      0.0830048     0.0510995       10     
reco:energyrecnue:EnergyReco                          0.000901538   0.00934819     0.0172027    0.00806204    0.00518217       10     
reco:energyrecnc:EnergyReco                           0.00741485     0.0573476     0.165999      0.016908      0.0596556       10     
[art]:TriggerResults:TriggerResultInserter             1.544e-05    0.00010792    0.000349054   4.8221e-05    0.000116045      10     
end_path:out1:RootOutput                               9.35e-06     4.58215e-05   0.000149201    2.554e-05    4.76474e-05      10     
end_path:out1:RootOutput(write)                        0.294362      0.432833      0.555388      0.438108      0.0997378       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21684.6 MB
  Peak resident set size usage (VmHWM): 2918.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Completed MCParticle Loop
True Neutrino Energy: 65.4151
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 41438 at 12-Dec-2025 03:48:33 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 9.99748
Completed MCParticle Loop
True Neutrino Energy: 15.3758
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 41439 at 12-Dec-2025 03:48:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  48
Added hit list length: 48 | Max was set to: -3.40282e+38
True Neutron Energy: 940.714
True Electron Energy: 31.4557
Completed MCParticle Loop
True Neutrino Energy: 48.0163
 Size of all hits: 48
hit initial : 71.1313 | hit correction : 1.18098
hit initial : 175.918 | hit correction : 1.18027
hit initial : 170.167 | hit correction : 1.18008
hit initial : 301.721 | hit correction : 1.17993
hit initial : 103.947 | hit correction : 1.18382
hit initial : 98.6461 | hit correction : 1.17984
hit initial : 231.737 | hit correction : 1.18383
hit initial : 102.049 | hit correction : 1.18034
hit initial : 406.6 | hit correction : 1.18111
hit initial : 369.877 | hit correction : 1.18144
hit initial : 444.497 | hit correction : 1.18207
hit initial : 372.928 | hit correction : 1.1829
hit initial : 361.025 | hit correction : 1.18379
 *** Total Charge : 3793.85
 Looking at view: 0 | Number of hits in view: 13
hit initial : 103.49 | hit correction : 1.18005
hit initial : 314.432 | hit correction : 1.17997
hit initial : 211.913 | hit correction : 1.17994
hit initial : 42.3009 | hit correction : 1.18024
hit initial : 141.534 | hit correction : 1.18033
hit initial : 209.326 | hit correction : 1.18058
hit initial : 216.708 | hit correction : 1.18091
hit initial : 218.455 | hit correction : 1.18116
hit initial : 202.986 | hit correction : 1.18132
hit initial : 210.704 | hit correction : 1.18152
hit initial : 235.407 | hit correction : 1.18183
hit initial : 236.378 | hit correction : 1.18213
hit initial : 221.731 | hit correction : 1.18257
hit initial : 236.026 | hit correction : 1.18308
hit initial : 228.677 | hit correction : 1.18358
hit initial : 215.837 | hit correction : 1.18382
hit initial : 243.615 | hit correction : 1.18386
hit initial : 114.059 | hit correction : 1.18385
 *** Total Charge : 4258.68
 Looking at view: 1 | Number of hits in view: 18
hit initial : 13.7553 | hit correction : 1.18402
hit initial : 12.9412 | hit correction : 1.18035
hit initial : 149.554 | hit correction : 1.1802
hit initial : 356.433 | hit correction : 1.17993
hit initial : 145.208 | hit correction : 1.17978
hit initial : 157.78 | hit correction : 1.18024
hit initial : 197.983 | hit correction : 1.18055
hit initial : 206.818 | hit correction : 1.18087
hit initial : 183.111 | hit correction : 1.18111
hit initial : 206.289 | hit correction : 1.18127
hit initial : 190.543 | hit correction : 1.18143
hit initial : 192.023 | hit correction : 1.18167
hit initial : 387.787 | hit correction : 1.1821
hit initial : 323.821 | hit correction : 1.18275
hit initial : 289.255 | hit correction : 1.18342
hit initial : 309.101 | hit correction : 1.18379
hit initial : 315.26 | hit correction : 1.18388
 *** Total Charge : 4298.95
 Looking at view: 2 | Number of hits in view: 17
Begin processing the 10th record. run: 5027 subRun: 0 event: 41440 at 12-Dec-2025 03:48:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.569
True Electron Energy: 41.7413
Completed MCParticle Loop
True Neutrino Energy: 47.1754
 Size of all hits: 0
12-Dec-2025 03:48:41 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0660319     0.0815517     0.0952434     0.0834367     0.0115247       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000363153   0.000587717   0.00130673    0.00052813    0.000251774      10     
end_path:ana:AnalyzeEvents         0.0655093     0.0807623     0.0947163     0.0821648     0.0114588       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.5 MB
  Peak resident set size usage (VmHWM): 1528.05 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:41 UTC       justIN version: 01.06.00