justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249036.9@dunegpschedd02.fnal.gov

Jobsub ID249036.9@dunegpschedd02.fnal.gov
Workflow ID10433
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-20 23:35:48
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-21 09:49:15
From worker nodeHostnamedunegli-7833720-0-fnpc22019.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-21 05:02:22
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193456Z_gen_000443_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17200s)
CPU time4h (17087s = 99%)
Max RSS bytes2725900288 (2599 MiB)
Outputting started2025-11-21 09:49:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10433/1/001/analysisLowE_20251121T050223Z.root
Finished2025-11-21 09:49:15
Saved logsjustin-logs:249036.9-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.0631301, 0.075591, 0.831019, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 4430 at 21-Nov-2025 09:38:23 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  21-Nov-2025 09:48:36 UTC run: 3799 subRun: 0 event: 4430
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6720, 6632, 6687
minwire 0: 39
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1724, 2223
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.126809, 
Output 1: 0.0817543, 0.0561535, 0.151738, 0.710354, 
Output 2: 0.047369, 0.222216, 0.698158, 0.0322568, 
Output 3: 0.956513, 0.0238036, 0.00642623, 0.0132574, 
Output 4: 0.325484, 0.577403, 0.0888769, 0.0082358, 
Output 5: 0.582241, 0.326576, 0.0751741, 0.0160096, 
Output 6: 0.0225282, 0.0656344, 0.0788709, 0.832967, 

21-Nov-2025 09:48:38 UTC  Closed output file "matt_reco2.root"
21-Nov-2025 09:48:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f2/be/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193456Z_gen_000443_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              612.446       1702.34       3305.36       1681.2        775.95         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00351141     0.0111394     0.0289172     0.0106541    0.00747829       10     
reco:pandora:StandardPandora                            611.476       1700.48       3297.57       1679.85       774.509        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00151952     0.0521093     0.351234      0.0109994     0.101775        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000747445   0.00713407     0.0227687    0.00394883    0.00716593       10     
reco:pandoracalo:Calorimetry                          0.00022696     0.0133642     0.0943235    0.00121537     0.0280083       10     
reco:pandorapid:Chi2ParticleID                        5.9873e-05    0.000541089   0.00212812    0.000175853   0.000785856      10     
reco:cvnmap:CVNMapper                                  0.0168342     0.0561476     0.135905      0.0555136     0.0321201       10     
reco:cvneva:CVNEvaluator                               0.673353       1.32793       6.59899      0.773096       1.75762        10     
reco:energyrecnumu:EnergyReco                         0.00269335     0.0409284     0.158864      0.0269685     0.0455446       10     
reco:energyrecnue:EnergyReco                          0.000768345   0.00403362     0.0142015    0.00221343    0.00422227       10     
reco:energyrecnc:EnergyReco                           0.00446082     0.0362432     0.0854044     0.0318486     0.0301957       10     
[art]:TriggerResults:TriggerResultInserter             9.868e-06    4.83033e-05   0.000231208   3.0112e-05    6.26601e-05      10     
end_path:out1:RootOutput                               4.93e-06     1.90932e-05   7.2247e-05    1.4823e-05    1.85044e-05      10     
end_path:out1:RootOutput(write)                        0.196957      0.309529      0.494413      0.308954      0.097784        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21683.7 MB
  Peak resident set size usage (VmHWM): 2725.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 142.456 | hit correction : 1.09321
hit initial : 102.162 | hit correction : 1.09222
 *** Total Charge : 2867.89
 Looking at view: 1 | Number of hits in view: 20
hit initial : 42.8834 | hit correction : 1.096
hit initial : 198.301 | hit correction : 1.09601
hit initial : 171.896 | hit correction : 1.09496
hit initial : 16.3866 | hit correction : 1.0932
hit initial : 566.696 | hit correction : 1.09482
hit initial : 70.7952 | hit correction : 1.09527
hit initial : 256.759 | hit correction : 1.09496
hit initial : 514.052 | hit correction : 1.09438
hit initial : 189.194 | hit correction : 1.09407
hit initial : 550.546 | hit correction : 1.09387
hit initial : 169.358 | hit correction : 1.09388
hit initial : 209.535 | hit correction : 1.09392
hit initial : 258.93 | hit correction : 1.09319
hit initial : 175.001 | hit correction : 1.09322
hit initial : 678.539 | hit correction : 1.09222
hit initial : 197.284 | hit correction : 1.09162
hit initial : 244.084 | hit correction : 1.09067
hit initial : 451.413 | hit correction : 1.09075
 *** Total Charge : 5425.29
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 10th record. run: 3799 subRun: 0 event: 4430 at 21-Nov-2025 09:49:01 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
This pfp has size:  5
True Neutron Energy: 939.572
True Electron Energy: 35.2159
Completed MCParticle Loop
True Neutrino Energy: 40.5999
 Size of all hits: 41
hit initial : 25.6146 | hit correction : 1.33757
hit initial : 70.808 | hit correction : 1.33535
hit initial : 28.61 | hit correction : 1.33533
hit initial : 67.8359 | hit correction : 1.33141
hit initial : 195.814 | hit correction : 1.3314
hit initial : 207.034 | hit correction : 1.33133
hit initial : 42.239 | hit correction : 1.33125
hit initial : 72.1326 | hit correction : 1.33377
hit initial : 277.401 | hit correction : 1.33386
hit initial : 402.435 | hit correction : 1.33412
hit initial : 359.24 | hit correction : 1.33444
hit initial : 216.716 | hit correction : 1.33486
hit initial : 176.842 | hit correction : 1.33512
hit initial : 181.705 | hit correction : 1.33537
hit initial : 182.13 | hit correction : 1.33579
hit initial : 208.015 | hit correction : 1.33618
hit initial : 167.375 | hit correction : 1.33659
hit initial : 185.329 | hit correction : 1.33702
hit initial : 218.36 | hit correction : 1.33738
hit initial : 138.744 | hit correction : 1.33755
 *** Total Charge : 4570.78
 Looking at view: 0 | Number of hits in view: 20
hit initial : 95.5736 | hit correction : 1.33143
hit initial : 221.831 | hit correction : 1.33137
hit initial : 126.904 | hit correction : 1.33132
hit initial : 400.526 | hit correction : 1.33407
hit initial : 638.366 | hit correction : 1.33431
hit initial : 412.735 | hit correction : 1.33497
hit initial : 330.221 | hit correction : 1.33566
hit initial : 359.687 | hit correction : 1.33638
hit initial : 351.421 | hit correction : 1.33711
hit initial : 229.705 | hit correction : 1.33746
 *** Total Charge : 4227.48
 Looking at view: 1 | Number of hits in view: 10
hit initial : 256.748 | hit correction : 1.33752
hit initial : 94.7599 | hit correction : 1.33157
hit initial : 56.4441 | hit correction : 1.33381
hit initial : 273.815 | hit correction : 1.3338
hit initial : 343.837 | hit correction : 1.33409
hit initial : 408.232 | hit correction : 1.33443
hit initial : 280.856 | hit correction : 1.33494
hit initial : 368.648 | hit correction : 1.33531
hit initial : 346.862 | hit correction : 1.33581
hit initial : 280.852 | hit correction : 1.33649
hit initial : 319.535 | hit correction : 1.33713
 *** Total Charge : 4046.69
 Looking at view: 2 | Number of hits in view: 11
21-Nov-2025 09:49:03 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0459131     0.0545664     0.0621016     0.0550639     0.0048955       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000278818   0.000343037   0.000493464   0.000341571   5.86103e-05      10     
end_path:ana:AnalyzeEvents         0.0454589     0.0540775     0.0617062     0.0545334    0.00485764       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.3 MB
  Peak resident set size usage (VmHWM): 1537.24 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-09 01:57:23 UTC       justIN version: 01.06.00