justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267781.1@dunegpschedd01.fnal.gov

Jobsub ID267781.1@dunegpschedd01.fnal.gov
Workflow ID11173
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 05:36:16
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 17:53:43
From worker nodeHostnamedunegli-8047081-0-fnpc9021.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 05:37:10
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163151Z_gen_000399_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time12h (44175s)
CPU time11h (43086s = 97%)
Max RSS bytes2803593216 (2673 MiB)
Outputting started2025-12-13 17:53:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11173/1/001/analysisLowE_20251213T053711Z.root
Finished2025-12-13 17:53:43
Saved logsjustin-logs:267781.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

25 17:51:53 UTC run: 5026 subRun: 0 event: 3990
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 17:51:53 UTC run: 5026 subRun: 0 event: 3990
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6591, 6507, 6686
minwire 0: 52
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1385, 1884
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.12665, 
Output 1: 0.0972851, 0.102549, 0.123817, 0.676349, 
Output 2: 0.0383151, 0.223133, 0.715629, 0.0229237, 
Output 3: 0.97128, 0.014483, 0.00275925, 0.0114773, 
Output 4: 0.486594, 0.451765, 0.0556471, 0.00599436, 
Output 5: 0.46263, 0.40267, 0.11074, 0.0239603, 
Output 6: 0.0189829, 0.0453855, 0.0637123, 0.871919, 

13-Dec-2025 17:51:57 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 17:51:57 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/23/42/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163151Z_gen_000399_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3239.32       4379.19       5108.32       4491.11       602.434        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00135967    0.00682006     0.0317101    0.00213117    0.00994231       10     
reco:pandora:StandardPandora                            3236.72       4321.71       5036.4        4427.89       577.301        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00142961      0.15755      0.224617      0.181445      0.0695189       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00298433     0.0155076     0.075664     0.00578939     0.021281        10     
reco:pandoracalo:Calorimetry                          0.000710238   0.00377711     0.0197085    0.00136973    0.00571144       10     
reco:pandorapid:Chi2ParticleID                        0.000205648   0.00109288    0.00839537    0.000285796   0.00243519       10     
reco:cvnmap:CVNMapper                                  0.110937      0.176731      0.259444      0.180749      0.0406495       10     
reco:cvneva:CVNEvaluator                                1.76387       2.81561       9.34452       2.05572       2.19003        10     
reco:energyrecnumu:EnergyReco                          0.0978648      53.679        74.3017       67.8279       27.0729        10     
reco:energyrecnue:EnergyReco                          0.00249913    0.00698332     0.0177556    0.00488549    0.00474568       10     
reco:energyrecnc:EnergyReco                            0.0120903     0.0185121     0.0478818     0.0145164     0.0102638       10     
[art]:TriggerResults:TriggerResultInserter             3.38e-05     7.91614e-05   0.000402016   4.2056e-05    0.000107964      10     
end_path:out1:RootOutput                              1.2639e-05    2.39199e-05    8.68e-05     1.73545e-05   2.12068e-05      10     
end_path:out1:RootOutput(write)                        0.479097      0.598787      0.811363       0.54624      0.118999        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11910.9 MB
  Peak resident set size usage (VmHWM): 2803.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 195.564 | hit correction : 1.22322
hit initial : 279.378 | hit correction : 1.22405
hit initial : 73.1986 | hit correction : 1.22409
hit initial : 398.062 | hit correction : 1.22401
hit initial : 312.453 | hit correction : 1.224
hit initial : 153.063 | hit correction : 1.2239
hit initial : 494.54 | hit correction : 1.22391
 *** Total Charge : 2418.14
 Looking at view: 1 | Number of hits in view: 8
hit initial : 215.833 | hit correction : 1.22314
hit initial : 128.109 | hit correction : 1.2237
hit initial : 491.271 | hit correction : 1.22369
hit initial : 137.797 | hit correction : 1.22411
hit initial : 121.913 | hit correction : 1.22425
hit initial : 111.8 | hit correction : 1.22425
hit initial : 117.962 | hit correction : 1.22411
hit initial : 115.694 | hit correction : 1.2242
hit initial : 105.523 | hit correction : 1.22408
hit initial : 106.684 | hit correction : 1.22403
hit initial : 122.237 | hit correction : 1.22396
hit initial : 122.062 | hit correction : 1.22385
hit initial : 71.032 | hit correction : 1.22377
 *** Total Charge : 2408.44
 Looking at view: 2 | Number of hits in view: 13
Begin processing the 10th record. run: 5026 subRun: 0 event: 3990 at 13-Dec-2025 17:53:19 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  6
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
This pfp has size:  5
True Neutron Energy: 939.571
True Electron Energy: 28.1656
Completed MCParticle Loop
True Neutrino Energy: 43.6511
 Size of all hits: 41
hit initial : 30.797 | hit correction : 1.03483
hit initial : 18.5401 | hit correction : 1.03878
hit initial : 34.4059 | hit correction : 1.03877
hit initial : 199.744 | hit correction : 1.03536
hit initial : 318.156 | hit correction : 1.03532
hit initial : 156.181 | hit correction : 1.03521
hit initial : 153.247 | hit correction : 1.03469
hit initial : 222.727 | hit correction : 1.03465
hit initial : 204.439 | hit correction : 1.03461
hit initial : 216.964 | hit correction : 1.03459
hit initial : 229.492 | hit correction : 1.0345
hit initial : 241.137 | hit correction : 1.03432
hit initial : 220.483 | hit correction : 1.034
hit initial : 287.222 | hit correction : 1.03389
hit initial : 395.584 | hit correction : 1.03392
hit initial : 315.809 | hit correction : 1.03388
 *** Total Charge : 3357.01
 Looking at view: 0 | Number of hits in view: 16
hit initial : 31.6749 | hit correction : 1.03482
hit initial : 16.8484 | hit correction : 1.03431
hit initial : 30.955 | hit correction : 1.03432
hit initial : 36.6538 | hit correction : 1.03877
hit initial : 27.2259 | hit correction : 1.03875
hit initial : 80.8375 | hit correction : 1.03536
hit initial : 278.632 | hit correction : 1.03534
hit initial : 90.4851 | hit correction : 1.03537
hit initial : 44.8239 | hit correction : 1.03469
hit initial : 237.127 | hit correction : 1.03463
hit initial : 294.295 | hit correction : 1.0346
hit initial : 318.772 | hit correction : 1.03453
hit initial : 347.928 | hit correction : 1.03428
hit initial : 291.453 | hit correction : 1.03394
hit initial : 328.823 | hit correction : 1.03391
hit initial : 387.129 | hit correction : 1.0339
 *** Total Charge : 2941.84
 Looking at view: 1 | Number of hits in view: 16
hit initial : 20.6132 | hit correction : 1.0353
hit initial : 58.1163 | hit correction : 1.03481
hit initial : 41.4407 | hit correction : 1.03428
hit initial : 67.2947 | hit correction : 1.03876
hit initial : 253.278 | hit correction : 1.03542
hit initial : 423.696 | hit correction : 1.03526
hit initial : 432.08 | hit correction : 1.03469
hit initial : 467.223 | hit correction : 1.0346
hit initial : 512.174 | hit correction : 1.0344
 *** Total Charge : 2355.38
 Looking at view: 2 | Number of hits in view: 9
13-Dec-2025 17:53:24 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.118033       0.16191      0.243645      0.146449      0.0423993       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000734556   0.00252702     0.0156642    0.00103424    0.00439177       10     
end_path:ana:AnalyzeEvents         0.115812       0.15903      0.242614      0.145091      0.0400783       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9813.21 MB
  Peak resident set size usage (VmHWM): 1540.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:05:53 UTC       justIN version: 01.06.00