justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266925.1@dunegpschedd01.fnal.gov

Jobsub ID266925.1@dunegpschedd01.fnal.gov
Workflow ID11092
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 17:46:22
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 00:21:01
From worker nodeHostnamedunegli-8029043-0-fnpc9012.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 17:47:39
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T015508Z_gen_003384_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (23588s)
CPU time6h (23446s = 99%)
Max RSS bytes2908160000 (2773 MiB)
Outputting started2025-12-12 00:20:47
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11092/1/001/analysisLowE_20251211T174739Z.root
Finished2025-12-12 00:21:01
Saved logsjustin-logs:266925.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

64201, 0.860318, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 33840 at 11-Dec-2025 23:45:16 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 00:19:54 UTC run: 5027 subRun: 0 event: 33840
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 7059, 6992, 6958
minwire 0: 55
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1743, 2242
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0985878, 
Output 1: 0.429084, 0.0879008, 0.194362, 0.288653, 
Output 2: 0.0332576, 0.101644, 0.855133, 0.00996578, 
Output 3: 0.938618, 0.0558095, 0.00270509, 0.00286693, 
Output 4: 0.60857, 0.353001, 0.0327254, 0.00570305, 
Output 5: 0.283749, 0.44109, 0.204336, 0.0708259, 
Output 6: 0.146907, 0.253251, 0.138127, 0.461715, 

12-Dec-2025 00:19:58 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 00:19:58 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/89/07/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T015508Z_gen_003384_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2018.69       2336.42       2700.14       2375.06       218.155        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00189558     0.0126444     0.0462411    0.00742124     0.0130944       10     
reco:pandora:StandardPandora                            2016.14       2333.52       2697.61       2372.51       217.747        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00047418     0.0236422     0.159218     0.00551844     0.046737        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000499531   0.00724368     0.0348287    0.00563402    0.00945672       10     
reco:pandoracalo:Calorimetry                          0.000307208    0.0143093     0.0375664    0.00900836     0.0152711       10     
reco:pandorapid:Chi2ParticleID                         9.202e-05    0.000489313   0.00319389    0.00017518    0.000904949      10     
reco:cvnmap:CVNMapper                                  0.037413      0.0603331     0.0774601     0.0577249     0.0120444       10     
reco:cvneva:CVNEvaluator                                1.60387       2.07883       5.19905       1.73968       1.04163        10     
reco:energyrecnumu:EnergyReco                         0.00782675     0.105547      0.399339       0.11465      0.111178        10     
reco:energyrecnue:EnergyReco                          0.00154087    0.00687113     0.0119641    0.00735154     0.0047685       10     
reco:energyrecnc:EnergyReco                            0.0114551     0.0528298     0.128826      0.0124077     0.0507176       10     
[art]:TriggerResults:TriggerResultInserter            2.3638e-05    3.81551e-05   0.000130125   2.79635e-05   3.0771e-05       10     
end_path:out1:RootOutput                                7.2e-06     1.30303e-05   4.4377e-05    8.7045e-06    1.06578e-05      10     
end_path:out1:RootOutput(write)                        0.412574      0.537234      0.593675      0.551156      0.0494164       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12113.8 MB
  Peak resident set size usage (VmHWM): 2908.16 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 218.584 | hit correction : 1.02751
hit initial : 812.879 | hit correction : 1.03011
hit initial : 9.49008 | hit correction : 1.02842
hit initial : 203.35 | hit correction : 1.02784
hit initial : 903.66 | hit correction : 1.02852
hit initial : 188.021 | hit correction : 1.02809
hit initial : 404.696 | hit correction : 1.02608
hit initial : 260.544 | hit correction : 1.02643
hit initial : 84.8551 | hit correction : 1.02662
 *** Total Charge : 3674.84
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 7th record. run: 5027 subRun: 0 event: 33837 at 12-Dec-2025 00:20:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 14.6748
Completed MCParticle Loop
True Neutrino Energy: 18.4061
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 33838 at 12-Dec-2025 00:20:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 5.05065
Completed MCParticle Loop
True Neutrino Energy: 10.4282
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 33839 at 12-Dec-2025 00:20:41 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 29.0114
Completed MCParticle Loop
True Neutrino Energy: 46.2629
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 33840 at 12-Dec-2025 00:20:43 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  34
Added hit list length: 34 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 44.8567
Completed MCParticle Loop
True Neutrino Energy: 48.2292
 Size of all hits: 34
hit initial : 69.3115 | hit correction : 1.19808
hit initial : 242.517 | hit correction : 1.19722
hit initial : 235.991 | hit correction : 1.19727
hit initial : 37.6964 | hit correction : 1.19843
hit initial : 190.301 | hit correction : 1.19844
hit initial : 160.839 | hit correction : 1.19771
hit initial : 78.6893 | hit correction : 1.19841
hit initial : 155.595 | hit correction : 1.1975
hit initial : 280.166 | hit correction : 1.19741
hit initial : 295.254 | hit correction : 1.1977
hit initial : 329.696 | hit correction : 1.19791
hit initial : 224.733 | hit correction : 1.19803
 *** Total Charge : 2755.72
 Looking at view: 0 | Number of hits in view: 12
hit initial : 16.3234 | hit correction : 1.19661
hit initial : 51.4961 | hit correction : 1.19835
hit initial : 132.531 | hit correction : 1.19753
hit initial : 60.4119 | hit correction : 1.19843
hit initial : 203.385 | hit correction : 1.1974
hit initial : 100.311 | hit correction : 1.19847
hit initial : 238.436 | hit correction : 1.19721
hit initial : 209.58 | hit correction : 1.19728
hit initial : 194.888 | hit correction : 1.19751
hit initial : 216.735 | hit correction : 1.19782
hit initial : 190.877 | hit correction : 1.19794
hit initial : 155.477 | hit correction : 1.19804
hit initial : 89.7931 | hit correction : 1.19811
hit initial : 21.1091 | hit correction : 1.19815
hit initial : 194.214 | hit correction : 1.1977
 *** Total Charge : 2485.89
 Looking at view: 1 | Number of hits in view: 15
hit initial : 115.419 | hit correction : 1.19715
hit initial : 614.855 | hit correction : 1.19729
hit initial : 564.667 | hit correction : 1.19762
hit initial : 555.541 | hit correction : 1.19791
hit initial : 443.438 | hit correction : 1.19822
hit initial : 143.402 | hit correction : 1.1984
hit initial : 54.9524 | hit correction : 1.19767
 *** Total Charge : 2985.08
 Looking at view: 2 | Number of hits in view: 7
12-Dec-2025 00:20:46 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0737356     0.0981836     0.173256      0.0834555     0.0336676       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000359607   0.000523473   0.000872489   0.000462284   0.00016586       10     
end_path:ana:AnalyzeEvents         0.073229      0.0974926     0.172397      0.0829428     0.0334855       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9809.22 MB
  Peak resident set size usage (VmHWM): 1533.04 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:00 UTC       justIN version: 01.06.00