justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 259885.2@dunegpschedd02.fnal.gov

Jobsub ID259885.2@dunegpschedd02.fnal.gov
Workflow ID11085
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 21:36:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 07:03:36
From worker nodeHostnamedunegli-7867874-0-fnpc8002.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 14:00:19
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010218Z_gen_002896_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time17h (61345s)
CPU time16h (60024s = 97%)
Max RSS bytes3059073024 (2917 MiB)
Outputting started2025-12-11 07:02:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11085/1/001/analysisLowE_20251210T140020Z.root
Finished2025-12-11 07:03:36
Saved logsjustin-logs:259885.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

6: 0.016947, 0.0453118, 0.0589323, 0.878809, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 28960 at 11-Dec-2025 05:09:49 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 06:59:55 UTC run: 5027 subRun: 0 event: 28960
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6669, 6710, 6676
minwire 0: 36
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 10, 509
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0531193, 
Output 1: 0.0204928, 0.0786114, 0.126365, 0.77453, 
Output 2: 0.0911864, 0.209454, 0.64573, 0.0536295, 
Output 3: 0.917069, 0.0543249, 0.013181, 0.0154255, 
Output 4: 0.664482, 0.29173, 0.0375868, 0.00620172, 
Output 5: 0.888758, 0.0923781, 0.0135392, 0.00532493, 
Output 6: 0.0118054, 0.044565, 0.0525936, 0.891036, 

11-Dec-2025 07:00:04 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 07:00:04 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4e/dc/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010218Z_gen_002896_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              5168.04       6082.88       7180.31       6101.73       781.459        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0165224     0.0275149     0.0482595     0.0283842    0.00853734       10     
reco:pandora:StandardPandora                            5163.29       6076.81       7174.71       6091.81       781.98         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00169358      0.13069      0.583905      0.0872408      0.16838        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00137818     0.0200245     0.049612      0.0192954     0.014036        10     
reco:pandoracalo:Calorimetry                          0.00116348     0.0340154     0.161804     0.00629517     0.0533781       10     
reco:pandorapid:Chi2ParticleID                        0.000159569   0.00144958    0.00481348    0.00069838     0.0015312       10     
reco:cvnmap:CVNMapper                                  0.135712      0.198636       0.30388      0.184935      0.0507026       10     
reco:cvneva:CVNEvaluator                                2.8536        4.58782       12.8451       3.73886       2.79199        10     
reco:energyrecnumu:EnergyReco                          0.0231845     0.118431      0.250089      0.136391      0.0708098       10     
reco:energyrecnue:EnergyReco                          0.00377624     0.0103798     0.0217734    0.00682081    0.00628972       10     
reco:energyrecnc:EnergyReco                            0.0146984     0.0793468     0.200091      0.0221815     0.0743896       10     
[art]:TriggerResults:TriggerResultInserter            4.8798e-05    0.000103819   0.000272094   7.7679e-05    6.75889e-05      10     
end_path:out1:RootOutput                              1.2893e-05     2.793e-05    7.3987e-05    2.29575e-05   1.66164e-05      10     
end_path:out1:RootOutput(write)                        0.520748      0.865305       1.0248       0.868711       0.13705        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11042.3 MB
  Peak resident set size usage (VmHWM): 3059.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 1969.56
 Looking at view: 0 | Number of hits in view: 8
hit initial : 15.0261 | hit correction : 1.14533
hit initial : 73.5045 | hit correction : 1.14523
hit initial : 159.625 | hit correction : 1.14511
hit initial : 51.0707 | hit correction : 1.14348
hit initial : 192.343 | hit correction : 1.14343
hit initial : 280.966 | hit correction : 1.1434
hit initial : 245.862 | hit correction : 1.1435
hit initial : 231.725 | hit correction : 1.14384
hit initial : 261.402 | hit correction : 1.14437
hit initial : 211.265 | hit correction : 1.14485
 *** Total Charge : 1970.97
 Looking at view: 1 | Number of hits in view: 10
hit initial : 261.178 | hit correction : 1.14514
hit initial : 634.177 | hit correction : 1.14343
hit initial : 90.2167 | hit correction : 1.14343
hit initial : 310.753 | hit correction : 1.14373
hit initial : 482.939 | hit correction : 1.14458
 *** Total Charge : 2035.56
 Looking at view: 2 | Number of hits in view: 5
Begin processing the 9th record. run: 5027 subRun: 0 event: 28959 at 11-Dec-2025 07:02:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 11.6446
Completed MCParticle Loop
True Neutrino Energy: 19.4355
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 28960 at 11-Dec-2025 07:02:37 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  25
Added hit list length: 25 | Max was set to: -3.40282e+38
This pfp has size:  38
Added hit list length: 38 | Max was set to: 25
True Neutron Energy: 939.57
True Electron Energy: 51.5771
Completed MCParticle Loop
True Neutrino Energy: 59.445
 Size of all hits: 38
hit initial : 279.086 | hit correction : 1.22865
hit initial : 150.801 | hit correction : 1.22845
hit initial : 260.027 | hit correction : 1.23057
hit initial : 122.24 | hit correction : 1.22969
hit initial : 578.117 | hit correction : 1.23058
hit initial : 71.5327 | hit correction : 1.22968
hit initial : 112.149 | hit correction : 1.23057
hit initial : 52.9813 | hit correction : 1.22974
hit initial : 111.104 | hit correction : 1.22764
hit initial : 59.0234 | hit correction : 1.2315
 *** Total Charge : 2210.08
 Looking at view: 0 | Number of hits in view: 10
hit initial : 58.5966 | hit correction : 1.23121
hit initial : 255.955 | hit correction : 1.23055
hit initial : 83.8877 | hit correction : 1.22968
hit initial : 58.386 | hit correction : 1.22712
hit initial : 26.1107 | hit correction : 1.23153
hit initial : 70.5676 | hit correction : 1.23064
hit initial : 83.1792 | hit correction : 1.22967
hit initial : 56.7296 | hit correction : 1.22752
hit initial : 185.305 | hit correction : 1.22696
hit initial : 59.778 | hit correction : 1.22546
hit initial : 54.8048 | hit correction : 1.22348
hit initial : 19.505 | hit correction : 1.23156
hit initial : 105.043 | hit correction : 1.23056
hit initial : 69.4739 | hit correction : 1.22974
hit initial : 109.14 | hit correction : 1.22809
hit initial : 60.9932 | hit correction : 1.22746
hit initial : 85.2537 | hit correction : 1.22689
hit initial : 97.8108 | hit correction : 1.22543
hit initial : 25.6917 | hit correction : 1.22469
hit initial : 85.8836 | hit correction : 1.22348
hit initial : 191.367 | hit correction : 1.22848
hit initial : 114.695 | hit correction : 1.22554
hit initial : 44.823 | hit correction : 1.22471
hit initial : 53.7487 | hit correction : 1.22352
hit initial : 280.204 | hit correction : 1.22874
hit initial : 159.347 | hit correction : 1.22883
hit initial : 49.6309 | hit correction : 1.22803
hit initial : 98.0325 | hit correction : 1.23142
 *** Total Charge : 3247.21
 Looking at view: 1 | Number of hits in view: 28
11-Dec-2025 07:02:44 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.161876      0.216416      0.344336      0.182034      0.0629144       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000941213   0.00719656     0.0309832    0.00175749    0.00964693       10     
end_path:ana:AnalyzeEvents         0.160655      0.208697      0.311497      0.174549      0.0567256       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8735.66 MB
  Peak resident set size usage (VmHWM): 1531.74 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:27:50 UTC       justIN version: 01.06.00