justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258139.2@dunegpschedd02.fnal.gov

Jobsub ID258139.2@dunegpschedd02.fnal.gov
Workflow ID11026
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 19:46:04
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:10:20
From worker nodeHostnamedunegli-7988825-0-fnpc17114.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:33:11
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T192645Z_gen_002292_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (23814s)
CPU time6h (23565s = 98%)
Max RSS bytes3029901312 (2889 MiB)
Outputting started2025-12-06 08:10:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11026/1/001/analysisLowE_20251206T013312Z.root
Finished2025-12-06 08:10:20
Saved logsjustin-logs:258139.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 0.02466, 
Output 6: 0.0140908, 0.0370066, 0.0552081, 0.893695, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 22920 at 06-Dec-2025 07:30:28 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 08:08:38 UTC run: 5026 subRun: 0 event: 22920
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 7089, 6956, 6805
minwire 0: 14
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1957, 2456
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0862963, 
Output 1: 0.219105, 0.0906046, 0.193631, 0.496659, 
Output 2: 0.0395906, 0.073098, 0.879334, 0.00797713, 
Output 3: 0.964864, 0.0320182, 0.0011367, 0.00198072, 
Output 4: 0.549377, 0.396213, 0.0440072, 0.0104026, 
Output 5: 0.311364, 0.427394, 0.181631, 0.0796114, 
Output 6: 0.138511, 0.237789, 0.130968, 0.492732, 

06-Dec-2025 08:08:43 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:08:43 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b7/25/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T192645Z_gen_002292_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2279.6        2355.94       2506.87       2351.04       61.0313        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00460378     0.0110033     0.0299521    0.00746991    0.00839008       10     
reco:pandora:StandardPandora                            2277.18       2352.95       2499.06       2348.74       59.7348        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00109971     0.0340285     0.141507      0.0163905     0.0418961       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000640947    0.0133713     0.0716154    0.00474601     0.0213468       10     
reco:pandoracalo:Calorimetry                          0.000459621   0.00234408     0.0108236    0.000691103   0.00335523       10     
reco:pandorapid:Chi2ParticleID                        0.000131184   0.000432796   0.00283027    0.000169957   0.00079975       10     
reco:cvnmap:CVNMapper                                  0.050861      0.0933957     0.123999      0.095761      0.0203241       10     
reco:cvneva:CVNEvaluator                                1.28722       1.93985       6.26541       1.51078       1.44386        10     
reco:energyrecnumu:EnergyReco                          0.0111529     0.133334      0.469952      0.125472      0.137644        10     
reco:energyrecnue:EnergyReco                          0.00216692    0.00499648     0.0150001    0.00236645    0.00497539       10     
reco:energyrecnc:EnergyReco                            0.0137476     0.0594922     0.142472      0.0152913     0.0564859       10     
[art]:TriggerResults:TriggerResultInserter            2.2565e-05    3.92239e-05   0.000130839   2.9985e-05    3.08725e-05      10     
end_path:out1:RootOutput                               7.834e-06    1.34374e-05   4.6135e-05    9.8405e-06    1.09667e-05      10     
end_path:out1:RootOutput(write)                        0.568256      0.700082      0.926734      0.689974      0.0871537       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14256.3 MB
  Peak resident set size usage (VmHWM): 3029.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 9.32739
Completed MCParticle Loop
True Neutrino Energy: 15.5168
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 22919 at 06-Dec-2025 08:09:54 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  29
Added hit list length: 29 | Max was set to: -3.40282e+38
True Electron Energy: 17.1553
Completed MCParticle Loop
True Neutrino Energy: 22.5399
 Size of all hits: 29
hit initial : 130.845 | hit correction : 1.30361
hit initial : 37.9696 | hit correction : 1.30284
hit initial : 190.323 | hit correction : 1.30358
hit initial : 90.946 | hit correction : 1.30349
hit initial : 40.7811 | hit correction : 1.30224
hit initial : 29.6464 | hit correction : 1.30092
hit initial : 61.9022 | hit correction : 1.30088
hit initial : 157.827 | hit correction : 1.30279
hit initial : 247.768 | hit correction : 1.30257
hit initial : 203.472 | hit correction : 1.30236
hit initial : 182.763 | hit correction : 1.30223
hit initial : 221.339 | hit correction : 1.30219
hit initial : 258.398 | hit correction : 1.30222
hit initial : 170.682 | hit correction : 1.30223
 *** Total Charge : 2637.21
 Looking at view: 0 | Number of hits in view: 14
hit initial : 182.915 | hit correction : 1.30364
hit initial : 290.646 | hit correction : 1.30336
hit initial : 40.9619 | hit correction : 1.30088
hit initial : 109.078 | hit correction : 1.30087
hit initial : 22.2119 | hit correction : 1.30083
hit initial : 82.6076 | hit correction : 1.30245
hit initial : 33.3605 | hit correction : 1.30241
hit initial : 146.821 | hit correction : 1.30279
hit initial : 116.631 | hit correction : 1.30257
hit initial : 149.327 | hit correction : 1.3024
hit initial : 144.823 | hit correction : 1.3023
hit initial : 146.278 | hit correction : 1.30221
hit initial : 140.307 | hit correction : 1.30221
hit initial : 238.586 | hit correction : 1.30218
hit initial : 188.558 | hit correction : 1.30216
 *** Total Charge : 2648.08
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 10th record. run: 5026 subRun: 0 event: 22920 at 06-Dec-2025 08:10:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  20
Added hit list length: 20 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Electron Energy: 25.6866
Completed MCParticle Loop
True Neutrino Energy: 31.0734
 Size of all hits: 20
hit initial : 53.2341 | hit correction : 1.06279
hit initial : 30.0031 | hit correction : 1.06256
hit initial : 38.7211 | hit correction : 1.06256
hit initial : 93.345 | hit correction : 1.06325
hit initial : 297.155 | hit correction : 1.06361
hit initial : 294.567 | hit correction : 1.06339
hit initial : 226.511 | hit correction : 1.06349
hit initial : 317.928 | hit correction : 1.06327
hit initial : 287.215 | hit correction : 1.06367
hit initial : 288.192 | hit correction : 1.06342
hit initial : 352.107 | hit correction : 1.0628
hit initial : 419.688 | hit correction : 1.06219
hit initial : 192.697 | hit correction : 1.06194
 *** Total Charge : 3073.69
 Looking at view: 1 | Number of hits in view: 13
hit initial : 36.8831 | hit correction : 1.06397
hit initial : 234.432 | hit correction : 1.06178
hit initial : 31.4577 | hit correction : 1.06028
hit initial : 512.768 | hit correction : 1.0623
hit initial : 250.751 | hit correction : 1.06372
hit initial : 1196.39 | hit correction : 1.06349
hit initial : 609.793 | hit correction : 1.06308
 *** Total Charge : 3053.56
 Looking at view: 2 | Number of hits in view: 7
06-Dec-2025 08:10:05 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.125262      0.166712      0.223394      0.151434      0.036762        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000534156   0.000786557   0.00144582    0.000758761   0.000234822      10     
end_path:ana:AnalyzeEvents         0.124576      0.165668       0.22109      0.150495      0.036539        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11959.8 MB
  Peak resident set size usage (VmHWM): 1537.18 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-12-19 13:09:25 UTC       justIN version: 01.05.03