justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261256.1@dunegpschedd02.fnal.gov

Jobsub ID261256.1@dunegpschedd02.fnal.gov
Workflow ID11094
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 21:50:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 01:53:51
From worker nodeHostnamedunegli-8035311-0-fnpc19103.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 21:51:48
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T235144Z_gen_001809_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14508s)
CPU time3h (14384s = 99%)
Max RSS bytes3019554816 (2879 MiB)
Outputting started2025-12-12 01:53:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11094/1/001/analysisLowE_20251211T215148Z.root
Finished2025-12-12 01:53:51
Saved logsjustin-logs:261256.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0174338, 0.00268498, 
Output 6: 0.0211138, 0.0794238, 0.0908546, 0.808608, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 18090 at 12-Dec-2025 01:28:40 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 01:52:49 UTC run: 5027 subRun: 0 event: 18090
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6423, 6324, 6625
minwire 0: 25
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 249, 748
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.120409, 
Output 1: 0.0867809, 0.218181, 0.159171, 0.535867, 
Output 2: 0.0414317, 0.166738, 0.75839, 0.0334397, 
Output 3: 0.974282, 0.0187845, 0.00259796, 0.00433578, 
Output 4: 0.87194, 0.109545, 0.01485, 0.00366506, 
Output 5: 0.425884, 0.260236, 0.21281, 0.10107, 
Output 6: 0.0471172, 0.0957785, 0.0864216, 0.770683, 

12-Dec-2025 01:52:51 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:52:51 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/61/29/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T235144Z_gen_001809_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1394.38       1437.65       1471.58       1446.83       21.346         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00137716    0.00595027     0.0191048    0.00373359    0.00547847       10     
reco:pandora:StandardPandora                            1391.62       1436.21       1470.3        1445.52       21.6375        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00133518     0.0142341     0.0686141    0.00517309     0.0200619       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00186788    0.00421125    0.00935051    0.00380904    0.00182612       10     
reco:pandoracalo:Calorimetry                          0.000233483    0.0025975     0.0204888    0.000340003   0.00599456       10     
reco:pandorapid:Chi2ParticleID                         6.542e-05    0.000193727   0.000940248   0.000100156   0.000253801      10     
reco:cvnmap:CVNMapper                                  0.0224644     0.0270994     0.0369171     0.0262525    0.00392312       10     
reco:cvneva:CVNEvaluator                               0.827007      0.992956       2.20107      0.865323      0.403311        10     
reco:energyrecnumu:EnergyReco                         0.00406446     0.0487955     0.107308      0.0394849     0.0440313       10     
reco:energyrecnue:EnergyReco                          0.000876838   0.00231544    0.00767232     0.0010222    0.00249554       10     
reco:energyrecnc:EnergyReco                            0.0066746     0.0510353     0.121053      0.039811      0.0458021       10     
[art]:TriggerResults:TriggerResultInserter             1.228e-05    2.12982e-05   7.9681e-05    1.4685e-05    1.96085e-05      10     
end_path:out1:RootOutput                               6.89e-06     1.0377e-05     2.82e-05      8.045e-06    6.11392e-06      10     
end_path:out1:RootOutput(write)                        0.285072      0.295093      0.307864      0.293245     0.00799209       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21782.2 MB
  Peak resident set size usage (VmHWM): 3019.55 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 105.076 | hit correction : 1.0273
hit initial : 394.719 | hit correction : 1.02758
hit initial : 229.286 | hit correction : 1.02816
 *** Total Charge : 3577.06
 Looking at view: 0 | Number of hits in view: 25
hit initial : 159.298 | hit correction : 1.02413
hit initial : 253.678 | hit correction : 1.02417
hit initial : 110.352 | hit correction : 1.02422
hit initial : 141.541 | hit correction : 1.02415
hit initial : 22.7477 | hit correction : 1.02412
hit initial : 320.284 | hit correction : 1.02441
hit initial : 384.281 | hit correction : 1.02468
hit initial : 133.173 | hit correction : 1.02511
hit initial : 122.096 | hit correction : 1.02571
hit initial : 102.971 | hit correction : 1.02643
hit initial : 748.958 | hit correction : 1.0267
hit initial : 55.1616 | hit correction : 1.02709
hit initial : 248.241 | hit correction : 1.02804
hit initial : 44.2693 | hit correction : 1.02827
 *** Total Charge : 2919.88
 Looking at view: 1 | Number of hits in view: 14
hit initial : 34.2839 | hit correction : 1.02561
hit initial : 204.732 | hit correction : 1.02411
hit initial : 436.403 | hit correction : 1.0242
hit initial : 683.796 | hit correction : 1.02433
hit initial : 193.131 | hit correction : 1.02477
hit initial : 187.334 | hit correction : 1.02501
hit initial : 187.962 | hit correction : 1.02518
hit initial : 171.803 | hit correction : 1.02541
hit initial : 192.092 | hit correction : 1.02567
hit initial : 139.491 | hit correction : 1.02597
hit initial : 319.385 | hit correction : 1.02648
hit initial : 386.206 | hit correction : 1.02729
hit initial : 251.484 | hit correction : 1.02793
hit initial : 221.575 | hit correction : 1.02835
 *** Total Charge : 3702.12
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 10th record. run: 5027 subRun: 0 event: 18090 at 12-Dec-2025 01:53:33 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  21
Added hit list length: 21 | Max was set to: -3.40282e+38
This pfp has size:  26
Added hit list length: 26 | Max was set to: 21
True Neutron Energy: 939.567
True Neutron Energy: 940.015
True Electron Energy: 39.7851
Completed MCParticle Loop
True Neutrino Energy: 43.5358
 Size of all hits: 26
hit initial : 129.333 | hit correction : 1.35558
hit initial : 252.568 | hit correction : 1.35626
hit initial : 207.617 | hit correction : 1.35677
hit initial : 111.422 | hit correction : 1.35693
 *** Total Charge : 950.749
 Looking at view: 0 | Number of hits in view: 4
hit initial : 56.2818 | hit correction : 1.35384
hit initial : 195.24 | hit correction : 1.35144
hit initial : 45.9811 | hit correction : 1.35704
hit initial : 116.419 | hit correction : 1.35377
hit initial : 130.577 | hit correction : 1.35205
hit initial : 72.7107 | hit correction : 1.35048
hit initial : 487.447 | hit correction : 1.35345
hit initial : 47.427 | hit correction : 1.35716
hit initial : 98.6026 | hit correction : 1.3545
hit initial : 58.6198 | hit correction : 1.3536
hit initial : 109.743 | hit correction : 1.3546
hit initial : 54.8339 | hit correction : 1.35547
hit initial : 226.318 | hit correction : 1.35581
hit initial : 91.4104 | hit correction : 1.35637
hit initial : 167.793 | hit correction : 1.35689
 *** Total Charge : 2653.29
 Looking at view: 1 | Number of hits in view: 15
hit initial : 19.8304 | hit correction : 1.35535
hit initial : 33.7466 | hit correction : 1.35456
hit initial : 25.7175 | hit correction : 1.35385
hit initial : 992.617 | hit correction : 1.35513
hit initial : 60.4512 | hit correction : 1.35721
hit initial : 20.2938 | hit correction : 1.35485
hit initial : 139.678 | hit correction : 1.35614
 *** Total Charge : 1751.49
 Looking at view: 2 | Number of hits in view: 7
12-Dec-2025 01:53:36 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0718594     0.0896446     0.112694      0.0867874     0.0118399       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000354183   0.000591167   0.00118962    0.000483774   0.000253166      10     
end_path:ana:AnalyzeEvents         0.0713844     0.0888891     0.111029      0.0862162     0.0116002       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.8 MB
  Peak resident set size usage (VmHWM): 1534.05 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:56 UTC       justIN version: 01.06.00