justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264365.4@dunegpschedd01.fnal.gov

Jobsub ID264365.4@dunegpschedd01.fnal.gov
Workflow ID11030
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:05:54
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 19:23:59
From worker nodeHostnamedunegli-7832544-0-fnpc7304.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:06:17
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T140009Z_gen_000720_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time8h (29845s)
CPU time8h (29377s = 98%)
Max RSS bytes3045597184 (2904 MiB)
Outputting started2025-12-06 19:23:43
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11030/1/001/analysisLowE_20251206T110618Z.root
Finished2025-12-06 19:23:59
Saved logsjustin-logs:264365.4-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.713002, 
Output 2: 0.041144, 0.155657, 0.772556, 0.0306432, 
Output 3: 0.936914, 0.0377851, 0.0106998, 0.0146013, 
Output 4: 0.704031, 0.239796, 0.0455917, 0.0105813, 
Output 5: 0.556312, 0.285932, 0.120279, 0.0374767, 
Output 6: 0.0228687, 0.0658669, 0.0715185, 0.839746, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 7200 at 06-Dec-2025 18:44:19 UTC
Boundary wire vector sizes: 6824, 6836, 6705
minwire 0: 23
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2092, 2591
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.15416, 
Output 1: 0.0862265, 0.115935, 0.158747, 0.639091, 
Output 2: 0.054094, 0.258919, 0.65607, 0.0309165, 
Output 3: 0.966923, 0.0248187, 0.00301559, 0.00524298, 
Output 4: 0.430002, 0.510589, 0.055153, 0.00425583, 
Output 5: 0.410742, 0.445988, 0.121122, 0.0221485, 
Output 6: 0.0251681, 0.0653528, 0.0806973, 0.828782, 

06-Dec-2025 19:22:12 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 19:22:12 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/aa/93/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T140009Z_gen_000720_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2267.68       2953.68       3508.72       2896.59       322.572        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00212933     0.0080698     0.0143804    0.00870771    0.00363078       10     
reco:pandora:StandardPandora                            2264.81       2950.38       3505.82       2891.53       322.527        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000958926    0.043133      0.145051      0.0347788     0.0380362       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000356627   0.00728014     0.0286336    0.00608588    0.00756939       10     
reco:pandoracalo:Calorimetry                          0.000660095   0.00215877     0.0073092    0.000926526   0.00249207       10     
reco:pandorapid:Chi2ParticleID                        8.6444e-05    0.000489659   0.00291935    0.000236544   0.000811349      10     
reco:cvnmap:CVNMapper                                  0.0513506     0.0810897     0.128206      0.0787658     0.019934        10     
reco:cvneva:CVNEvaluator                                1.28244       2.41533       5.76086       2.15945       1.15645        10     
reco:energyrecnumu:EnergyReco                          0.0137145     0.0754805     0.144915      0.0856342     0.0512501       10     
reco:energyrecnue:EnergyReco                          0.00197153    0.00356526     0.010399     0.00287382    0.00234219       10     
reco:energyrecnc:EnergyReco                            0.0104861     0.0476124      0.11421      0.0185551     0.0418708       10     
[art]:TriggerResults:TriggerResultInserter            2.0143e-05    3.7834e-05    8.1315e-05    3.4628e-05    1.60695e-05      10     
end_path:out1:RootOutput                               9.382e-06    1.34604e-05   2.6774e-05    1.2287e-05    4.71158e-06      10     
end_path:out1:RootOutput(write)                        0.401409      0.618333      0.734906      0.665741      0.100401        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9963.6 MB
  Peak resident set size usage (VmHWM): 3045.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 279.113 | hit correction : 1.11945
hit initial : 460.32 | hit correction : 1.11961
hit initial : 237.356 | hit correction : 1.11978
hit initial : 123.491 | hit correction : 1.11999
hit initial : 150.906 | hit correction : 1.12009
hit initial : 201.614 | hit correction : 1.12016
hit initial : 146.105 | hit correction : 1.12022
hit initial : 434.036 | hit correction : 1.1202
hit initial : 370.992 | hit correction : 1.12029
hit initial : 298.709 | hit correction : 1.1255
hit initial : 773.382 | hit correction : 1.12578
hit initial : 1349.18 | hit correction : 1.12605
hit initial : 121.051 | hit correction : 1.12665
hit initial : 1080.52 | hit correction : 1.12624
hit initial : 49.6354 | hit correction : 1.12628
 *** Total Charge : 7418.69
 Looking at view: 2 | Number of hits in view: 19
Begin processing the 9th record. run: 4696 subRun: 0 event: 7199 at 06-Dec-2025 19:23:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.784
True Electron Energy: 8.21186
Completed MCParticle Loop
True Neutrino Energy: 25.4536
 Size of all hits: 0
Begin processing the 10th record. run: 4696 subRun: 0 event: 7200 at 06-Dec-2025 19:23:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
True Neutron Energy: 941.152
True Electron Energy: 43.0666
Completed MCParticle Loop
True Neutrino Energy: 67.1229
 Size of all hits: 41
hit initial : 71.6031 | hit correction : 1.3993
hit initial : 194.069 | hit correction : 1.39926
hit initial : 123.598 | hit correction : 1.39931
hit initial : 54.23 | hit correction : 1.39964
hit initial : 60.2082 | hit correction : 1.40011
hit initial : 253.226 | hit correction : 1.40023
hit initial : 133.154 | hit correction : 1.40086
hit initial : 372.326 | hit correction : 1.40108
hit initial : 560.646 | hit correction : 1.40152
hit initial : 636.768 | hit correction : 1.40198
hit initial : 436.539 | hit correction : 1.40256
hit initial : 178.84 | hit correction : 1.40288
hit initial : 29.525 | hit correction : 1.403
 *** Total Charge : 4350.74
 Looking at view: 0 | Number of hits in view: 13
hit initial : 105.194 | hit correction : 1.40271
hit initial : 126.634 | hit correction : 1.40288
hit initial : 94.136 | hit correction : 1.40286
hit initial : 82.9362 | hit correction : 1.39925
hit initial : 216.075 | hit correction : 1.3994
hit initial : 47.1706 | hit correction : 1.39933
hit initial : 116.782 | hit correction : 1.39956
hit initial : 286.46 | hit correction : 1.40094
hit initial : 115.314 | hit correction : 1.40107
hit initial : 233.088 | hit correction : 1.40167
hit initial : 893.549 | hit correction : 1.40178
hit initial : 248.202 | hit correction : 1.40199
 *** Total Charge : 3595.27
 Looking at view: 1 | Number of hits in view: 12
hit initial : 18.5793 | hit correction : 1.39931
hit initial : 185.521 | hit correction : 1.3992
hit initial : 309.406 | hit correction : 1.3995
hit initial : 100.635 | hit correction : 1.39968
hit initial : 273.263 | hit correction : 1.40004
hit initial : 121.874 | hit correction : 1.40068
hit initial : 121.592 | hit correction : 1.40089
hit initial : 226.734 | hit correction : 1.401
hit initial : 355.753 | hit correction : 1.40111
hit initial : 246.669 | hit correction : 1.40148
hit initial : 282.572 | hit correction : 1.4017
hit initial : 343.691 | hit correction : 1.40192
hit initial : 308.232 | hit correction : 1.40234
hit initial : 280.178 | hit correction : 1.40273
hit initial : 195.095 | hit correction : 1.40297
hit initial : 26.2523 | hit correction : 1.40306
 *** Total Charge : 4758.59
 Looking at view: 2 | Number of hits in view: 16
06-Dec-2025 19:23:42 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.147013      0.182174      0.279188      0.173473      0.0367506       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000484061   0.000738102   0.00149299    0.000681471   0.000270627      10     
end_path:ana:AnalyzeEvents         0.146203      0.181204      0.276937      0.172518      0.0363837       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7666.1 MB
  Peak resident set size usage (VmHWM): 1541.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:26 UTC       justIN version: 01.06.00