justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261267.1@dunegpschedd02.fnal.gov

Jobsub ID261267.1@dunegpschedd02.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:12:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 01:49:39
From worker nodeHostnamedunegli-8033253-0-fnpc19140.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:13:19
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T020815Z_gen_003622_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (12965s)
CPU time3h (12875s = 99%)
Max RSS bytes3027881984 (2887 MiB)
Outputting started2025-12-12 01:49:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T221319Z.root
Finished2025-12-12 01:49:39
Saved logsjustin-logs:261267.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

7, 
Output 1: 0.082402, 0.0738592, 0.11109, 0.732649, 
Output 2: 0.0630096, 0.262368, 0.634669, 0.0399537, 
Output 3: 0.975532, 0.0125525, 0.00237101, 0.00954499, 
Output 4: 0.652578, 0.315506, 0.0286725, 0.00324416, 
Output 5: 0.619292, 0.301114, 0.0638675, 0.0157265, 
Output 6: 0.00967397, 0.0290103, 0.0461627, 0.915153, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 36220 at 12-Dec-2025 01:26:46 UTC
Boundary wire vector sizes: 6906, 6761, 6743
minwire 0: 12
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0794264, 
Output 1: 0.0796418, 0.105571, 0.163863, 0.650924, 
Output 2: 0.0204198, 0.0902849, 0.881771, 0.00752393, 
Output 3: 0.959816, 0.0320298, 0.00295978, 0.00519479, 
Output 4: 0.556611, 0.367174, 0.0631974, 0.0130175, 
Output 5: 0.288788, 0.450419, 0.209325, 0.0514674, 
Output 6: 0.0414263, 0.094339, 0.087571, 0.776664, 

12-Dec-2025 01:48:45 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:48:45 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/e1/4a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T020815Z_gen_003622_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1245.96       1284.58       1315.1        1285.97       19.074         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00122142    0.00634382     0.0200117     0.0035767    0.00649292       10     
reco:pandora:StandardPandora                            1244.8        1283.18       1313.94       1284.82       19.0503        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00130187     0.0222669     0.0588212     0.0246571     0.0154454       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00182008    0.00471918     0.0116958    0.00443379    0.00251437       10     
reco:pandoracalo:Calorimetry                          0.000194232   0.00261787     0.0197754    0.000323749   0.00575448       10     
reco:pandorapid:Chi2ParticleID                         4.793e-05    0.000228617   0.000815369   7.8206e-05    0.000275368      10     
reco:cvnmap:CVNMapper                                  0.0206325     0.0233554     0.0298533     0.0226957    0.00270038       10     
reco:cvneva:CVNEvaluator                               0.746348      0.974466       2.82547      0.751846      0.618249        10     
reco:energyrecnumu:EnergyReco                          0.0038048     0.0302027     0.0888208    0.00933603     0.0315296       10     
reco:energyrecnue:EnergyReco                          0.000811928   0.00200652    0.00646632    0.000849974    0.0022244       10     
reco:energyrecnc:EnergyReco                           0.00625243     0.0534879     0.0910933     0.0690378     0.0314838       10     
[art]:TriggerResults:TriggerResultInserter              9.1e-06     1.59412e-05   5.3321e-05    1.1645e-05    1.26458e-05      10     
end_path:out1:RootOutput                               5.76e-06      8.32e-06      1.893e-05     6.66e-06     3.97207e-06      10     
end_path:out1:RootOutput(write)                        0.269238      0.276887      0.339441      0.269828      0.0208627       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21782.2 MB
  Peak resident set size usage (VmHWM): 3027.88 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 168.451 | hit correction : 1.02303
hit initial : 85.9529 | hit correction : 1.02257
hit initial : 327.095 | hit correction : 1.02266
hit initial : 573.405 | hit correction : 1.01885
hit initial : 243.599 | hit correction : 1.01845
hit initial : 388.171 | hit correction : 1.01837
hit initial : 174.81 | hit correction : 1.01832
hit initial : 341.067 | hit correction : 1.01791
hit initial : 253.945 | hit correction : 1.01772
hit initial : 35.7398 | hit correction : 1.01675
hit initial : 123.812 | hit correction : 1.0182
hit initial : 173.213 | hit correction : 1.01816
hit initial : 17.5631 | hit correction : 1.019
hit initial : 273.712 | hit correction : 1.01941
hit initial : 463.21 | hit correction : 1.01978
hit initial : 50.231 | hit correction : 1.02002
hit initial : 509.182 | hit correction : 1.02025
hit initial : 532.175 | hit correction : 1.02076
hit initial : 492.766 | hit correction : 1.02136
hit initial : 250.397 | hit correction : 1.02176
hit initial : 507.69 | hit correction : 1.0221
 *** Total Charge : 6164.95
 Looking at view: 2 | Number of hits in view: 22
Begin processing the 9th record. run: 5027 subRun: 0 event: 36219 at 12-Dec-2025 01:49:19 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.42507
Completed MCParticle Loop
True Neutrino Energy: 6.70905
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 36220 at 12-Dec-2025 01:49:22 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  38
Added hit list length: 38 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 35.6415
Completed MCParticle Loop
True Neutrino Energy: 52.1889
 Size of all hits: 38
hit initial : 39.4436 | hit correction : 1.2131
hit initial : 55.7887 | hit correction : 1.21126
hit initial : 75.8107 | hit correction : 1.21315
hit initial : 50.9942 | hit correction : 1.21209
hit initial : 122.875 | hit correction : 1.2131
hit initial : 25.935 | hit correction : 1.20744
hit initial : 94.5249 | hit correction : 1.2121
hit initial : 130.538 | hit correction : 1.21128
hit initial : 234.817 | hit correction : 1.21086
hit initial : 318.535 | hit correction : 1.21043
hit initial : 244.902 | hit correction : 1.21005
hit initial : 236.275 | hit correction : 1.2096
hit initial : 266.039 | hit correction : 1.2094
hit initial : 251.567 | hit correction : 1.20934
hit initial : 234.39 | hit correction : 1.20933
hit initial : 192.022 | hit correction : 1.20929
hit initial : 179.84 | hit correction : 1.20917
hit initial : 188.07 | hit correction : 1.20906
hit initial : 189.134 | hit correction : 1.20901
hit initial : 217.443 | hit correction : 1.20898
hit initial : 212.983 | hit correction : 1.20895
hit initial : 120.247 | hit correction : 1.20895
 *** Total Charge : 4455.2
 Looking at view: 0 | Number of hits in view: 22
hit initial : 175.667 | hit correction : 1.21212
hit initial : 343.916 | hit correction : 1.21295
hit initial : 121.253 | hit correction : 1.21313
hit initial : 223.073 | hit correction : 1.2114
hit initial : 329.348 | hit correction : 1.21109
hit initial : 263.934 | hit correction : 1.2105
hit initial : 268.352 | hit correction : 1.21021
hit initial : 222.4 | hit correction : 1.20976
hit initial : 168.646 | hit correction : 1.20952
hit initial : 227.348 | hit correction : 1.20936
hit initial : 234.717 | hit correction : 1.20933
hit initial : 210.346 | hit correction : 1.20931
hit initial : 222.447 | hit correction : 1.20929
hit initial : 428.097 | hit correction : 1.20908
hit initial : 578.098 | hit correction : 1.20897
hit initial : 83.959 | hit correction : 1.20896
 *** Total Charge : 4963.74
 Looking at view: 2 | Number of hits in view: 16
12-Dec-2025 01:49:24 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0647719     0.0831541     0.106901      0.083549      0.0118042       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000326213   0.000636087   0.00147773    0.000440229   0.000338773      10     
end_path:ana:AnalyzeEvents         0.0638993     0.0823712     0.104969      0.0830199     0.0115882       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.6 MB
  Peak resident set size usage (VmHWM): 1531.64 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:18 UTC       justIN version: 01.06.00