justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267593.0@dunegpschedd01.fnal.gov

Jobsub ID267593.0@dunegpschedd01.fnal.gov
Workflow ID11173
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 01:52:04
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 15:53:11
From worker nodeHostnamedunegli-8047095-0-fnpc9053.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 03:32:52
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002000Z_gen_002250_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time12h (44406s)
CPU time12h (43593s = 98%)
Max RSS bytes2797649920 (2668 MiB)
Outputting started2025-12-13 15:52:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11173/1/001/analysisLowE_20251213T033253Z.root
Finished2025-12-13 15:53:11
Saved logsjustin-logs:267593.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 15:51:52 UTC run: 5027 subRun: 0 event: 22500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6925, 6844, 6778
minwire 0: 37
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 647, 1146
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.101884, 
Output 1: 0.115535, 0.092454, 0.209644, 0.582367, 
Output 2: 0.0308327, 0.0827743, 0.87651, 0.009883, 
Output 3: 0.96823, 0.0255658, 0.0020361, 0.00416795, 
Output 4: 0.460685, 0.47401, 0.0551917, 0.0101131, 
Output 5: 0.279338, 0.449129, 0.203471, 0.0680613, 
Output 6: 0.0510288, 0.137631, 0.110823, 0.700517, 

13-Dec-2025 15:51:55 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 15:51:55 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/db/82/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002000Z_gen_002250_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3863.11       4407.59       5211.92       4224.93       477.439        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00192259    0.00495324     0.0173403    0.00238485    0.00522358       10     
reco:pandora:StandardPandora                            3860.06       4403.77       5208.97       4221.49       476.558        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000870977    0.130126       0.21362      0.164049      0.0716495       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000638366    0.0109958     0.0558572    0.00481187     0.0157585       10     
reco:pandoracalo:Calorimetry                          0.000589379   0.00244769     0.0153545    0.00103744    0.00431351       10     
reco:pandorapid:Chi2ParticleID                        0.00013438    0.000777578   0.00576456    0.000239064   0.00166316       10     
reco:cvnmap:CVNMapper                                  0.0996806     0.167621      0.220067      0.161234      0.033956        10     
reco:cvneva:CVNEvaluator                                1.26033       2.77452       9.8438        2.09025       2.38228        10     
reco:energyrecnumu:EnergyReco                          0.102512      0.154195      0.258865      0.143552      0.0462861       10     
reco:energyrecnue:EnergyReco                          0.00237858    0.00702309     0.0188663    0.00413361    0.00595667       10     
reco:energyrecnc:EnergyReco                            0.0102739     0.0181153     0.0421397     0.0165067     0.0084866       10     
[art]:TriggerResults:TriggerResultInserter            2.7576e-05    5.96648e-05   0.000208338   4.55495e-05   5.02341e-05      10     
end_path:out1:RootOutput                               9.813e-06    2.06466e-05   5.9822e-05    1.6816e-05    1.3507e-05       10     
end_path:out1:RootOutput(write)                        0.388226      0.551562      0.854373      0.536637      0.123429        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11905.3 MB
  Peak resident set size usage (VmHWM): 2797.65 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 179.924 | hit correction : 1.01053
hit initial : 277.177 | hit correction : 1.01001
hit initial : 250.181 | hit correction : 1.01143
hit initial : 266.167 | hit correction : 1.01002
hit initial : 174.689 | hit correction : 1.0118
hit initial : 181.343 | hit correction : 1.02804
hit initial : 136.21 | hit correction : 1.03041
hit initial : 39.2351 | hit correction : 1.0304
hit initial : 104.713 | hit correction : 1.03095
hit initial : 252.208 | hit correction : 1.032
hit initial : 188.417 | hit correction : 1.03285
hit initial : 123.083 | hit correction : 1.03314
hit initial : 492.129 | hit correction : 1.03371
hit initial : 395.451 | hit correction : 1.03421
hit initial : 12.6478 | hit correction : 1.03452
hit initial : 534.262 | hit correction : 1.03503
hit initial : 507.836 | hit correction : 1.0354
hit initial : 72.9185 | hit correction : 1.03532
hit initial : 217.322 | hit correction : 1.03599
hit initial : 72.0582 | hit correction : 1.03605
 *** Total Charge : 5215.27
 Looking at view: 0 | Number of hits in view: 23
hit initial : 160.069 | hit correction : 1.00625
hit initial : 346.101 | hit correction : 1.00945
hit initial : 18.6932 | hit correction : 1.0107
hit initial : 237.187 | hit correction : 1.01006
hit initial : 179.831 | hit correction : 1.01145
hit initial : 527.069 | hit correction : 1.01008
hit initial : 139.008 | hit correction : 1.01135
hit initial : 93.8222 | hit correction : 1.01195
hit initial : 111.934 | hit correction : 1.02801
hit initial : 149.15 | hit correction : 1.02808
hit initial : 153.225 | hit correction : 1.03043
hit initial : 196.453 | hit correction : 1.03053
hit initial : 351.159 | hit correction : 1.03121
hit initial : 257.657 | hit correction : 1.03187
hit initial : 102.807 | hit correction : 1.03209
hit initial : 68.1389 | hit correction : 1.03261
hit initial : 410.915 | hit correction : 1.03291
hit initial : 225.707 | hit correction : 1.03301
hit initial : 244.223 | hit correction : 1.03352
hit initial : 34.5376 | hit correction : 1.03383
hit initial : 58.3102 | hit correction : 1.03453
hit initial : 149.982 | hit correction : 1.03457
hit initial : 70.471 | hit correction : 1.03509
hit initial : 116.309 | hit correction : 1.03509
hit initial : 13.041 | hit correction : 1.03509
hit initial : 88.3486 | hit correction : 1.03599
 *** Total Charge : 4611.46
 Looking at view: 1 | Number of hits in view: 26
hit initial : 28.599 | hit correction : 1.01301
hit initial : 230.897 | hit correction : 1.00622
hit initial : 28.8869 | hit correction : 1.00634
hit initial : 377.303 | hit correction : 1.0095
hit initial : 255.567 | hit correction : 1.00937
hit initial : 256.401 | hit correction : 1.01013
hit initial : 244.464 | hit correction : 1.0099
hit initial : 184.262 | hit correction : 1.01052
hit initial : 566.611 | hit correction : 1.01122
hit initial : 312.458 | hit correction : 1.01007
hit initial : 194.599 | hit correction : 1.01192
hit initial : 336.511 | hit correction : 1.02804
hit initial : 203.631 | hit correction : 1.03034
hit initial : 345.376 | hit correction : 1.03067
hit initial : 430.396 | hit correction : 1.03148
hit initial : 194.022 | hit correction : 1.03198
hit initial : 246.178 | hit correction : 1.03228
hit initial : 292.131 | hit correction : 1.03271
hit initial : 191.824 | hit correction : 1.03306
hit initial : 156.621 | hit correction : 1.03326
hit initial : 175.046 | hit correction : 1.03348
hit initial : 210.052 | hit correction : 1.03369
hit initial : 212.106 | hit correction : 1.03396
hit initial : 250.147 | hit correction : 1.03429
hit initial : 219.791 | hit correction : 1.03464
hit initial : 443.097 | hit correction : 1.03505
hit initial : 203.228 | hit correction : 1.03535
hit initial : 242.867 | hit correction : 1.03569
hit initial : 244.958 | hit correction : 1.03603
hit initial : 45.8669 | hit correction : 1.03621
 *** Total Charge : 7503.87
 Looking at view: 2 | Number of hits in view: 30
13-Dec-2025 15:52:58 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0760355     0.108087      0.175743      0.105993      0.0263992       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000557574   0.000764903   0.00178169    0.000672767   0.000344002      10     
end_path:ana:AnalyzeEvents         0.0751536     0.107061      0.173211       0.10518      0.0259921       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9807.1 MB
  Peak resident set size usage (VmHWM): 1535.08 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:05:54 UTC       justIN version: 01.06.00