justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249755.10@dunegpschedd02.fnal.gov

Jobsub ID249755.10@dunegpschedd02.fnal.gov
Workflow ID10523
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 19:10:16
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-22 21:18:52
From worker nodeHostnamedunegli-7851135-0-fnpc23034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 19:10:44
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T214422Z_gen_002740_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6434s)
CPU time1h (6382s = 99%)
Max RSS bytes3054112768 (2912 MiB)
Outputting started2025-11-22 20:57:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10523/1/001/analysisLowE_20251122T191045Z.root
Finished2025-11-22 21:18:52
Saved logsjustin-logs:249755.10-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.0553717, 0.0826527, 0.849734, 0.0122414, 
Output 3: 0.962506, 0.0314803, 0.00240024, 0.00361339, 
Output 4: 0.42809, 0.491242, 0.0670243, 0.0136431, 
Output 5: 0.461337, 0.422937, 0.0891929, 0.0265327, 
Output 6: 0.0972801, 0.170672, 0.103746, 0.628302, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 27400 at 22-Nov-2025 20:46:16 UTC
Boundary wire vector sizes: 6754, 6755, 6771
minwire 0: 11
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2006, 2505
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.133636, 
Output 1: 0.141681, 0.119509, 0.198615, 0.540195, 
Output 2: 0.0305456, 0.123119, 0.831148, 0.0151867, 
Output 3: 0.968779, 0.0148686, 0.00306264, 0.0132894, 
Output 4: 0.462472, 0.478882, 0.0510235, 0.00762217, 
Output 5: 0.247712, 0.497289, 0.202613, 0.052386, 
Output 6: 0.0455748, 0.0933305, 0.091776, 0.769319, 

22-Nov-2025 20:57:31 UTC  Closed output file "matt_reco2.root"
22-Nov-2025 20:57:31 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/68/62/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T214422Z_gen_002740_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              618.922       634.813       672.771       630.043       14.1724        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000885871   0.00372548    0.00555804    0.00421988    0.00146261       10     
reco:pandora:StandardPandora                            617.906       633.682       671.735       628.595       14.2149        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00147839     0.0142226     0.0600844    0.00503396     0.0175572       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00280887    0.00514347     0.0115105    0.00420882    0.00289249       10     
reco:pandoracalo:Calorimetry                          0.000138906   0.00244653     0.0199106    0.000259806   0.00585915       10     
reco:pandorapid:Chi2ParticleID                        3.8714e-05    0.000163627   0.000975983   6.71535e-05   0.000272781      10     
reco:cvnmap:CVNMapper                                  0.015889      0.0220306     0.030061      0.0226072    0.00408874       10     
reco:cvneva:CVNEvaluator                               0.688596      0.829978       2.0087       0.701873       0.39298        10     
reco:energyrecnumu:EnergyReco                         0.00216805     0.0179956     0.035991      0.0126871     0.0149981       10     
reco:energyrecnue:EnergyReco                          0.000771422   0.00126532    0.00478063    0.000868457   0.00117532       10     
reco:energyrecnc:EnergyReco                           0.00460646     0.0236782     0.0451771     0.0338515     0.0157805       10     
[art]:TriggerResults:TriggerResultInserter             9.549e-06    1.69684e-05   6.0436e-05    1.0981e-05    1.47374e-05      10     
end_path:out1:RootOutput                               6.482e-06    1.02636e-05    2.12e-05      7.595e-06    4.58019e-06      10     
end_path:out1:RootOutput(write)                        0.199701      0.209172      0.232761      0.206188     0.00923102       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21783.5 MB
  Peak resident set size usage (VmHWM): 3054.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 37.8704 | hit correction : 1.32612
hit initial : 82.0829 | hit correction : 1.32734
hit initial : 186.212 | hit correction : 1.32724
hit initial : 203.114 | hit correction : 1.3269
hit initial : 190.115 | hit correction : 1.32661
hit initial : 221.56 | hit correction : 1.32631
hit initial : 162.899 | hit correction : 1.32617
 *** Total Charge : 1437.93
 Looking at view: 1 | Number of hits in view: 7
hit initial : 75.9927 | hit correction : 1.32487
hit initial : 56.4582 | hit correction : 1.32738
hit initial : 368.686 | hit correction : 1.32711
hit initial : 508.942 | hit correction : 1.32644
hit initial : 150.391 | hit correction : 1.32621
 *** Total Charge : 1539.44
 Looking at view: 2 | Number of hits in view: 5
Begin processing the 10th record. run: 3799 subRun: 0 event: 27400 at 22-Nov-2025 20:57:57 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  50
Added hit list length: 50 | Max was set to: -3.40282e+38
True Neutron Energy: 939.926
True Electron Energy: 60.2369
Completed MCParticle Loop
True Neutrino Energy: 64.0487
 Size of all hits: 50
hit initial : 80.1179 | hit correction : 1.24952
hit initial : 77.3683 | hit correction : 1.24952
hit initial : 56.8102 | hit correction : 1.25698
hit initial : 47.2489 | hit correction : 1.25204
hit initial : 45.3995 | hit correction : 1.25001
hit initial : 33.7015 | hit correction : 1.25005
hit initial : 150.832 | hit correction : 1.25207
hit initial : 81.3979 | hit correction : 1.25211
hit initial : 54.3713 | hit correction : 1.25275
hit initial : 288.434 | hit correction : 1.25278
hit initial : 259.383 | hit correction : 1.25304
hit initial : 188.335 | hit correction : 1.25372
hit initial : 503.629 | hit correction : 1.25387
hit initial : 377.57 | hit correction : 1.254
hit initial : 237.944 | hit correction : 1.25439
hit initial : 290.208 | hit correction : 1.25507
hit initial : 364.976 | hit correction : 1.25558
hit initial : 379.119 | hit correction : 1.25615
hit initial : 206.226 | hit correction : 1.25674
 *** Total Charge : 4668.91
 Looking at view: 0 | Number of hits in view: 19
hit initial : 106.887 | hit correction : 1.25552
hit initial : 114.967 | hit correction : 1.25549
hit initial : 94.6096 | hit correction : 1.25387
hit initial : 53.233 | hit correction : 1.25204
hit initial : 133.947 | hit correction : 1.25292
hit initial : 79.663 | hit correction : 1.25216
hit initial : 384.91 | hit correction : 1.25591
hit initial : 69.5871 | hit correction : 1.25396
hit initial : 311.71 | hit correction : 1.2565
hit initial : 50.9532 | hit correction : 1.2569
hit initial : 71.529 | hit correction : 1.25207
hit initial : 56.5191 | hit correction : 1.25304
hit initial : 301.492 | hit correction : 1.25391
hit initial : 468.589 | hit correction : 1.25393
hit initial : 373.527 | hit correction : 1.25514
hit initial : 22.0011 | hit correction : 1.25555
 *** Total Charge : 3380.22
 Looking at view: 1 | Number of hits in view: 16
hit initial : 34.9637 | hit correction : 1.26001
hit initial : 43.4238 | hit correction : 1.25698
hit initial : 26.661 | hit correction : 1.25405
hit initial : 77.8969 | hit correction : 1.24999
hit initial : 19.7835 | hit correction : 1.24999
hit initial : 74.0349 | hit correction : 1.25205
hit initial : 408.989 | hit correction : 1.25225
hit initial : 277.321 | hit correction : 1.25294
hit initial : 488.099 | hit correction : 1.25371
hit initial : 346.397 | hit correction : 1.25386
hit initial : 277.628 | hit correction : 1.25399
hit initial : 238.58 | hit correction : 1.25434
hit initial : 285.824 | hit correction : 1.25492
hit initial : 480.837 | hit correction : 1.25562
hit initial : 458.241 | hit correction : 1.25652
 *** Total Charge : 4438.38
 Looking at view: 2 | Number of hits in view: 15
22-Nov-2025 20:57:59 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.046361      0.0570075     0.0718778     0.0553073    0.00855317       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000274003   0.000354259   0.000472381   0.000341797   5.90792e-05      10     
end_path:ana:AnalyzeEvents         0.0457907     0.0565331     0.0715121     0.0548707    0.00853812       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.9 MB
  Peak resident set size usage (VmHWM): 1537.91 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-08 21:40:45 UTC       justIN version: 01.06.00