justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258196.0@dunegpschedd02.fnal.gov

Jobsub ID258196.0@dunegpschedd02.fnal.gov
Workflow ID11028
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 22:05:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 07:51:50
From worker nodeHostnamedunegli-7988603-0-fnpc9062.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:37:55
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222605Z_gen_000308_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22425s)
CPU time6h (22236s = 99%)
Max RSS bytes3081773056 (2939 MiB)
Outputting started2025-12-06 07:51:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11028/1/001/analysisLowE_20251206T013758Z.root
Finished2025-12-06 07:51:50
Saved logsjustin-logs:258196.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

616678, 
Output 4: 0.415638, 0.507887, 0.0691997, 0.00727588, 
Output 5: 0.448, 0.403378, 0.121143, 0.0274796, 
Output 6: 0.0330709, 0.1074, 0.106474, 0.753055, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 3080 at 06-Dec-2025 07:25:43 UTC
Boundary wire vector sizes: 6714, 6674, 6684
minwire 0: 43
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2109, 2608
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0670327, 
Output 1: 0.0399004, 0.0721814, 0.0851365, 0.802782, 
Output 2: 0.0425381, 0.173446, 0.759266, 0.02475, 
Output 3: 0.959363, 0.0241481, 0.00476111, 0.0117276, 
Output 4: 0.828042, 0.136658, 0.0272165, 0.00808343, 
Output 5: 0.614469, 0.270576, 0.0893625, 0.0255928, 
Output 6: 0.0173285, 0.0383539, 0.0493135, 0.895004, 

06-Dec-2025 07:50:36 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:50:36 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/ca/84/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222605Z_gen_000308_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1487.83       2213.15       2958.91       2302.92       462.836        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00188228    0.00865179     0.0240211    0.00579511    0.00670161       10     
reco:pandora:StandardPandora                            1486.24       2210.38       2952.29       2300.36       461.799        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00127459     0.0337626     0.153802      0.0221995     0.0426853       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00124549    0.00698684     0.0399147    0.00330401     0.0111304       10     
reco:pandoracalo:Calorimetry                          0.000234192   0.00240696     0.0111119    0.000499285   0.00387594       10     
reco:pandorapid:Chi2ParticleID                        6.4792e-05    0.000503147   0.00393819    0.000119823   0.00114551       10     
reco:cvnmap:CVNMapper                                  0.037025      0.059277      0.0969793     0.0538367     0.019144        10     
reco:cvneva:CVNEvaluator                                1.05152       1.9883        5.23699       1.82139       1.12784        10     
reco:energyrecnumu:EnergyReco                         0.00797255     0.0797323     0.208441      0.0622124     0.068322        10     
reco:energyrecnue:EnergyReco                          0.00109456    0.00366687     0.0124901    0.00195021    0.00365275       10     
reco:energyrecnc:EnergyReco                           0.00830665     0.0583688      0.18666      0.0459077     0.0547625       10     
[art]:TriggerResults:TriggerResultInserter            1.7027e-05    3.67317e-05   0.000150172   2.54415e-05   3.81242e-05      10     
end_path:out1:RootOutput                               5.77e-06     1.12262e-05   4.2815e-05    7.9975e-06    1.06532e-05      10     
end_path:out1:RootOutput(write)                         0.3593       0.530085      0.835781      0.537603      0.156943        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12130.2 MB
  Peak resident set size usage (VmHWM): 3081.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 150.808 | hit correction : 1.12591
hit initial : 146.599 | hit correction : 1.12589
hit initial : 566.586 | hit correction : 1.12592
hit initial : 550.162 | hit correction : 1.12594
hit initial : 499.871 | hit correction : 1.12691
hit initial : 149.269 | hit correction : 1.12695
hit initial : 388.323 | hit correction : 1.12696
hit initial : 722.591 | hit correction : 1.1269
hit initial : 609.38 | hit correction : 1.1271
hit initial : 273.572 | hit correction : 1.12727
 *** Total Charge : 7308.34
 Looking at view: 0 | Number of hits in view: 30
hit initial : 122.114 | hit correction : 1.11398
hit initial : 297.542 | hit correction : 1.11411
hit initial : 184.232 | hit correction : 1.11429
hit initial : 207.407 | hit correction : 1.12851
hit initial : 96.3193 | hit correction : 1.12427
hit initial : 200.805 | hit correction : 1.12428
hit initial : 73.8964 | hit correction : 1.1243
hit initial : 114.228 | hit correction : 1.12537
hit initial : 141.794 | hit correction : 1.12539
hit initial : 33.6897 | hit correction : 1.12734
hit initial : 60.3964 | hit correction : 1.12735
hit initial : 18.7006 | hit correction : 1.12736
hit initial : 119.857 | hit correction : 1.12506
hit initial : 230.098 | hit correction : 1.12531
hit initial : 137.818 | hit correction : 1.12561
hit initial : 115.513 | hit correction : 1.12583
hit initial : 429.203 | hit correction : 1.12587
hit initial : 620.37 | hit correction : 1.12595
hit initial : 248.412 | hit correction : 1.12602
hit initial : 16.4072 | hit correction : 1.12611
hit initial : 43.8463 | hit correction : 1.12693
hit initial : 225.644 | hit correction : 1.12695
hit initial : 351.412 | hit correction : 1.12694
hit initial : 542.711 | hit correction : 1.12684
hit initial : 475.83 | hit correction : 1.12686
hit initial : 291.013 | hit correction : 1.12704
hit initial : 312.925 | hit correction : 1.12718
hit initial : 268.543 | hit correction : 1.12729
hit initial : 111.897 | hit correction : 1.12733
hit initial : 15.6641 | hit correction : 1.12729
 *** Total Charge : 6872.86
 Looking at view: 1 | Number of hits in view: 30
hit initial : 35.644 | hit correction : 1.12236
hit initial : 33.5876 | hit correction : 1.12239
hit initial : 17.9029 | hit correction : 1.12638
hit initial : 263.378 | hit correction : 1.12427
hit initial : 128.907 | hit correction : 1.12432
hit initial : 126.222 | hit correction : 1.12543
hit initial : 163.627 | hit correction : 1.12535
hit initial : 23.4933 | hit correction : 1.12529
hit initial : 103.259 | hit correction : 1.12734
hit initial : 13.9036 | hit correction : 1.1273
hit initial : 248.176 | hit correction : 1.12509
hit initial : 275.445 | hit correction : 1.1256
hit initial : 360.538 | hit correction : 1.12585
hit initial : 454.785 | hit correction : 1.12588
hit initial : 364.798 | hit correction : 1.12597
hit initial : 227.666 | hit correction : 1.12607
hit initial : 13.7117 | hit correction : 1.12615
hit initial : 54.2086 | hit correction : 1.12691
hit initial : 196.38 | hit correction : 1.12689
hit initial : 151.797 | hit correction : 1.127
hit initial : 137.648 | hit correction : 1.12702
hit initial : 145.702 | hit correction : 1.12694
hit initial : 123.45 | hit correction : 1.12695
hit initial : 121.031 | hit correction : 1.12683
hit initial : 133.001 | hit correction : 1.12678
hit initial : 522.217 | hit correction : 1.12667
hit initial : 145.982 | hit correction : 1.12693
hit initial : 162.604 | hit correction : 1.12699
hit initial : 128.674 | hit correction : 1.12708
hit initial : 116.814 | hit correction : 1.12712
hit initial : 121.168 | hit correction : 1.12717
hit initial : 122.559 | hit correction : 1.12722
hit initial : 145.6 | hit correction : 1.12728
hit initial : 171.203 | hit correction : 1.12736
hit initial : 50.1724 | hit correction : 1.12737
hit initial : 40.038 | hit correction : 1.12715
 *** Total Charge : 6357.93
 Looking at view: 2 | Number of hits in view: 36
06-Dec-2025 07:51:39 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0727866     0.197892      0.522647      0.148106      0.140932        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000367607   0.000460022   0.000824219   0.000423377   0.000128285      10     
end_path:ana:AnalyzeEvents         0.0722921     0.197292      0.521409      0.147519       0.14077        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9818.91 MB
  Peak resident set size usage (VmHWM): 1545.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:57 UTC       justIN version: 01.06.00