justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264365.1@dunegpschedd01.fnal.gov

Jobsub ID264365.1@dunegpschedd01.fnal.gov
Workflow ID11030
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:05:54
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 19:13:58
From worker nodeHostnamedunegli-7832544-0-fnpc7304.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:06:35
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T232125Z_gen_001553_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time8h (29225s)
CPU time7h (28764s = 98%)
Max RSS bytes3029364736 (2889 MiB)
Outputting started2025-12-06 19:13:40
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11030/1/001/analysisLowE_20251206T110636Z.root
Finished2025-12-06 19:13:58
Saved logsjustin-logs:264365.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 0.158493, 0.764435, 0.0165256, 
Output 3: 0.915515, 0.0763083, 0.00435504, 0.00382189, 
Output 4: 0.497613, 0.452362, 0.0443444, 0.00568117, 
Output 5: 0.459177, 0.430652, 0.0887737, 0.0213973, 
Output 6: 0.0952112, 0.201237, 0.130657, 0.572895, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 15530 at 06-Dec-2025 18:30:55 UTC
Boundary wire vector sizes: 6446, 6478, 6426
minwire 0: 24
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 398, 897
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0555829, 
Output 1: 0.0588237, 0.039591, 0.0985339, 0.803051, 
Output 2: 0.132819, 0.264524, 0.565248, 0.0374089, 
Output 3: 0.882268, 0.10781, 0.00644343, 0.00347812, 
Output 4: 0.403121, 0.507122, 0.0802806, 0.00947602, 
Output 5: 0.898142, 0.0923931, 0.00721037, 0.00225466, 
Output 6: 0.0280243, 0.142984, 0.124939, 0.704053, 

06-Dec-2025 19:12:04 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 19:12:04 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/6c/eb/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T232125Z_gen_001553_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2460.39       2891.82       3280.07       2864.97       208.956        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00183376     0.0171985     0.0669282     0.0132096     0.0176866       10     
reco:pandora:StandardPandora                            2457.27       2887.93       3276.64       2859.25       208.964        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00159222     0.0406664       0.168       0.031726      0.047095        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00144813    0.00951084     0.0414243    0.00716716     0.0109241       10     
reco:pandoracalo:Calorimetry                          0.000789678   0.00803244     0.0487523    0.00162642     0.0141029       10     
reco:pandorapid:Chi2ParticleID                        0.000158478   0.000787131   0.00244228    0.000437687   0.000701986      10     
reco:cvnmap:CVNMapper                                  0.0605364     0.087469      0.153679      0.0784223     0.0254716       10     
reco:cvneva:CVNEvaluator                                2.15056       2.81323       5.7209        2.41166       1.03319        10     
reco:energyrecnumu:EnergyReco                          0.0302927      0.17575      0.253508      0.179014      0.0586033       10     
reco:energyrecnue:EnergyReco                          0.00272478     0.0098493     0.0181279     0.0105229    0.00626966       10     
reco:energyrecnc:EnergyReco                            0.0142538     0.0365445     0.218061      0.0151143     0.0605901       10     
[art]:TriggerResults:TriggerResultInserter            2.8952e-05    5.91211e-05   0.000123677   5.5355e-05    2.69027e-05      10     
end_path:out1:RootOutput                               9.878e-06    1.5542e-05    3.7253e-05    1.32525e-05   7.66575e-06      10     
end_path:out1:RootOutput(write)                        0.523047      0.694043      0.823926      0.701086      0.0777714       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9932.2 MB
  Peak resident set size usage (VmHWM): 3029.36 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 195.826 | hit correction : 1.26734
hit initial : 117.304 | hit correction : 1.26719
 *** Total Charge : 4031.73
 Looking at view: 1 | Number of hits in view: 18
hit initial : 25.7998 | hit correction : 1.26619
hit initial : 139.317 | hit correction : 1.27162
hit initial : 492.469 | hit correction : 1.27076
hit initial : 32.1791 | hit correction : 1.27092
hit initial : 54.5346 | hit correction : 1.27095
hit initial : 230.624 | hit correction : 1.27082
hit initial : 111.788 | hit correction : 1.26865
hit initial : 41.1175 | hit correction : 1.26866
hit initial : 167.919 | hit correction : 1.26864
hit initial : 128.742 | hit correction : 1.26853
hit initial : 32.1797 | hit correction : 1.26865
hit initial : 166.732 | hit correction : 1.26841
hit initial : 546.086 | hit correction : 1.26833
hit initial : 50.7838 | hit correction : 1.26725
hit initial : 197.49 | hit correction : 1.26719
hit initial : 323.649 | hit correction : 1.26721
hit initial : 305.538 | hit correction : 1.26789
hit initial : 368.23 | hit correction : 1.26741
 *** Total Charge : 4333.01
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 10th record. run: 5027 subRun: 0 event: 15530 at 06-Dec-2025 19:13:33 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  42
Added hit list length: 42 | Max was set to: -3.40282e+38
True Neutron Energy: 939.576
True Electron Energy: 39.6017
Completed MCParticle Loop
True Neutrino Energy: 45.0059
 Size of all hits: 42
hit initial : 64.1301 | hit correction : 1.45284
hit initial : 38.7263 | hit correction : 1.45284
hit initial : 43.5244 | hit correction : 1.44248
hit initial : 121.999 | hit correction : 1.44251
hit initial : 75.8226 | hit correction : 1.44253
hit initial : 107.826 | hit correction : 1.44249
hit initial : 84.551 | hit correction : 1.44109
hit initial : 56.2423 | hit correction : 1.44175
hit initial : 114.03 | hit correction : 1.44376
hit initial : 857.011 | hit correction : 1.44516
hit initial : 895.084 | hit correction : 1.4462
hit initial : 364.623 | hit correction : 1.4477
hit initial : 34.3004 | hit correction : 1.45097
 *** Total Charge : 4131.31
 Looking at view: 0 | Number of hits in view: 13
hit initial : 37.1305 | hit correction : 1.44107
hit initial : 539.821 | hit correction : 1.44492
hit initial : 214.424 | hit correction : 1.4417
hit initial : 85.855 | hit correction : 1.44145
hit initial : 31.4339 | hit correction : 1.44415
hit initial : 832.728 | hit correction : 1.44537
hit initial : 108.062 | hit correction : 1.44824
hit initial : 163.879 | hit correction : 1.44965
hit initial : 243.125 | hit correction : 1.45034
hit initial : 172.611 | hit correction : 1.45101
hit initial : 48.1017 | hit correction : 1.45124
 *** Total Charge : 3582.34
 Looking at view: 1 | Number of hits in view: 11
hit initial : 124.348 | hit correction : 1.44117
hit initial : 98.3535 | hit correction : 1.44102
hit initial : 40.8357 | hit correction : 1.45376
hit initial : 35.4448 | hit correction : 1.45371
hit initial : 128.836 | hit correction : 1.44246
hit initial : 123.784 | hit correction : 1.44252
hit initial : 44.1332 | hit correction : 1.44148
hit initial : 103.854 | hit correction : 1.44176
hit initial : 198.879 | hit correction : 1.44208
hit initial : 374.714 | hit correction : 1.44285
hit initial : 650.916 | hit correction : 1.44582
hit initial : 21.3033 | hit correction : 1.44605
hit initial : 363.694 | hit correction : 1.44607
hit initial : 113.269 | hit correction : 1.44769
hit initial : 245.459 | hit correction : 1.44941
hit initial : 220.35 | hit correction : 1.45034
hit initial : 164.446 | hit correction : 1.45109
hit initial : 35.3232 | hit correction : 1.45134
 *** Total Charge : 4464.1
 Looking at view: 2 | Number of hits in view: 18
06-Dec-2025 19:13:40 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0931159     0.191519      0.260533      0.198106      0.0471283       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000570692   0.00086478    0.00143214    0.000836631   0.000219497      10     
end_path:ana:AnalyzeEvents         0.0920144     0.190377      0.259295      0.196449      0.0470484       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7659.83 MB
  Peak resident set size usage (VmHWM): 1532.68 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:33 UTC       justIN version: 01.06.00