justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263751.3@dunegpschedd01.fnal.gov

Jobsub ID263751.3@dunegpschedd01.fnal.gov
Workflow ID11029
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 10:59:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 07:07:51
From worker nodeHostnamedunegli-7832016-0-fnpc22014.fnal.gov
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 23:24:06
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T160429Z_gen_000165_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (27817s)
CPU time7h (27538s = 98%)
Max RSS bytes3027795968 (2887 MiB)
Outputting started2025-12-06 07:07:43
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11029/1/001/analysisLowE_20251205T232407Z.root
Finished2025-12-06 07:07:51
Saved logsjustin-logs:263751.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

fier summary: 
Output 0: 0.124474, 
Output 1: 0.0721922, 0.0837006, 0.0978446, 0.746263, 
Output 2: 0.0419584, 0.147314, 0.785526, 0.0252014, 
Output 3: 0.980624, 0.0079891, 0.00147782, 0.00990912, 
Output 4: 0.677096, 0.285736, 0.0311201, 0.00604791, 
Output 5: 0.26113, 0.389633, 0.255653, 0.0935835, 
Output 6: 0.0367672, 0.0723915, 0.0800228, 0.810819, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 1650 at 06-Dec-2025 06:51:44 UTC
Boundary wire vector sizes: 6839, 6774, 6686
minwire 0: 75
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 47, 546
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0961682, 
Output 1: 0.048008, 0.0318151, 0.0779949, 0.842182, 
Output 2: 0.101428, 0.223648, 0.64549, 0.0294337, 
Output 3: 0.97381, 0.020305, 0.00158221, 0.00430301, 
Output 4: 0.303193, 0.624759, 0.0661153, 0.00593245, 
Output 5: 0.598813, 0.34528, 0.0456059, 0.0103007, 
Output 6: 0.0297762, 0.0861512, 0.0922512, 0.791821, 

06-Dec-2025 07:07:07 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:07:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/01/ae/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T160429Z_gen_000165_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              920.064       2766.38       5315.75       2173.02       1491.03        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00267504     0.0162154     0.0478121     0.0150874     0.011698        10     
reco:pandora:StandardPandora                            918.891       2764.35       5314.02       2171.54       1490.25        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000558586    0.0799676     0.274651      0.0680996     0.0799345       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0010944    0.00404766      0.01354     0.00203554    0.00372183       10     
reco:pandoracalo:Calorimetry                          0.000234232    0.0125388     0.117653     0.000446104    0.035058        10     
reco:pandorapid:Chi2ParticleID                        8.8787e-05    0.000319958   0.00189387    0.000139799   0.000525935      10     
reco:cvnmap:CVNMapper                                  0.0308584     0.0808066      0.15049      0.0661642     0.0381415       10     
reco:cvneva:CVNEvaluator                               0.812784       1.41622       6.2309       0.883005       1.60568        10     
reco:energyrecnumu:EnergyReco                         0.00343822     0.068217      0.226944      0.0735648     0.0648263       10     
reco:energyrecnue:EnergyReco                          0.000893188   0.00287715    0.00973527    0.00211136    0.00264554       10     
reco:energyrecnc:EnergyReco                           0.00562954     0.0507694      0.16746      0.0347565     0.0513182       10     
[art]:TriggerResults:TriggerResultInserter            1.2684e-05    4.00588e-05   0.000160493   2.67055e-05   4.07012e-05      10     
end_path:out1:RootOutput                               1.036e-05    2.28852e-05   5.4512e-05    1.97425e-05   1.19359e-05      10     
end_path:out1:RootOutput(write)                        0.232126      0.301234      0.441869      0.276626      0.0626449       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38966.9 MB
  Peak resident set size usage (VmHWM): 3027.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 1060.23
 Looking at view: 1 | Number of hits in view: 8
hit initial : 20.1475 | hit correction : 1.10301
hit initial : 130.632 | hit correction : 1.10294
hit initial : 134.985 | hit correction : 1.10532
hit initial : 357.364 | hit correction : 1.10525
hit initial : 284.787 | hit correction : 1.10519
 *** Total Charge : 1025.23
 Looking at view: 2 | Number of hits in view: 5
Begin processing the 8th record. run: 5026 subRun: 0 event: 1648 at 06-Dec-2025 07:07:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  13
Added hit list length: 13 | Max was set to: -3.40282e+38
True Electron Energy: 8.15549
Completed MCParticle Loop
True Neutrino Energy: 11.4402
 Size of all hits: 13
hit initial : 21.6666 | hit correction : 1.01647
hit initial : 315.72 | hit correction : 1.01607
hit initial : 432.17 | hit correction : 1.01611
hit initial : 141.934 | hit correction : 1.01613
 *** Total Charge : 926.173
 Looking at view: 0 | Number of hits in view: 4
hit initial : 31.7662 | hit correction : 1.01577
hit initial : 90.2028 | hit correction : 1.0159
hit initial : 64.8171 | hit correction : 1.01616
hit initial : 104.018 | hit correction : 1.0162
hit initial : 21.4356 | hit correction : 1.01622
hit initial : 439.037 | hit correction : 1.01608
hit initial : 206.146 | hit correction : 1.01605
hit initial : 136.365 | hit correction : 1.01609
hit initial : 170.264 | hit correction : 1.01615
 *** Total Charge : 1284.38
 Looking at view: 2 | Number of hits in view: 9
Begin processing the 9th record. run: 5026 subRun: 0 event: 1649 at 06-Dec-2025 07:07:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 29.883
Completed MCParticle Loop
True Neutrino Energy: 44.4269
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 1650 at 06-Dec-2025 07:07:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  24
Added hit list length: 24 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Electron Energy: 7.77485
Completed MCParticle Loop
True Neutrino Energy: 13.1552
 Size of all hits: 24
hit initial : 51.3091 | hit correction : 1.09972
hit initial : 162.209 | hit correction : 1.09977
hit initial : 320.56 | hit correction : 1.10028
hit initial : 170.307 | hit correction : 1.10086
hit initial : 137.077 | hit correction : 1.10107
hit initial : 33.0977 | hit correction : 1.10109
hit initial : 94.0949 | hit correction : 1.1016
hit initial : 59.4878 | hit correction : 1.10163
 *** Total Charge : 1131.57
 Looking at view: 0 | Number of hits in view: 8
hit initial : 88.917 | hit correction : 1.09965
hit initial : 79.6205 | hit correction : 1.09572
hit initial : 67.6711 | hit correction : 1.0957
hit initial : 42.6468 | hit correction : 1.09964
hit initial : 155.502 | hit correction : 1.1002
hit initial : 228.81 | hit correction : 1.10021
hit initial : 131.055 | hit correction : 1.10034
hit initial : 144.993 | hit correction : 1.101
hit initial : 124.101 | hit correction : 1.10108
 *** Total Charge : 1169.37
 Looking at view: 1 | Number of hits in view: 9
hit initial : 13.5722 | hit correction : 1.0995
hit initial : 231.599 | hit correction : 1.0997
hit initial : 31.7986 | hit correction : 1.09913
hit initial : 87.941 | hit correction : 1.09947
hit initial : 231.877 | hit correction : 1.10015
hit initial : 350.82 | hit correction : 1.10087
hit initial : 125.081 | hit correction : 1.10107
 *** Total Charge : 1180.28
 Looking at view: 2 | Number of hits in view: 7
06-Dec-2025 07:07:42 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0544971     0.0659809     0.0785578     0.0666905    0.00661382       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000383545   0.000632333   0.00134027    0.000558235   0.000266569      10     
end_path:ana:AnalyzeEvents         0.0537129     0.0651709     0.0767528     0.0659205    0.00641393       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 36659 MB
  Peak resident set size usage (VmHWM): 1536.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:30 UTC       justIN version: 01.06.00