justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260977.1@dunegpschedd02.fnal.gov

Jobsub ID260977.1@dunegpschedd02.fnal.gov
Workflow ID11087
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 11:40:04
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 18:09:03
From worker nodeHostnamedunegli-7872479-0-fnpc9030.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 11:41:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163938Z_gen_000497_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (23237s)
CPU time6h (23042s = 99%)
Max RSS bytes3032788992 (2892 MiB)
Outputting started2025-12-11 18:08:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11087/1/001/analysisLowE_20251211T114128Z.root
Finished2025-12-11 18:09:03
Saved logsjustin-logs:260977.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0: 0.136273, 
Output 1: 0.0772076, 0.0740223, 0.168261, 0.680509, 
Output 2: 0.0480356, 0.186353, 0.738708, 0.0269034, 
Output 3: 0.965621, 0.0216897, 0.00416337, 0.00852615, 
Output 4: 0.433247, 0.486854, 0.0713055, 0.00859415, 
Output 5: 0.426115, 0.429066, 0.120231, 0.0245877, 
Output 6: 0.0280949, 0.0698293, 0.0787782, 0.823298, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 4970 at 11-Dec-2025 17:40:05 UTC
Boundary wire vector sizes: 6873, 6851, 6672
minwire 0: 47
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.154623, 
Output 1: 0.108305, 0.121968, 0.124271, 0.645456, 
Output 2: 0.0508044, 0.181655, 0.750115, 0.0174252, 
Output 3: 0.984447, 0.0102012, 0.00095036, 0.00440149, 
Output 4: 0.481157, 0.461733, 0.0502722, 0.00683804, 
Output 5: 0.216738, 0.586921, 0.164402, 0.0319394, 
Output 6: 0.0473602, 0.110798, 0.111167, 0.730675, 

11-Dec-2025 18:07:42 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 18:07:42 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/45/cc/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163938Z_gen_000497_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1651.7        2294.51        2802         2374.18       343.886        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00318444     0.0084453     0.0177503    0.00681689    0.00440116       10     
reco:pandora:StandardPandora                            1650.16       2291.78       2793.92       2372.37       342.845        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00131235     0.0357514     0.236742      0.0119545     0.0680888       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000543915    0.0133017     0.0415965    0.00650574     0.0141518       10     
reco:pandoracalo:Calorimetry                          0.000217197   0.00699751     0.0424175    0.000748225    0.012624        10     
reco:pandorapid:Chi2ParticleID                        8.7902e-05    0.000622298   0.00446334    0.000156936   0.00128907       10     
reco:cvnmap:CVNMapper                                  0.0556103     0.0766184     0.116239      0.0757018     0.0180346       10     
reco:cvneva:CVNEvaluator                                1.02867       1.95336       6.66783       1.42919       1.60777        10     
reco:energyrecnumu:EnergyReco                         0.00593854     0.0611287     0.140453      0.0421071     0.0535312       10     
reco:energyrecnue:EnergyReco                          0.00109713    0.00436368     0.012341     0.00222544    0.00380542       10     
reco:energyrecnc:EnergyReco                           0.00788133     0.0841699     0.198032      0.0832204     0.0679665       10     
[art]:TriggerResults:TriggerResultInserter            1.8817e-05    3.81118e-05   0.000154884   2.5724e-05    3.92292e-05      10     
end_path:out1:RootOutput                               7.046e-06    1.3126e-05    5.0645e-05     9.087e-06    1.25897e-05      10     
end_path:out1:RootOutput(write)                        0.335017      0.488011      0.721275      0.493625      0.133118        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12111.7 MB
  Peak resident set size usage (VmHWM): 3032.79 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 240.143 | hit correction : 1.11996
hit initial : 186.022 | hit correction : 1.12016
hit initial : 202.878 | hit correction : 1.12041
hit initial : 198.103 | hit correction : 1.12065
hit initial : 245.505 | hit correction : 1.12099
hit initial : 60.8801 | hit correction : 1.12112
 *** Total Charge : 6394.9
 Looking at view: 2 | Number of hits in view: 27
Begin processing the 8th record. run: 5026 subRun: 0 event: 4968 at 11-Dec-2025 18:08:33 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 26.4205
Completed MCParticle Loop
True Neutrino Energy: 33.5431
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 4969 at 11-Dec-2025 18:08:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 36.8283
Completed MCParticle Loop
True Neutrino Energy: 54.1373
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 4970 at 11-Dec-2025 18:08:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  46
Added hit list length: 46 | Max was set to: -3.40282e+38
True Neutron Energy: 939.573
True Electron Energy: 47.1709
Completed MCParticle Loop
True Neutrino Energy: 52.6027
 Size of all hits: 46
hit initial : 77.0013 | hit correction : 1.40235
hit initial : 90.1906 | hit correction : 1.40341
hit initial : 80.5736 | hit correction : 1.40339
hit initial : 30.4135 | hit correction : 1.40336
hit initial : 54.1626 | hit correction : 1.40264
hit initial : 179.62 | hit correction : 1.40316
hit initial : 128.976 | hit correction : 1.40227
hit initial : 81.8815 | hit correction : 1.40351
hit initial : 104.545 | hit correction : 1.40221
hit initial : 47.6229 | hit correction : 1.40218
hit initial : 37.9545 | hit correction : 1.40407
hit initial : 129.266 | hit correction : 1.40407
hit initial : 190.515 | hit correction : 1.4041
hit initial : 230.723 | hit correction : 1.40409
hit initial : 256.711 | hit correction : 1.4041
hit initial : 208.113 | hit correction : 1.40409
hit initial : 152.208 | hit correction : 1.40379
hit initial : 236.561 | hit correction : 1.40408
hit initial : 258.408 | hit correction : 1.40412
hit initial : 155.001 | hit correction : 1.40399
hit initial : 302.12 | hit correction : 1.40421
hit initial : 276.508 | hit correction : 1.40425
hit initial : 196.652 | hit correction : 1.40418
hit initial : 241.785 | hit correction : 1.40424
 *** Total Charge : 5260.84
 Looking at view: 0 | Number of hits in view: 24
hit initial : 253.937 | hit correction : 1.40271
hit initial : 218.734 | hit correction : 1.40226
hit initial : 94.4272 | hit correction : 1.40215
hit initial : 198.332 | hit correction : 1.40329
hit initial : 231.155 | hit correction : 1.40369
hit initial : 233.124 | hit correction : 1.40392
hit initial : 182.257 | hit correction : 1.40413
hit initial : 179.324 | hit correction : 1.40423
hit initial : 173.815 | hit correction : 1.40425
hit initial : 156.589 | hit correction : 1.40426
hit initial : 167.106 | hit correction : 1.40425
hit initial : 178.078 | hit correction : 1.4042
hit initial : 173.781 | hit correction : 1.40413
hit initial : 198.474 | hit correction : 1.4041
hit initial : 162.819 | hit correction : 1.40408
hit initial : 163.86 | hit correction : 1.40409
hit initial : 227.982 | hit correction : 1.4041
hit initial : 152.464 | hit correction : 1.40408
hit initial : 195.676 | hit correction : 1.40409
hit initial : 34.7702 | hit correction : 1.4041
hit initial : 165.99 | hit correction : 1.40409
hit initial : 114.076 | hit correction : 1.40409
 *** Total Charge : 5414.17
 Looking at view: 1 | Number of hits in view: 22
11-Dec-2025 18:08:44 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0720059     0.101183      0.182208      0.102377       0.0307         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000357828   0.00174615     0.0135555    0.000455941   0.00393668       10     
end_path:ana:AnalyzeEvents         0.0714234     0.0992756     0.168089      0.101816      0.0271922       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9809.4 MB
  Peak resident set size usage (VmHWM): 1528.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:14 UTC       justIN version: 01.06.00