justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262355.1@dunegpschedd02.fnal.gov

Jobsub ID262355.1@dunegpschedd02.fnal.gov
Workflow ID11170
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 22:37:06
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-14 09:11:43
From worker nodeHostnamedunegli-8066212-0-fnpc17126.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-14 03:30:43
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191853Z_gen_002124_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (20448s)
CPU time5h (19743s = 96%)
Max RSS bytes2800627712 (2670 MiB)
Outputting started2025-12-14 09:11:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11170/1/001/analysisLowE_20251214T033045Z.root
Finished2025-12-14 09:11:43
Saved logsjustin-logs:262355.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

oes not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  14-Dec-2025 09:10:10 UTC run: 5026 subRun: 0 event: 21240
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  14-Dec-2025 09:10:10 UTC run: 5026 subRun: 0 event: 21240
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6630, 6559, 6584
minwire 0: 42
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.149217, 
Output 1: 0.0807846, 0.0618672, 0.0896906, 0.767658, 
Output 2: 0.10737, 0.319789, 0.529579, 0.0432623, 
Output 3: 0.979053, 0.00996914, 0.00145402, 0.00952401, 
Output 4: 0.38862, 0.564333, 0.0437214, 0.00332497, 
Output 5: 0.531444, 0.414433, 0.0458283, 0.0082946, 
Output 6: 0.019477, 0.0440235, 0.0642234, 0.872276, 

14-Dec-2025 09:10:15 UTC  Closed output file "matt_reco2.root"
14-Dec-2025 09:10:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/24/7f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191853Z_gen_002124_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1838.97       1974.22       2317.43       1874.6        173.374        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000743629    0.0115392     0.0804507    0.00107969     0.0236066       10     
reco:pandora:StandardPandora                            1836.86       1972.01       2314.94       1873.01       173.29         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000364019    0.0473475     0.0743308     0.0649513      0.03103        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00034656    0.00373573     0.0104074    0.00246444    0.00313081       10     
reco:pandoracalo:Calorimetry                          0.000211987    0.0010865    0.00341485    0.000718581   0.00105788       10     
reco:pandorapid:Chi2ParticleID                        6.0566e-05    0.000278721   0.00127648    0.000167849   0.00034151       10     
reco:cvnmap:CVNMapper                                  0.104548       0.1236       0.161251      0.115759      0.0163817       10     
reco:cvneva:CVNEvaluator                               0.914994       1.44712       4.35005      0.988305      0.993121        10     
reco:energyrecnumu:EnergyReco                          0.0854794     0.106372      0.136748      0.100695      0.017477        10     
reco:energyrecnue:EnergyReco                          0.00168302    0.00371696     0.0101473    0.00228365    0.00318507       10     
reco:energyrecnc:EnergyReco                           0.00920287     0.0109161     0.0154766     0.0100827    0.00203885       10     
[art]:TriggerResults:TriggerResultInserter            1.7034e-05    2.68903e-05   8.7907e-05    2.0838e-05    2.04431e-05      10     
end_path:out1:RootOutput                               8.239e-06    1.12759e-05   2.5846e-05     9.554e-06    4.99452e-06      10     
end_path:out1:RootOutput(write)                        0.352088      0.460021      0.791843      0.375193      0.145267        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14063.2 MB
  Peak resident set size usage (VmHWM): 2800.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 252.722 | hit correction : 1.16012
 *** Total Charge : 6411.27
 Looking at view: 1 | Number of hits in view: 23
hit initial : 31.3307 | hit correction : 1.16438
hit initial : 68.0853 | hit correction : 1.20963
hit initial : 20.5276 | hit correction : 1.20965
hit initial : 170.343 | hit correction : 1.20965
hit initial : 48.3809 | hit correction : 1.20327
hit initial : 51.9523 | hit correction : 1.17408
hit initial : 165.809 | hit correction : 1.17348
hit initial : 652.753 | hit correction : 1.17322
hit initial : 610.208 | hit correction : 1.17326
hit initial : 32.8908 | hit correction : 1.17323
hit initial : 247.526 | hit correction : 1.17314
hit initial : 353.984 | hit correction : 1.17311
hit initial : 131.085 | hit correction : 1.1635
hit initial : 31.4867 | hit correction : 1.16353
hit initial : 89.7163 | hit correction : 1.16337
hit initial : 623.19 | hit correction : 1.16336
hit initial : 401.52 | hit correction : 1.16328
hit initial : 201.551 | hit correction : 1.16308
hit initial : 287.181 | hit correction : 1.16277
hit initial : 247.308 | hit correction : 1.16226
hit initial : 289.533 | hit correction : 1.16178
hit initial : 282.865 | hit correction : 1.1613
hit initial : 290.403 | hit correction : 1.16079
hit initial : 257.427 | hit correction : 1.16028
hit initial : 205.509 | hit correction : 1.15986
 *** Total Charge : 6769.89
 Looking at view: 2 | Number of hits in view: 25
Begin processing the 10th record. run: 5026 subRun: 0 event: 21240 at 14-Dec-2025 09:11:25 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  6
This pfp has size:  32
Added hit list length: 32 | Max was set to: -3.40282e+38
This pfp has size:  11
This pfp has size:  7
True Neutron Energy: 939.572
True Neutron Energy: 942.518
True Neutron Energy: 940.653
True Electron Energy: 22.5995
Completed MCParticle Loop
True Neutrino Energy: 38.1036
 Size of all hits: 32
hit initial : 26.3958 | hit correction : 1.4358
hit initial : 39.264 | hit correction : 1.4357
hit initial : 100.217 | hit correction : 1.4427
hit initial : 349.246 | hit correction : 1.44273
hit initial : 363.958 | hit correction : 1.44285
hit initial : 190.272 | hit correction : 1.44321
hit initial : 152.601 | hit correction : 1.44341
hit initial : 150.735 | hit correction : 1.44345
hit initial : 156.566 | hit correction : 1.44355
hit initial : 175.049 | hit correction : 1.44372
hit initial : 153.613 | hit correction : 1.44395
hit initial : 82.6549 | hit correction : 1.44406
 *** Total Charge : 2800.21
 Looking at view: 0 | Number of hits in view: 12
hit initial : 34.6883 | hit correction : 1.43573
hit initial : 47.0705 | hit correction : 1.43575
hit initial : 187.571 | hit correction : 1.44276
hit initial : 250.319 | hit correction : 1.44281
hit initial : 537.49 | hit correction : 1.44289
hit initial : 211.744 | hit correction : 1.4434
hit initial : 211.792 | hit correction : 1.44348
hit initial : 195.109 | hit correction : 1.44371
hit initial : 173.982 | hit correction : 1.44392
hit initial : 78.0851 | hit correction : 1.44406
 *** Total Charge : 2781.71
 Looking at view: 1 | Number of hits in view: 10
hit initial : 26.5942 | hit correction : 1.43579
hit initial : 66.0373 | hit correction : 1.43575
hit initial : 153.998 | hit correction : 1.44268
hit initial : 16.4505 | hit correction : 1.44273
hit initial : 339.962 | hit correction : 1.44275
hit initial : 120.158 | hit correction : 1.4427
hit initial : 288.021 | hit correction : 1.443
hit initial : 218.003 | hit correction : 1.44338
hit initial : 466.109 | hit correction : 1.44361
hit initial : 256.06 | hit correction : 1.4438
 *** Total Charge : 2815.58
 Looking at view: 2 | Number of hits in view: 10
14-Dec-2025 09:11:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.111133      0.141505      0.281088      0.120353      0.0499582       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000466995   0.000623912   0.00111991    0.000576814   0.000174243      10     
end_path:ana:AnalyzeEvents         0.110431      0.140652      0.280255      0.119633      0.0498551       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11961.4 MB
  Peak resident set size usage (VmHWM): 1539.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:07:44 UTC       justIN version: 01.06.00