justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266207.0@dunegpschedd01.fnal.gov

Jobsub ID266207.0@dunegpschedd01.fnal.gov
Workflow ID11088
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 17:51:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 11:35:53
From worker nodeHostnamedunegli-8024708-0-fnpc23117.fnal.gov
cpuinfoAMD EPYC 9354 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:58:17
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003658Z_gen_002549_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (9441s)
CPU time2h (9332s = 98%)
Max RSS bytes3195645952 (3047 MiB)
Outputting started2025-12-11 11:35:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11088/1/001/analysisLowE_20251211T085818Z.root
Finished2025-12-11 11:35:53
Saved logsjustin-logs:266207.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.00931543, 
Output 4: 0.471933, 0.491994, 0.0327407, 0.0033318, 
Output 5: 0.73497, 0.25376, 0.00952623, 0.00174372, 
Output 6: 0.0100268, 0.0348092, 0.0540528, 0.901111, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 25490 at 11-Dec-2025 11:18:00 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 11:34:57 UTC run: 5027 subRun: 0 event: 25490
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 7083, 7026, 6946
minwire 0: 17
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.116306, 
Output 1: 0.0575214, 0.0744827, 0.188987, 0.679008, 
Output 2: 0.0410657, 0.184133, 0.750831, 0.0239705, 
Output 3: 0.942955, 0.0390081, 0.00888777, 0.00914894, 
Output 4: 0.392269, 0.487208, 0.106589, 0.0139342, 
Output 5: 0.501162, 0.394172, 0.0896617, 0.0150048, 
Output 6: 0.0259173, 0.0794715, 0.0849275, 0.809684, 

11-Dec-2025 11:34:59 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 11:34:59 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b7/a0/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003658Z_gen_002549_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              654.153       930.268       1208.07       967.681       219.914        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00148528    0.00564892     0.0135796    0.00572417    0.00322386       10     
reco:pandora:StandardPandora                            653.195       929.018       1205.34       966.63        219.671        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00033602     0.0183034     0.0683956     0.0142814     0.0199037       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000717618   0.00289141     0.0104421    0.00108362    0.00331743       10     
reco:pandoracalo:Calorimetry                          0.000141765   0.00255202     0.0131542    0.000377363   0.00404096       10     
reco:pandorapid:Chi2ParticleID                        5.1498e-05    0.00021631    0.000778411   8.45135e-05   0.000276724      10     
reco:cvnmap:CVNMapper                                  0.0164646     0.0238817     0.0333132     0.0211435    0.00532255       10     
reco:cvneva:CVNEvaluator                               0.634444      0.824311       2.13669      0.684207      0.438609        10     
reco:energyrecnumu:EnergyReco                         0.00260442     0.0359537     0.136294      0.0081699     0.0428236       10     
reco:energyrecnue:EnergyReco                          0.000619009   0.00294261     0.0109755    0.00101477    0.00344482       10     
reco:energyrecnc:EnergyReco                            0.0040409     0.0433941      0.07749      0.0568283     0.0304909       10     
[art]:TriggerResults:TriggerResultInserter            1.4202e-05    2.71401e-05   0.000106211   1.80975e-05   2.6528e-05       10     
end_path:out1:RootOutput                               6.35e-06     9.3242e-06     2.656e-05     7.446e-06    5.77955e-06      10     
end_path:out1:RootOutput(write)                         0.19227       0.28916      0.330924      0.311519      0.0467345       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21926.3 MB
  Peak resident set size usage (VmHWM): 3195.65 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 107.48 | hit correction : 1.21792
hit initial : 160.27 | hit correction : 1.21799
hit initial : 55.5476 | hit correction : 1.218
hit initial : 159.761 | hit correction : 1.21894
hit initial : 556.628 | hit correction : 1.21893
hit initial : 537.717 | hit correction : 1.21887
hit initial : 128.105 | hit correction : 1.21885
 *** Total Charge : 2401.63
 Looking at view: 1 | Number of hits in view: 11
hit initial : 451.714 | hit correction : 1.21796
hit initial : 381.293 | hit correction : 1.21874
hit initial : 275.728 | hit correction : 1.21916
hit initial : 169.763 | hit correction : 1.21913
hit initial : 250.936 | hit correction : 1.21882
hit initial : 237.949 | hit correction : 1.21875
 *** Total Charge : 2153.83
 Looking at view: 2 | Number of hits in view: 6
Begin processing the 9th record. run: 5027 subRun: 0 event: 25489 at 11-Dec-2025 11:35:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 941.74
True Electron Energy: 12.6379
Completed MCParticle Loop
True Neutrino Energy: 28.1217
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 25490 at 11-Dec-2025 11:35:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  39
Added hit list length: 39 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Neutron Energy: 947.279
True Neutron Energy: 940.715
True Electron Energy: 21.7157
Completed MCParticle Loop
True Neutrino Energy: 43.7075
 Size of all hits: 39
hit initial : 52.1713 | hit correction : 1.14499
hit initial : 247.733 | hit correction : 1.14491
hit initial : 319.565 | hit correction : 1.14481
hit initial : 193.307 | hit correction : 1.14473
hit initial : 258.743 | hit correction : 1.14445
hit initial : 491.355 | hit correction : 1.1445
hit initial : 393.391 | hit correction : 1.14458
hit initial : 30.2915 | hit correction : 1.14321
hit initial : 24.2793 | hit correction : 1.14625
hit initial : 185.121 | hit correction : 1.14452
hit initial : 51.3652 | hit correction : 1.14319
hit initial : 89.1767 | hit correction : 1.1463
hit initial : 40.0879 | hit correction : 1.1444
hit initial : 167.408 | hit correction : 1.14638
hit initial : 48.2997 | hit correction : 1.14643
 *** Total Charge : 2967.67
 Looking at view: 0 | Number of hits in view: 15
hit initial : 66.1751 | hit correction : 1.14439
hit initial : 209.278 | hit correction : 1.14439
hit initial : 214.299 | hit correction : 1.1446
hit initial : 62.7867 | hit correction : 1.14633
hit initial : 169.72 | hit correction : 1.14634
hit initial : 82.6804 | hit correction : 1.14638
hit initial : 28.8273 | hit correction : 1.1447
hit initial : 132.124 | hit correction : 1.14474
hit initial : 259.115 | hit correction : 1.14484
hit initial : 516.39 | hit correction : 1.14455
hit initial : 378.138 | hit correction : 1.14446
 *** Total Charge : 2426.52
 Looking at view: 1 | Number of hits in view: 11
hit initial : 42.4109 | hit correction : 1.14215
hit initial : 23.6997 | hit correction : 1.14209
hit initial : 110.017 | hit correction : 1.14438
hit initial : 238.966 | hit correction : 1.14439
hit initial : 187.174 | hit correction : 1.14465
hit initial : 83.5119 | hit correction : 1.14471
hit initial : 401.827 | hit correction : 1.14488
hit initial : 113.49 | hit correction : 1.14482
hit initial : 96.9205 | hit correction : 1.1444
hit initial : 383.855 | hit correction : 1.14461
hit initial : 122.521 | hit correction : 1.14457
hit initial : 126.006 | hit correction : 1.14447
hit initial : 127.61 | hit correction : 1.14442
 *** Total Charge : 2355.46
 Looking at view: 2 | Number of hits in view: 13
11-Dec-2025 11:35:37 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0674945     0.0831315     0.100241      0.0851661     0.0090369       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000361248   0.000665237   0.00124179    0.000523529   0.000277545      10     
end_path:ana:AnalyzeEvents         0.0665021     0.0822564     0.0988302     0.0840557    0.00894307       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.5 MB
  Peak resident set size usage (VmHWM): 1542.75 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:46 UTC       justIN version: 01.06.00