justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261319.0@dunegpschedd02.fnal.gov

Jobsub ID261319.0@dunegpschedd02.fnal.gov
Workflow ID11112
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:36:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 02:38:42
From worker nodeHostnamedunegli-8035324-0-fnpc19121.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:38:14
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010339Z_gen_002970_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14416s)
CPU time3h (14296s = 99%)
Max RSS bytes2718846976 (2592 MiB)
Outputting started2025-12-12 02:38:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11112/1/001/analysisLowE_20251211T223815Z.root
Finished2025-12-12 02:38:42
Saved logsjustin-logs:261319.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

662, 
Output 5: 0.668217, 0.287263, 0.0367492, 0.00777133, 
Output 6: 0.0110668, 0.0323386, 0.0482555, 0.908339, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 29700 at 12-Dec-2025 02:14:18 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:37:48 UTC run: 5027 subRun: 0 event: 29700
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6832, 6744, 6819
minwire 0: 68
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0999379, 
Output 1: 0.0824431, 0.185263, 0.284398, 0.447896, 
Output 2: 0.0250994, 0.0653484, 0.90223, 0.0073227, 
Output 3: 0.954747, 0.0410012, 0.00222974, 0.00202247, 
Output 4: 0.539382, 0.398448, 0.0514805, 0.0106897, 
Output 5: 0.191535, 0.461218, 0.265811, 0.0814357, 
Output 6: 0.087522, 0.20521, 0.125201, 0.582067, 

12-Dec-2025 02:37:50 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:37:50 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/87/21/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010339Z_gen_002970_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1389.72       1427.72       1504.93       1417.22       31.8173        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00142413    0.00775227     0.0299979    0.00376747    0.00921158       10     
reco:pandora:StandardPandora                            1387.08       1426.38       1503.66       1416.04       31.9759        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000339044    0.0178547     0.0616501     0.0101781     0.0178723       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000299763   0.00528422     0.0181395    0.00394353    0.00506469       10     
reco:pandoracalo:Calorimetry                          0.000176112   0.00113996    0.00653838    0.000359398   0.00184832       10     
reco:pandorapid:Chi2ParticleID                         4.979e-05    0.000159776   0.000556625   7.6256e-05    0.000183943      10     
reco:cvnmap:CVNMapper                                  0.0229056     0.0339227     0.0922568     0.0277052     0.0200191       10     
reco:cvneva:CVNEvaluator                               0.760251      0.910214       2.09789      0.775233      0.396121        10     
reco:energyrecnumu:EnergyReco                         0.00671731     0.0380357     0.109076      0.0122661     0.0361987       10     
reco:energyrecnue:EnergyReco                          0.000784008   0.00261339    0.00675232    0.000936565   0.00259838       10     
reco:energyrecnc:EnergyReco                           0.00639833     0.0490299     0.0901693     0.0699347     0.0352225       10     
[art]:TriggerResults:TriggerResultInserter             1.131e-05    2.02302e-05   6.9481e-05    1.5345e-05    1.65103e-05      10     
end_path:out1:RootOutput                               6.45e-06     9.2501e-06     2.852e-05     7.125e-06    6.4311e-06       10     
end_path:out1:RootOutput(write)                        0.264855       0.27355      0.284655       0.27057     0.00669774       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21679.3 MB
  Peak resident set size usage (VmHWM): 2718.85 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 476.448 | hit correction : 1.19297
hit initial : 124.948 | hit correction : 1.19304
 *** Total Charge : 4440.5
 Looking at view: 1 | Number of hits in view: 16
hit initial : 250.307 | hit correction : 1.19105
hit initial : 51.525 | hit correction : 1.19094
hit initial : 230.689 | hit correction : 1.19172
hit initial : 144.371 | hit correction : 1.19189
hit initial : 770.354 | hit correction : 1.19175
hit initial : 149.533 | hit correction : 1.19178
hit initial : 512.105 | hit correction : 1.1918
hit initial : 343.512 | hit correction : 1.19225
hit initial : 311.493 | hit correction : 1.19278
hit initial : 245.691 | hit correction : 1.19331
hit initial : 211.8 | hit correction : 1.19382
hit initial : 199.826 | hit correction : 1.19437
hit initial : 169.413 | hit correction : 1.19474
hit initial : 169.975 | hit correction : 1.1952
hit initial : 60.6826 | hit correction : 1.19542
 *** Total Charge : 4556.99
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 9th record. run: 5027 subRun: 0 event: 29699 at 12-Dec-2025 02:38:25 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 11.8929
Completed MCParticle Loop
True Neutrino Energy: 15.1815
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 29700 at 12-Dec-2025 02:38:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  38
Added hit list length: 38 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Electron Energy: 29.424
Completed MCParticle Loop
True Neutrino Energy: 32.7342
 Size of all hits: 38
hit initial : 109.092 | hit correction : 1.19615
hit initial : 138.879 | hit correction : 1.19527
hit initial : 331.659 | hit correction : 1.19582
hit initial : 289.864 | hit correction : 1.19549
hit initial : 67.9393 | hit correction : 1.19534
hit initial : 933.465 | hit correction : 1.19549
hit initial : 213.621 | hit correction : 1.19543
hit initial : 893.265 | hit correction : 1.19541
 *** Total Charge : 3559.97
 Looking at view: 0 | Number of hits in view: 8
hit initial : 32.2557 | hit correction : 1.19521
hit initial : 114.794 | hit correction : 1.19522
hit initial : 200.399 | hit correction : 1.19522
hit initial : 249.615 | hit correction : 1.19524
hit initial : 274.871 | hit correction : 1.19526
hit initial : 269.515 | hit correction : 1.19531
hit initial : 276.8 | hit correction : 1.19548
hit initial : 565.271 | hit correction : 1.19569
hit initial : 699.875 | hit correction : 1.19576
hit initial : 304.635 | hit correction : 1.19585
hit initial : 40.0589 | hit correction : 1.19595
hit initial : 246.89 | hit correction : 1.19537
 *** Total Charge : 3915.34
 Looking at view: 1 | Number of hits in view: 12
hit initial : 127.859 | hit correction : 1.19522
hit initial : 183.079 | hit correction : 1.19522
hit initial : 193.14 | hit correction : 1.19524
hit initial : 263.104 | hit correction : 1.19524
hit initial : 198.977 | hit correction : 1.1953
hit initial : 219.973 | hit correction : 1.19532
hit initial : 157.548 | hit correction : 1.19549
hit initial : 154.277 | hit correction : 1.19554
hit initial : 160.618 | hit correction : 1.19562
hit initial : 141.505 | hit correction : 1.19578
hit initial : 245.413 | hit correction : 1.19604
hit initial : 340.836 | hit correction : 1.19611
hit initial : 182.713 | hit correction : 1.19581
hit initial : 216.758 | hit correction : 1.19554
hit initial : 183.191 | hit correction : 1.19525
hit initial : 24.3431 | hit correction : 1.19519
hit initial : 147.648 | hit correction : 1.19543
hit initial : 156.722 | hit correction : 1.19535
 *** Total Charge : 3942.5
 Looking at view: 2 | Number of hits in view: 18
12-Dec-2025 02:38:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0702972     0.0996651     0.133435      0.0959265     0.0215928       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000355834   0.00557557     0.0203746    0.000444935   0.00686113       10     
end_path:ana:AnalyzeEvents         0.0672044     0.0939154     0.125842      0.0893347     0.0192282       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.2 MB
  Peak resident set size usage (VmHWM): 1530.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:05 UTC       justIN version: 01.06.00