justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267932.2@dunegpschedd01.fnal.gov

Jobsub ID267932.2@dunegpschedd01.fnal.gov
Workflow ID11176
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 09:12:27
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 18:49:26
From worker nodeHostnamedunegli-8047072-0-fnpc9021.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 09:14:04
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222452Z_gen_000259_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (34509s)
CPU time9h (34215s = 99%)
Max RSS bytes2796503040 (2666 MiB)
Outputting started2025-12-13 18:49:13
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11176/1/001/analysisLowE_20251213T091406Z.root
Finished2025-12-13 18:49:26
Saved logsjustin-logs:267932.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:47:52 UTC run: 5027 subRun: 0 event: 2590
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:47:52 UTC run: 5027 subRun: 0 event: 2590
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:47:52 UTC run: 5027 subRun: 0 event: 2590
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6664, 6495, 6508
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 679, 1178
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.108907, 
Output 1: 0.062244, 0.0677278, 0.0849506, 0.785078, 
Output 2: 0.0767805, 0.277225, 0.609044, 0.0369499, 
Output 3: 0.971848, 0.017726, 0.00279221, 0.0076338, 
Output 4: 0.789203, 0.174306, 0.0299935, 0.00649765, 
Output 5: 0.588766, 0.34542, 0.0557494, 0.0100649, 
Output 6: 0.0154474, 0.037605, 0.0537407, 0.893207, 

13-Dec-2025 18:47:56 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:47:56 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/fe/07/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222452Z_gen_000259_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2755.5        3418.95       4536.41       3302.95       442.132        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00127962    0.00592753     0.0248019    0.00188853    0.00830696       10     
reco:pandora:StandardPandora                            2753.03       3415.73       4533.05       3298.09       442.026        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0666563     0.118611      0.147642      0.123581      0.0234677       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00173117    0.00916523     0.0409836    0.00484085     0.0110654       10     
reco:pandoracalo:Calorimetry                          0.000462688   0.00215573    0.00787795    0.00111615    0.00221016       10     
reco:pandorapid:Chi2ParticleID                        0.000116979   0.000511496   0.00323749    0.000206979   0.000910415      10     
reco:cvnmap:CVNMapper                                  0.119731      0.148045      0.268767       0.13401      0.0425817       10     
reco:cvneva:CVNEvaluator                                1.41603       2.31216       5.70363       2.07158       1.1585         10     
reco:energyrecnumu:EnergyReco                          0.0897966     0.130404      0.200928      0.121191      0.0362293       10     
reco:energyrecnue:EnergyReco                          0.00192565    0.00348875    0.00783774    0.00285068    0.00170864       10     
reco:energyrecnc:EnergyReco                            0.011078      0.0131313     0.0227171     0.0119707    0.00328004       10     
[art]:TriggerResults:TriggerResultInserter            2.2333e-05    4.53733e-05   0.000157826   3.42165e-05   3.78984e-05      10     
end_path:out1:RootOutput                               8.815e-06    1.77788e-05   5.0945e-05    1.4209e-05    1.15395e-05      10     
end_path:out1:RootOutput(write)                        0.413973      0.478774      0.559328      0.459816      0.0502742       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11902.8 MB
  Peak resident set size usage (VmHWM): 2796.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  11
Added hit list length: 11 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  6
True Electron Energy: 7.64533
Completed MCParticle Loop
True Neutrino Energy: 13.1484
 Size of all hits: 11
hit initial : 86.202 | hit correction : 1.10531
hit initial : 277.79 | hit correction : 1.10536
hit initial : 320.189 | hit correction : 1.10544
hit initial : 212.074 | hit correction : 1.10562
 *** Total Charge : 990.763
 Looking at view: 0 | Number of hits in view: 4
hit initial : 83.4067 | hit correction : 1.10531
hit initial : 223.934 | hit correction : 1.10534
hit initial : 221.114 | hit correction : 1.10539
hit initial : 241.62 | hit correction : 1.10558
hit initial : 94.9391 | hit correction : 1.10578
 *** Total Charge : 956.242
 Looking at view: 1 | Number of hits in view: 5
hit initial : 474.978 | hit correction : 1.10535
hit initial : 451.07 | hit correction : 1.10557
 *** Total Charge : 1023.7
 Looking at view: 2 | Number of hits in view: 2
Begin processing the 9th record. run: 5027 subRun: 0 event: 2589 at 13-Dec-2025 18:49:02 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  9
Added hit list length: 9 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  8
True Electron Energy: 3.38038
Completed MCParticle Loop
True Neutrino Energy: 8.75835
 Size of all hits: 9
hit initial : 85.3957 | hit correction : 1.41612
hit initial : 134.355 | hit correction : 1.41609
hit initial : 74.3691 | hit correction : 1.41615
 *** Total Charge : 416.506
 Looking at view: 0 | Number of hits in view: 3
hit initial : 60.2066 | hit correction : 1.41603
hit initial : 134.435 | hit correction : 1.41609
hit initial : 59.3886 | hit correction : 1.41616
 *** Total Charge : 359.729
 Looking at view: 1 | Number of hits in view: 3
hit initial : 37.3871 | hit correction : 1.41587
hit initial : 180.016 | hit correction : 1.41609
hit initial : 65.0009 | hit correction : 1.41621
 *** Total Charge : 399.909
 Looking at view: 2 | Number of hits in view: 3
Begin processing the 10th record. run: 5027 subRun: 0 event: 2590 at 13-Dec-2025 18:49:07 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  7
This pfp has size:  7
Added hit list length: 7 | Max was set to: -3.40282e+38
This pfp has size:  6
This pfp has size:  6
This pfp has size:  4
This pfp has size:  3
True Neutron Energy: 945.612
True Neutron Energy: 940.144
True Neutron Energy: 939.756
True Electron Energy: 58.0119
Completed MCParticle Loop
True Neutrino Energy: 67.1364
 Size of all hits: 7
hit initial : 70.2048 | hit correction : 1.13601
hit initial : 37.5696 | hit correction : 1.13597
 *** Total Charge : 122.431
 Looking at view: 0 | Number of hits in view: 2
hit initial : 73.1559 | hit correction : 1.13599
hit initial : 30.8923 | hit correction : 1.13598
 *** Total Charge : 118.198
 Looking at view: 1 | Number of hits in view: 2
hit initial : 31.0585 | hit correction : 1.14869
hit initial : 47.4548 | hit correction : 1.13602
hit initial : 83.4996 | hit correction : 1.13597
 *** Total Charge : 184.439
 Looking at view: 2 | Number of hits in view: 3
13-Dec-2025 18:49:13 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.112948      0.150262      0.201563      0.146396      0.0257067       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000655001   0.00399704     0.0171021    0.000831466   0.00636252       10     
end_path:ana:AnalyzeEvents         0.112012      0.146009      0.183631      0.139431      0.0231276       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9809.51 MB
  Peak resident set size usage (VmHWM): 1537.43 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:20:55 UTC       justIN version: 01.06.00