justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266129.1@dunegpschedd01.fnal.gov

Jobsub ID266129.1@dunegpschedd01.fnal.gov
Workflow ID11093
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 16:27:08
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 19:28:16
From worker nodeHostnamedunegli-8028879-0-fnpc9056.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:47:38
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025313Z_gen_004310_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (38422s)
CPU time10h (37642s = 97%)
Max RSS bytes3031068672 (2890 MiB)
Outputting started2025-12-11 19:28:01
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11093/1/001/analysisLowE_20251211T084739Z.root
Finished2025-12-11 19:28:16
Saved logsjustin-logs:266129.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.0716721, 0.863393, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 43100 at 11-Dec-2025 18:32:55 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 19:26:35 UTC run: 5027 subRun: 0 event: 43100
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6894, 6852, 6698
minwire 0: 55
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 378, 877
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0853564, 
Output 1: 0.172748, 0.107807, 0.202307, 0.517138, 
Output 2: 0.044515, 0.128643, 0.80595, 0.0208928, 
Output 3: 0.936339, 0.0478889, 0.00719661, 0.00857566, 
Output 4: 0.778551, 0.205627, 0.0133977, 0.00242427, 
Output 5: 0.143857, 0.551796, 0.253715, 0.0506319, 
Output 6: 0.0993145, 0.216574, 0.127892, 0.55622, 

11-Dec-2025 19:26:38 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 19:26:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/08/1c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025313Z_gen_004310_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3215.61       3807.5        4477.55       3725.88       366.678        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0140811     0.0223534     0.0304315     0.0216385    0.00483165       10     
reco:pandora:StandardPandora                            3213.62       3764.19       4413.8        3662.68       344.44         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00533669     0.0631838     0.337052      0.0227331     0.0963546       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000725776    0.0137039     0.0635956     0.0101912     0.0175166       10     
reco:pandoracalo:Calorimetry                          0.000400129    0.0287676     0.0960855     0.0180302     0.0344766       10     
reco:pandorapid:Chi2ParticleID                        0.000149441   0.000796722   0.00612635    0.000203909   0.00177711       10     
reco:cvnmap:CVNMapper                                  0.0714279     0.112845      0.184798      0.111344      0.028109        10     
reco:cvneva:CVNEvaluator                                1.20374       2.92765       8.82871       2.2317        2.03919        10     
reco:energyrecnumu:EnergyReco                          0.0097405      19.1497       68.321       0.123143       29.1938        10     
reco:energyrecnue:EnergyReco                          0.00185252    0.00980434     0.0184746    0.00935651    0.00636783       10     
reco:energyrecnc:EnergyReco                            0.0138014      20.332        72.3364      0.0655716      31.0359        10     
[art]:TriggerResults:TriggerResultInserter            2.9737e-05    6.17488e-05   0.00022438    3.99435e-05   5.59361e-05      10     
end_path:out1:RootOutput                               8.53e-06     2.18996e-05   5.9594e-05    1.66125e-05   1.45928e-05      10     
end_path:out1:RootOutput(write)                        0.499152      0.652125      0.797257      0.663283      0.0719027       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12130.7 MB
  Peak resident set size usage (VmHWM): 3031.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 226.626 | hit correction : 1.3425
hit initial : 226.889 | hit correction : 1.34206
hit initial : 250.398 | hit correction : 1.34187
hit initial : 197.399 | hit correction : 1.34171
hit initial : 152.187 | hit correction : 1.34157
hit initial : 103.65 | hit correction : 1.34132
 *** Total Charge : 4465.75
 Looking at view: 0 | Number of hits in view: 19
hit initial : 239.757 | hit correction : 1.34653
hit initial : 139.335 | hit correction : 1.34517
hit initial : 18.8818 | hit correction : 1.34422
hit initial : 310.124 | hit correction : 1.34655
hit initial : 297.673 | hit correction : 1.34528
hit initial : 78.2364 | hit correction : 1.34661
hit initial : 11.2564 | hit correction : 1.3459
hit initial : 192.699 | hit correction : 1.34522
hit initial : 25.4625 | hit correction : 1.34226
hit initial : 108.344 | hit correction : 1.34154
hit initial : 56.0567 | hit correction : 1.34089
hit initial : 30.8761 | hit correction : 1.34141
hit initial : 25.2664 | hit correction : 1.34083
hit initial : 88.4148 | hit correction : 1.34359
hit initial : 350.517 | hit correction : 1.34355
hit initial : 267.216 | hit correction : 1.3429
hit initial : 222.427 | hit correction : 1.34224
hit initial : 248.038 | hit correction : 1.34196
hit initial : 232.732 | hit correction : 1.3418
hit initial : 206.811 | hit correction : 1.34163
 *** Total Charge : 4233.14
 Looking at view: 1 | Number of hits in view: 20
hit initial : 102.237 | hit correction : 1.34289
hit initial : 487.584 | hit correction : 1.34294
hit initial : 52.2638 | hit correction : 1.342
hit initial : 133.383 | hit correction : 1.34673
hit initial : 230.694 | hit correction : 1.34656
hit initial : 65.8156 | hit correction : 1.34651
hit initial : 192.469 | hit correction : 1.34645
hit initial : 229.515 | hit correction : 1.34593
hit initial : 223.488 | hit correction : 1.34531
hit initial : 236.208 | hit correction : 1.34478
hit initial : 258.888 | hit correction : 1.34395
hit initial : 553.197 | hit correction : 1.34179
hit initial : 305.751 | hit correction : 1.34176
hit initial : 73.5933 | hit correction : 1.34092
 *** Total Charge : 4226.63
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 9th record. run: 5027 subRun: 0 event: 43099 at 11-Dec-2025 19:27:49 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 57.8705
Completed MCParticle Loop
True Neutrino Energy: 63.4268
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 43100 at 11-Dec-2025 19:27:54 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  15
Added hit list length: 15 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Electron Energy: 11.1766
Completed MCParticle Loop
True Neutrino Energy: 16.5559
 Size of all hits: 15
hit initial : 79.1575 | hit correction : 1.39931
hit initial : 106.048 | hit correction : 1.39813
hit initial : 211.004 | hit correction : 1.39835
hit initial : 58.7974 | hit correction : 1.39825
hit initial : 179.295 | hit correction : 1.39899
hit initial : 224.775 | hit correction : 1.39908
hit initial : 211.899 | hit correction : 1.3992
 *** Total Charge : 1498.1
 Looking at view: 1 | Number of hits in view: 7
hit initial : 83.8204 | hit correction : 1.39942
hit initial : 129.573 | hit correction : 1.39928
hit initial : 107.667 | hit correction : 1.39908
hit initial : 129.213 | hit correction : 1.39904
hit initial : 171.821 | hit correction : 1.39904
hit initial : 140.504 | hit correction : 1.3989
hit initial : 176.211 | hit correction : 1.39814
hit initial : 136.04 | hit correction : 1.39813
 *** Total Charge : 1503.52
 Looking at view: 2 | Number of hits in view: 8
11-Dec-2025 19:28:00 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.113589      0.189026      0.532086      0.158099      0.116285        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000530498   0.00365539     0.0186036    0.000657305    0.0061779       10     
end_path:ana:AnalyzeEvents         0.112771      0.185161      0.518552      0.150964      0.113194        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9820.39 MB
  Peak resident set size usage (VmHWM): 1546.47 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:20:35 UTC       justIN version: 01.06.00