justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258260.0@dunegpschedd02.fnal.gov

Jobsub ID258260.0@dunegpschedd02.fnal.gov
Workflow ID11026
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 22:51:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 12:10:32
From worker nodeHostnamedunegli-7989276-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:38:36
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T205052Z_gen_003256_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (37894s)
CPU time8h (31675s = 83%)
Max RSS bytes3051606016 (2910 MiB)
Outputting started2025-12-06 12:10:11
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11026/1/001/analysisLowE_20251206T013837Z.root
Finished2025-12-06 12:10:32
Saved logsjustin-logs:258260.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

he 10th record. run: 5026 subRun: 0 event: 32560 at 06-Dec-2025 11:27:34 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 12:08:43 UTC run: 5026 subRun: 0 event: 32560
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6900, 6808, 6736
minwire 0: 89
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2145, 2644
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0986208, 
Output 1: 0.0618951, 0.0498396, 0.125003, 0.763262, 
Output 2: 0.0651236, 0.204565, 0.708011, 0.0223008, 
Output 3: 0.970231, 0.0236711, 0.00194519, 0.0041527, 
Output 4: 0.197042, 0.717176, 0.0805007, 0.00528136, 
Output 5: 0.69979, 0.254872, 0.036195, 0.00914376, 
Output 6: 0.0235184, 0.0721409, 0.0814582, 0.822883, 

06-Dec-2025 12:08:48 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 12:08:49 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2b/ac/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T205052Z_gen_003256_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2274.77       3756.61       5011.37       4013.28       961.151        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00325828     0.0157908     0.0400019    0.00926458     0.0121998       10     
reco:pandora:StandardPandora                            2272.01       3751.33       5004.88       4008.36       959.88         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000907982    0.0724372     0.272871      0.0192701     0.0904774       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000855954    0.0118506     0.0572353    0.00265939     0.0168044       10     
reco:pandoracalo:Calorimetry                          0.00037106    0.00399266     0.0160365    0.000974913   0.00530803       10     
reco:pandorapid:Chi2ParticleID                        0.000147147   0.000941187   0.00401259    0.000252331   0.00139057       10     
reco:cvnmap:CVNMapper                                  0.0441167     0.134587      0.280031       0.11633      0.079216        10     
reco:cvneva:CVNEvaluator                                2.13127       3.95052       9.20325       3.66671       1.89342        10     
reco:energyrecnumu:EnergyReco                          0.011003      0.137673      0.264202      0.135083      0.0843891       10     
reco:energyrecnue:EnergyReco                          0.00203713     0.0111636     0.0295985     0.0100774    0.00829544       10     
reco:energyrecnc:EnergyReco                           0.00996901     0.0793062     0.256899      0.0208682     0.0930689       10     
[art]:TriggerResults:TriggerResultInserter            3.2341e-05    7.05661e-05   0.000209134   4.89475e-05   5.14793e-05      10     
end_path:out1:RootOutput                              1.0971e-05    2.63876e-05   0.00010064    1.41415e-05   2.67294e-05      10     
end_path:out1:RootOutput(write)                        0.397362      0.854929       1.63145      0.752732      0.380692        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21752.1 MB
  Peak resident set size usage (VmHWM): 3051.61 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Begin processing the 8th record. run: 5026 subRun: 0 event: 32558 at 06-Dec-2025 12:09:55 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 1.03444
Completed MCParticle Loop
True Neutrino Energy: 4.31796
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 32559 at 06-Dec-2025 12:10:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.8552
Completed MCParticle Loop
True Neutrino Energy: 9.35715
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 32560 at 06-Dec-2025 12:10:06 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  52
Added hit list length: 52 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 28.7175
Completed MCParticle Loop
True Neutrino Energy: 34.1017
 Size of all hits: 52
hit initial : 60.4339 | hit correction : 1.07322
hit initial : 37.8144 | hit correction : 1.07323
hit initial : 62.4238 | hit correction : 1.07192
hit initial : 213.002 | hit correction : 1.07194
hit initial : 120.454 | hit correction : 1.07195
hit initial : 135.053 | hit correction : 1.06945
hit initial : 284.843 | hit correction : 1.06962
hit initial : 279.017 | hit correction : 1.0699
hit initial : 190.7 | hit correction : 1.07114
hit initial : 46.8276 | hit correction : 1.07115
hit initial : 25.8289 | hit correction : 1.07015
hit initial : 17.7672 | hit correction : 1.07017
hit initial : 252.968 | hit correction : 1.07003
hit initial : 226.735 | hit correction : 1.07013
hit initial : 233.251 | hit correction : 1.07029
hit initial : 264.827 | hit correction : 1.07057
hit initial : 245.658 | hit correction : 1.07081
hit initial : 222.078 | hit correction : 1.07092
hit initial : 220.201 | hit correction : 1.07096
hit initial : 236.825 | hit correction : 1.071
hit initial : 261.299 | hit correction : 1.07107
 *** Total Charge : 3895.21
 Looking at view: 0 | Number of hits in view: 21
hit initial : 329.264 | hit correction : 1.07098
hit initial : 93.9138 | hit correction : 1.07035
hit initial : 559.937 | hit correction : 1.07099
hit initial : 94.5341 | hit correction : 1.07016
hit initial : 185.399 | hit correction : 1.07099
hit initial : 278.843 | hit correction : 1.07006
hit initial : 30.9484 | hit correction : 1.07206
hit initial : 307.806 | hit correction : 1.06989
hit initial : 146.627 | hit correction : 1.07198
hit initial : 295.297 | hit correction : 1.06956
hit initial : 185.314 | hit correction : 1.07189
hit initial : 110.667 | hit correction : 1.06952
hit initial : 49.0307 | hit correction : 1.07187
 *** Total Charge : 2856.02
 Looking at view: 1 | Number of hits in view: 13
hit initial : 491.838 | hit correction : 1.06995
hit initial : 209.778 | hit correction : 1.06939
hit initial : 220.022 | hit correction : 1.0701
hit initial : 213.293 | hit correction : 1.06965
hit initial : 185.649 | hit correction : 1.0702
hit initial : 178.656 | hit correction : 1.07036
hit initial : 269.027 | hit correction : 1.07063
hit initial : 165.121 | hit correction : 1.07082
hit initial : 142.49 | hit correction : 1.07092
hit initial : 147.267 | hit correction : 1.07095
hit initial : 155.914 | hit correction : 1.07096
hit initial : 161.814 | hit correction : 1.07097
hit initial : 147.252 | hit correction : 1.07101
hit initial : 166.328 | hit correction : 1.07108
hit initial : 232.118 | hit correction : 1.07115
hit initial : 25.8114 | hit correction : 1.07116
hit initial : 47.1374 | hit correction : 1.06811
hit initial : 28.1764 | hit correction : 1.06807
 *** Total Charge : 3412.09
 Looking at view: 2 | Number of hits in view: 18
06-Dec-2025 12:10:10 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.140493      0.156942      0.185755      0.150181      0.0166719       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000559655   0.000769734   0.00136498    0.000716987   0.000225404      10     
end_path:ana:AnalyzeEvents         0.139662       0.15585      0.184799      0.148505      0.0166668       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.8 MB
  Peak resident set size usage (VmHWM): 1538.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-12-19 14:51:36 UTC       justIN version: 01.05.03