justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267117.0@dunegpschedd01.fnal.gov

Jobsub ID267117.0@dunegpschedd01.fnal.gov
Workflow ID11092
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:40:43
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 01:34:20
From worker nodeHostnamedunegli-8033258-0-fnpc23022.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:41:56
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031412Z_gen_004822_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6735s)
CPU time1h (6689s = 99%)
Max RSS bytes3042631680 (2901 MiB)
Outputting started2025-12-12 01:34:11
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11092/1/001/analysisLowE_20251211T234156Z.root
Finished2025-12-12 01:34:20
Saved logsjustin-logs:267117.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

mmary: 
Output 0: 0.139123, 
Output 1: 0.0912606, 0.0577376, 0.0762136, 0.774788, 
Output 2: 0.037288, 0.237241, 0.702377, 0.0230944, 
Output 3: 0.979562, 0.0103061, 0.00184856, 0.0082835, 
Output 4: 0.65692, 0.289247, 0.0468075, 0.00702477, 
Output 5: 0.273825, 0.507365, 0.189178, 0.0296331, 
Output 6: 0.0236621, 0.0475036, 0.0665036, 0.862331, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 48220 at 12-Dec-2025 01:22:10 UTC
Boundary wire vector sizes: 6796, 6786, 6797
minwire 0: 70
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0931417, 
Output 1: 0.0508162, 0.0653045, 0.10304, 0.78084, 
Output 2: 0.037358, 0.183234, 0.76292, 0.016488, 
Output 3: 0.953065, 0.0326436, 0.00515626, 0.00913495, 
Output 4: 0.520835, 0.35672, 0.101619, 0.0208265, 
Output 5: 0.461722, 0.422426, 0.0993098, 0.0165426, 
Output 6: 0.0244932, 0.0621489, 0.0760787, 0.837279, 

12-Dec-2025 01:33:43 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:33:43 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/cc/ae/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031412Z_gen_004822_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              629.458       664.633       726.909       660.196       32.1604        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00135116    0.00562273     0.0168224     0.0039572    0.00458084       10     
reco:pandora:StandardPandora                            628.468       663.462       724.408       659.168       31.8738        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000376057    0.0157374     0.085306     0.00385824     0.024469        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00047713    0.00342289     0.0112992    0.00278608    0.00283755       10     
reco:pandoracalo:Calorimetry                          0.000196956   0.00609666     0.0211556    0.000983992   0.00839887       10     
reco:pandorapid:Chi2ParticleID                        4.6719e-05    0.000247821   0.000807079   0.000159614   0.000246429      10     
reco:cvnmap:CVNMapper                                  0.0176081     0.024959      0.0479416     0.0209779    0.00904886       10     
reco:cvneva:CVNEvaluator                               0.695373      0.828213       1.96372      0.702597      0.378544        10     
reco:energyrecnumu:EnergyReco                          0.0019237     0.0462987     0.0976665     0.0558602     0.0364387       10     
reco:energyrecnue:EnergyReco                          0.000756874   0.00320161    0.00506881     0.0046711    0.00196455       10     
reco:energyrecnc:EnergyReco                           0.00453712     0.0239922     0.0544027    0.00486209     0.0236005       10     
[art]:TriggerResults:TriggerResultInserter             8.296e-06    1.61447e-05   5.3582e-05     1.067e-05    1.30999e-05      10     
end_path:out1:RootOutput                               3.297e-06    9.2849e-06    3.3294e-05    6.9285e-06    8.13313e-06      10     
end_path:out1:RootOutput(write)                        0.199072      0.213243      0.271109      0.209606      0.0198828       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21747.3 MB
  Peak resident set size usage (VmHWM): 3042.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 222.563 | hit correction : 1.43346
hit initial : 222.583 | hit correction : 1.43275
hit initial : 334.512 | hit correction : 1.43363
hit initial : 41.9486 | hit correction : 1.43385
 *** Total Charge : 2309.67
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 10th record. run: 5027 subRun: 0 event: 48220 at 12-Dec-2025 01:34:09 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  59
Added hit list length: 59 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Neutron Energy: 941.412
True Electron Energy: 40.0898
Completed MCParticle Loop
True Neutrino Energy: 57.3947
 Size of all hits: 59
hit initial : 96.9218 | hit correction : 1.14919
hit initial : 280.402 | hit correction : 1.14926
hit initial : 240.441 | hit correction : 1.14941
hit initial : 76.3028 | hit correction : 1.14952
hit initial : 43.0937 | hit correction : 1.14505
hit initial : 137.487 | hit correction : 1.14425
hit initial : 325.136 | hit correction : 1.14488
hit initial : 97.829 | hit correction : 1.14438
hit initial : 74.6306 | hit correction : 1.14403
hit initial : 470.683 | hit correction : 1.1458
hit initial : 76.8713 | hit correction : 1.14561
hit initial : 40.2689 | hit correction : 1.14838
hit initial : 174.549 | hit correction : 1.14905
hit initial : 143.737 | hit correction : 1.14909
hit initial : 20.5246 | hit correction : 1.14919
hit initial : 29.0747 | hit correction : 1.15263
hit initial : 364.562 | hit correction : 1.14717
hit initial : 364.946 | hit correction : 1.14781
hit initial : 449.644 | hit correction : 1.14833
hit initial : 205.261 | hit correction : 1.14843
 *** Total Charge : 4259.58
 Looking at view: 0 | Number of hits in view: 20
hit initial : 29.8983 | hit correction : 1.14303
hit initial : 119.733 | hit correction : 1.14604
hit initial : 74.802 | hit correction : 1.14517
hit initial : 53.4607 | hit correction : 1.14456
hit initial : 108.968 | hit correction : 1.14301
hit initial : 146.241 | hit correction : 1.14515
hit initial : 201.841 | hit correction : 1.14442
hit initial : 83.7828 | hit correction : 1.14301
hit initial : 136.363 | hit correction : 1.14838
hit initial : 69.7239 | hit correction : 1.14508
hit initial : 176.503 | hit correction : 1.14419
hit initial : 478.424 | hit correction : 1.14832
hit initial : 45.723 | hit correction : 1.14506
hit initial : 91.9826 | hit correction : 1.14411
hit initial : 39.9196 | hit correction : 1.14254
hit initial : 222.382 | hit correction : 1.14618
hit initial : 133.581 | hit correction : 1.14719
hit initial : 73.4286 | hit correction : 1.14793
hit initial : 36.9152 | hit correction : 1.14839
hit initial : 41.9986 | hit correction : 1.14911
hit initial : 30.7399 | hit correction : 1.14912
 *** Total Charge : 2746.4
 Looking at view: 1 | Number of hits in view: 21
hit initial : 23.8608 | hit correction : 1.14405
hit initial : 32.5923 | hit correction : 1.14406
hit initial : 22.1627 | hit correction : 1.1445
hit initial : 215.061 | hit correction : 1.14502
hit initial : 316.078 | hit correction : 1.14447
hit initial : 389.492 | hit correction : 1.14527
hit initial : 213.33 | hit correction : 1.14415
hit initial : 122.118 | hit correction : 1.14401
hit initial : 236.874 | hit correction : 1.14609
hit initial : 192.088 | hit correction : 1.14665
hit initial : 176.947 | hit correction : 1.14705
hit initial : 189.404 | hit correction : 1.14739
hit initial : 187.737 | hit correction : 1.14772
hit initial : 252.762 | hit correction : 1.14811
hit initial : 349.105 | hit correction : 1.14833
hit initial : 221.671 | hit correction : 1.14856
hit initial : 310.988 | hit correction : 1.14902
hit initial : 64.294 | hit correction : 1.14919
 *** Total Charge : 4032.2
 Looking at view: 2 | Number of hits in view: 18
12-Dec-2025 01:34:11 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0476215     0.0576708     0.073716      0.0598927    0.00818436       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000266348   0.000451056   0.000677352   0.000380265   0.000141178      10     
end_path:ana:AnalyzeEvents         0.0471508     0.0570951     0.0730574     0.0594539    0.00813912       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475 MB
  Peak resident set size usage (VmHWM): 1533.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:00 UTC       justIN version: 01.06.00