justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267083.1@dunegpschedd01.fnal.gov

Jobsub ID267083.1@dunegpschedd01.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:44:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:04:15
From worker nodeHostnamedunegli-7875982-0-fnpc19111.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:46:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T164034Z_gen_000512_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (15441s)
CPU time4h (15308s = 99%)
Max RSS bytes3138809856 (2993 MiB)
Outputting started2025-12-12 03:03:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T224628Z.root
Finished2025-12-12 03:04:15
Saved logsjustin-logs:267083.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1: 0.0871125, 0.0522243, 0.079867, 0.780796, 
Output 2: 0.0451298, 0.217366, 0.702685, 0.0348186, 
Output 3: 0.962068, 0.0114024, 0.00409959, 0.0224298, 
Output 4: 0.823516, 0.152867, 0.0194474, 0.00416921, 
Output 5: 0.41499, 0.408113, 0.145329, 0.0315677, 
Output 6: 0.0221321, 0.0380639, 0.0505869, 0.889217, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 5120 at 12-Dec-2025 02:31:41 UTC
Boundary wire vector sizes: 6637, 6583, 6641
minwire 0: 63
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 441, 940
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.10452, 
Output 1: 0.164822, 0.062278, 0.129742, 0.643158, 
Output 2: 0.0226142, 0.116171, 0.847468, 0.0137472, 
Output 3: 0.976093, 0.00854104, 0.00200114, 0.0133646, 
Output 4: 0.637484, 0.327263, 0.0303731, 0.00488009, 
Output 5: 0.258011, 0.444548, 0.234333, 0.0631078, 
Output 6: 0.0320977, 0.0614229, 0.0668622, 0.839617, 

12-Dec-2025 03:02:48 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:02:48 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/29/eb/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T164034Z_gen_000512_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1438.01       1527.47       1862.44       1478.11       123.931        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00141453    0.00492066     0.0138235    0.00346361    0.00357116       10     
reco:pandora:StandardPandora                            1436.71       1525.89       1860.48       1476.82       123.772        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000730428    0.0235205     0.0620461     0.0253096     0.0174608       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00129688    0.00445614     0.0131986    0.00410101    0.00322726       10     
reco:pandoracalo:Calorimetry                          0.000287873    0.0033227     0.0223534    0.000364229   0.00655967       10     
reco:pandorapid:Chi2ParticleID                         6.448e-05    0.000191893   0.000581536   9.8476e-05    0.000182907      10     
reco:cvnmap:CVNMapper                                  0.0229725     0.0293651     0.0404255     0.0287887    0.00589305       10     
reco:cvneva:CVNEvaluator                                0.85151       1.09032       2.20055       0.8674       0.414026        10     
reco:energyrecnumu:EnergyReco                         0.00787275     0.0461025     0.142874      0.011914      0.0473947       10     
reco:energyrecnue:EnergyReco                          0.000858379   0.00301733    0.00775819    0.00130938    0.00289329       10     
reco:energyrecnc:EnergyReco                           0.00699778     0.052583      0.112601      0.0664021     0.0386858       10     
[art]:TriggerResults:TriggerResultInserter             1.233e-05    2.08654e-05   6.8221e-05    1.5156e-05    1.6072e-05       10     
end_path:out1:RootOutput                               7.82e-06     1.0346e-05     2.601e-05     8.76e-06     5.25709e-06      10     
end_path:out1:RootOutput(write)                        0.286127      0.323453      0.421759      0.301217      0.0471123       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21808.9 MB
  Peak resident set size usage (VmHWM): 3138.81 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  34
Added hit list length: 34 | Max was set to: -3.40282e+38
True Electron Energy: 51.1925
Completed MCParticle Loop
True Neutrino Energy: 56.7951
 Size of all hits: 34
hit initial : 34.8981 | hit correction : 1.13435
hit initial : 29.3459 | hit correction : 1.13433
hit initial : 36.3253 | hit correction : 1.13754
hit initial : 113.54 | hit correction : 1.13751
hit initial : 95.5568 | hit correction : 1.13613
hit initial : 141.675 | hit correction : 1.13565
hit initial : 168.949 | hit correction : 1.1375
hit initial : 637.648 | hit correction : 1.1357
hit initial : 53.9171 | hit correction : 1.13746
hit initial : 591.847 | hit correction : 1.13544
hit initial : 86.4843 | hit correction : 1.13541
hit initial : 64.0314 | hit correction : 1.13269
hit initial : 51.2979 | hit correction : 1.13202
hit initial : 360.115 | hit correction : 1.13431
hit initial : 358.553 | hit correction : 1.13387
hit initial : 438.374 | hit correction : 1.13286
hit initial : 269.181 | hit correction : 1.13246
hit initial : 91.0812 | hit correction : 1.13217
 *** Total Charge : 4110.9
 Looking at view: 0 | Number of hits in view: 18
hit initial : 35.0299 | hit correction : 1.13364
hit initial : 53.0508 | hit correction : 1.13756
hit initial : 84.0418 | hit correction : 1.13737
hit initial : 214.318 | hit correction : 1.13755
hit initial : 66.4286 | hit correction : 1.13613
hit initial : 266.787 | hit correction : 1.13609
hit initial : 150.662 | hit correction : 1.13584
hit initial : 310.715 | hit correction : 1.13562
hit initial : 445.488 | hit correction : 1.1355
hit initial : 291.406 | hit correction : 1.13504
hit initial : 464.767 | hit correction : 1.1343
hit initial : 344.034 | hit correction : 1.13375
hit initial : 185.593 | hit correction : 1.13316
hit initial : 141.062 | hit correction : 1.13268
hit initial : 327.463 | hit correction : 1.13247
hit initial : 195.788 | hit correction : 1.13201
 *** Total Charge : 4058.4
 Looking at view: 2 | Number of hits in view: 16
Begin processing the 10th record. run: 5026 subRun: 0 event: 5120 at 12-Dec-2025 03:03:44 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  22
Added hit list length: 22 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 18.3601
Completed MCParticle Loop
True Neutrino Energy: 25.4853
 Size of all hits: 22
hit initial : 54.6386 | hit correction : 1.29043
hit initial : 39.1179 | hit correction : 1.29064
hit initial : 72.8727 | hit correction : 1.29168
hit initial : 328.443 | hit correction : 1.2902
hit initial : 305.513 | hit correction : 1.29025
hit initial : 242.314 | hit correction : 1.29032
hit initial : 300.36 | hit correction : 1.2905
hit initial : 320.104 | hit correction : 1.29077
hit initial : 193.417 | hit correction : 1.29149
 *** Total Charge : 2396.32
 Looking at view: 0 | Number of hits in view: 9
hit initial : 44.2 | hit correction : 1.29197
hit initial : 161.502 | hit correction : 1.29197
hit initial : 139.857 | hit correction : 1.29137
hit initial : 129.961 | hit correction : 1.29177
hit initial : 28.7047 | hit correction : 1.29197
hit initial : 225.45 | hit correction : 1.29017
hit initial : 425.72 | hit correction : 1.29024
hit initial : 165.118 | hit correction : 1.29022
hit initial : 124.109 | hit correction : 1.29039
hit initial : 113.211 | hit correction : 1.2905
hit initial : 118.665 | hit correction : 1.29056
hit initial : 160.075 | hit correction : 1.29068
hit initial : 167.238 | hit correction : 1.29096
 *** Total Charge : 2586.42
 Looking at view: 2 | Number of hits in view: 13
12-Dec-2025 03:03:48 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.101807      0.124783      0.144247      0.124999      0.013328        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000430274   0.000665585   0.00129745    0.00050985    0.000273867      10     
end_path:ana:AnalyzeEvents         0.100774      0.123912      0.143599      0.123687      0.0134465       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.3 MB
  Peak resident set size usage (VmHWM): 1533.29 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:46 UTC       justIN version: 01.06.00