justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249784.3@dunegpschedd02.fnal.gov

Jobsub ID249784.3@dunegpschedd02.fnal.gov
Workflow ID10521
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 20:04:52
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-23 00:42:26
From worker nodeHostnamedunegli-7851207-0-fnpc19120.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 20:05:14
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T203110Z_gen_001654_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14540s)
CPU time3h (14396s = 99%)
Max RSS bytes3053625344 (2912 MiB)
Outputting started2025-11-23 00:07:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10521/1/001/analysisLowE_20251122T200514Z.root
Finished2025-11-23 00:42:26
Saved logsjustin-logs:249784.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.720986, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 16540 at 22-Nov-2025 23:43:04 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2025 00:06:48 UTC run: 3799 subRun: 0 event: 16540
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6912, 6766, 6746
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 455, 954
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.118273, 
Output 1: 0.0836075, 0.0798179, 0.131024, 0.705551, 
Output 2: 0.0396819, 0.187953, 0.750618, 0.0217465, 
Output 3: 0.970246, 0.0218262, 0.00283915, 0.0050887, 
Output 4: 0.602849, 0.333466, 0.0552005, 0.00848371, 
Output 5: 0.433318, 0.399238, 0.137368, 0.0300748, 
Output 6: 0.0236421, 0.0687879, 0.0798548, 0.827715, 

23-Nov-2025 00:06:50 UTC  Closed output file "matt_reco2.root"
23-Nov-2025 00:06:50 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/36/c0/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T203110Z_gen_001654_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1400.48       1441.84       1501.73       1444.56       28.4281        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00129465    0.00364276    0.00616428    0.00384813      0.00139        10     
reco:pandora:StandardPandora                            1399.22       1440.4        1500.43       1443.34       28.6029        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00185439     0.0146829     0.0777476    0.00615689     0.0221645       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00237394    0.00473847     0.0152973    0.00400242    0.00360744       10     
reco:pandoracalo:Calorimetry                          0.000282931    0.0072392     0.021329     0.00178585    0.00878995       10     
reco:pandorapid:Chi2ParticleID                         6.025e-05    0.000226354   0.00121207     8.366e-05    0.000337031      10     
reco:cvnmap:CVNMapper                                  0.0240821     0.0290114     0.0427108     0.0255958    0.00629266       10     
reco:cvneva:CVNEvaluator                               0.834239       1.02442       2.56333      0.851915      0.513239        10     
reco:energyrecnumu:EnergyReco                          0.0039424     0.0408212     0.0537121     0.0500958     0.017898        10     
reco:energyrecnue:EnergyReco                          0.000911553   0.00342317    0.00736128    0.00122186    0.00285425       10     
reco:energyrecnc:EnergyReco                           0.00656845     0.0220503     0.0699903    0.00694905     0.023716        10     
[art]:TriggerResults:TriggerResultInserter            1.3891e-05    2.28492e-05    8.737e-05     1.549e-05    2.15273e-05      10     
end_path:out1:RootOutput                               7.26e-06      9.876e-06     2.795e-05     7.81e-06     6.04068e-06      10     
end_path:out1:RootOutput(write)                        0.276298      0.287286      0.307527      0.284307      0.0105331       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21784.2 MB
  Peak resident set size usage (VmHWM): 3053.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 89.3655 | hit correction : 1.06887
hit initial : 149.71 | hit correction : 1.06886
hit initial : 101.536 | hit correction : 1.06968
hit initial : 312.337 | hit correction : 1.06977
hit initial : 238.637 | hit correction : 1.07016
hit initial : 365.46 | hit correction : 1.07078
hit initial : 159.506 | hit correction : 1.07085
hit initial : 207.346 | hit correction : 1.07092
 *** Total Charge : 1737.84
 Looking at view: 2 | Number of hits in view: 8
Begin processing the 9th record. run: 3799 subRun: 0 event: 16539 at 23-Nov-2025 00:07:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 5.30219
Completed MCParticle Loop
True Neutrino Energy: 9.02796
 Size of all hits: 0
Begin processing the 10th record. run: 3799 subRun: 0 event: 16540 at 23-Nov-2025 00:07:31 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  49
Added hit list length: 49 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Neutron Energy: 941.172
True Neutron Energy: 939.665
True Electron Energy: 48.6973
Completed MCParticle Loop
True Neutrino Energy: 66.0353
 Size of all hits: 49
hit initial : 62.7026 | hit correction : 1.17678
hit initial : 31.1491 | hit correction : 1.17752
hit initial : 93.3039 | hit correction : 1.17209
hit initial : 246.776 | hit correction : 1.17214
hit initial : 49.0766 | hit correction : 1.17273
hit initial : 247.175 | hit correction : 1.17227
hit initial : 43.2053 | hit correction : 1.17274
hit initial : 147.697 | hit correction : 1.17235
hit initial : 45.9638 | hit correction : 1.17527
hit initial : 120.59 | hit correction : 1.17535
hit initial : 547.464 | hit correction : 1.17525
hit initial : 199.941 | hit correction : 1.17528
hit initial : 97.6451 | hit correction : 1.17399
hit initial : 248.239 | hit correction : 1.17395
hit initial : 221.882 | hit correction : 1.17387
hit initial : 216.438 | hit correction : 1.17377
hit initial : 229.026 | hit correction : 1.17373
hit initial : 191.546 | hit correction : 1.17374
hit initial : 185.315 | hit correction : 1.17377
hit initial : 196.855 | hit correction : 1.17384
hit initial : 197.569 | hit correction : 1.17394
hit initial : 56.4866 | hit correction : 1.17457
hit initial : 185.161 | hit correction : 1.17406
hit initial : 218.922 | hit correction : 1.17412
hit initial : 344.753 | hit correction : 1.17408
hit initial : 307.45 | hit correction : 1.17417
hit initial : 230.116 | hit correction : 1.17427
hit initial : 216.584 | hit correction : 1.17435
hit initial : 246.334 | hit correction : 1.17445
 *** Total Charge : 6369.51
 Looking at view: 0 | Number of hits in view: 29
hit initial : 106.794 | hit correction : 1.17233
hit initial : 249.016 | hit correction : 1.17231
hit initial : 212.38 | hit correction : 1.17218
hit initial : 141.049 | hit correction : 1.17207
hit initial : 50.9819 | hit correction : 1.17206
hit initial : 82.142 | hit correction : 1.1752
hit initial : 57.1176 | hit correction : 1.17456
hit initial : 254.184 | hit correction : 1.17443
hit initial : 366.117 | hit correction : 1.17519
hit initial : 324.995 | hit correction : 1.17431
hit initial : 169.737 | hit correction : 1.17536
hit initial : 397.78 | hit correction : 1.17419
hit initial : 97.6881 | hit correction : 1.17541
hit initial : 441.696 | hit correction : 1.1741
hit initial : 373.961 | hit correction : 1.17402
hit initial : 358.799 | hit correction : 1.17386
hit initial : 370.631 | hit correction : 1.17376
hit initial : 428.414 | hit correction : 1.17378
hit initial : 400.109 | hit correction : 1.17388
hit initial : 148.535 | hit correction : 1.17395
 *** Total Charge : 5907.34
 Looking at view: 1 | Number of hits in view: 20
23-Nov-2025 00:07:34 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0739757     0.0954281      0.17309      0.089003      0.0274542       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000350481   0.00058988    0.00111434    0.000498396   0.000233394      10     
end_path:ana:AnalyzeEvents         0.0734819     0.0946684     0.172102      0.088473      0.0273292       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.7 MB
  Peak resident set size usage (VmHWM): 1535.98 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-08 21:37:59 UTC       justIN version: 01.06.00