Jobsub ID 257717.49@dunegpschedd02.fnal.gov
| Jobsub ID | 257717.49@dunegpschedd02.fnal.gov |
| Workflow ID | 11006 |
| Stage ID | 1 |
| User name | osbiston@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-12-04 23:14:05 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-05 06:13:53 |
| From worker node | Hostname | dunegli-7828413-0-fnpc18002.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-05 00:16:51 |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T131729Z_gen_000323_supernova_g4stage1_g4stage2_detsim_reco.root
|
| Jobscript | Exit code | 0 |
| Real time | 5h (21388s) |
| CPU time | 5h (21340s = 99%) |
| Max RSS bytes | 3057655808 (2916 MiB) |
| Outputting started | 2025-12-05 06:13:20 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11006/1/001/analysisLowE_20251205T001653Z.root
|
| Finished | 2025-12-05 06:13:53 |
| Saved logs | justin-logs:257717.49-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
DE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0005, LArDLVertexing, STATUS_CODE_NOT_INITIALIZED
Boundary wire vector sizes: 6723, 6639, 6674
minwire 0: 22
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1700, 2199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.0772477,
Output 1: 0.0587253, 0.0950308, 0.116252, 0.729992,
Output 2: 0.0464601, 0.207974, 0.724835, 0.0207302,
Output 3: 0.950983, 0.033503, 0.00512344, 0.0103904,
Output 4: 0.511217, 0.411264, 0.0678236, 0.0096955,
Output 5: 0.643388, 0.2938, 0.0513704, 0.0114421,
Output 6: 0.0219649, 0.063133, 0.0743971, 0.840505,
05-Dec-2025 06:12:08 UTC Closed output file "matt_reco2.root"
05-Dec-2025 06:12:08 UTC Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3f/d6/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T131729Z_gen_000323_supernova_g4stage1_g4stage2_detsim_reco.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 1533.96 2114.43 2395.17 2212.6 256.264 10
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0012235 0.00686399 0.0224132 0.003834 0.00684259 10
reco:pandora:StandardPandora 1531.63 2111.24 2391.33 2208.22 255.914 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00151914 0.0209328 0.0869036 0.0101596 0.0247014 10
reco:pandoraShower:LArPandoraModularShowerCreation 0.00167894 0.00784988 0.0281071 0.00652807 0.00715361 10
reco:pandoracalo:Calorimetry 0.000265192 0.00381408 0.0282243 0.000541524 0.00828969 10
reco:pandorapid:Chi2ParticleID 7.0541e-05 0.000407014 0.00234852 0.000131234 0.00066084 10
reco:cvnmap:CVNMapper 0.029479 0.0690154 0.320471 0.0414073 0.0843418 10
reco:cvneva:CVNEvaluator 1.76962 2.39792 4.86162 1.93457 0.905009 10
reco:energyrecnumu:EnergyReco 0.00294253 0.0634578 0.121249 0.0661275 0.0466961 10
reco:energyrecnue:EnergyReco 0.0012404 0.00498757 0.0144246 0.00202585 0.00515011 10
reco:energyrecnc:EnergyReco 0.00935743 0.062198 0.164817 0.0497001 0.0539102 10
[art]:TriggerResults:TriggerResultInserter 1.5505e-05 4.07742e-05 0.000127323 3.44675e-05 2.98875e-05 10
end_path:out1:RootOutput 9.569e-06 1.49184e-05 4.2534e-05 1.22575e-05 9.29944e-06 10
end_path:out1:RootOutput(write) 0.361604 0.55439 1.02278 0.564336 0.183526 10
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 21787.7 MB
Peak resident set size usage (VmHWM): 3057.66 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 28.8353 | hit correction : 1.30309
hit initial : 33.8038 | hit correction : 1.30225
hit initial : 16.9145 | hit correction : 1.30219
hit initial : 193.363 | hit correction : 1.30218
hit initial : 35.5025 | hit correction : 1.30201
*** Total Charge : 8651.9
Looking at view: 2 | Number of hits in view: 44
Begin processing the 9th record. run: 4696 subRun: 0 event: 3229 at 05-Dec-2025 06:13:08 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles: 2
This pfp has size: 52
Added hit list length: 52 | Max was set to: -3.40282e+38
True Electron Energy: 35.625
Completed MCParticle Loop
True Neutrino Energy: 38.9605
Size of all hits: 52
hit initial : 48.3941 | hit correction : 1.05326
hit initial : 56.4943 | hit correction : 1.04255
hit initial : 83.9086 | hit correction : 1.04254
hit initial : 90.6845 | hit correction : 1.04432
hit initial : 358.017 | hit correction : 1.04436
hit initial : 289.008 | hit correction : 1.04444
hit initial : 62.6477 | hit correction : 1.04452
hit initial : 63.6158 | hit correction : 1.05191
hit initial : 624.733 | hit correction : 1.05202
hit initial : 372.471 | hit correction : 1.05196
hit initial : 508.756 | hit correction : 1.05226
hit initial : 420.011 | hit correction : 1.0525
hit initial : 522.368 | hit correction : 1.05269
hit initial : 591.328 | hit correction : 1.05281
hit initial : 306.39 | hit correction : 1.05288
*** Total Charge : 4621.66
Looking at view: 0 | Number of hits in view: 15
hit initial : 73.3814 | hit correction : 1.05196
hit initial : 258.516 | hit correction : 1.05194
hit initial : 266.725 | hit correction : 1.05194
hit initial : 235.847 | hit correction : 1.05197
hit initial : 263.287 | hit correction : 1.05205
hit initial : 239.886 | hit correction : 1.05222
hit initial : 224.396 | hit correction : 1.05233
hit initial : 220.706 | hit correction : 1.05241
hit initial : 223.697 | hit correction : 1.05252
hit initial : 218.966 | hit correction : 1.05262
hit initial : 214.466 | hit correction : 1.05268
hit initial : 225.173 | hit correction : 1.05273
hit initial : 201.916 | hit correction : 1.05279
hit initial : 268.695 | hit correction : 1.05287
hit initial : 232.05 | hit correction : 1.0529
hit initial : 162.029 | hit correction : 1.05292
hit initial : 53.1065 | hit correction : 1.05294
*** Total Charge : 3770.71
Looking at view: 1 | Number of hits in view: 17
hit initial : 169.122 | hit correction : 1.04254
hit initial : 246.136 | hit correction : 1.04431
hit initial : 212.256 | hit correction : 1.04432
hit initial : 326.752 | hit correction : 1.04452
hit initial : 37.7241 | hit correction : 1.04423
hit initial : 89.1093 | hit correction : 1.04962
hit initial : 345.484 | hit correction : 1.05195
hit initial : 158.896 | hit correction : 1.05192
hit initial : 171.751 | hit correction : 1.05194
hit initial : 369.424 | hit correction : 1.052
hit initial : 296.576 | hit correction : 1.05222
hit initial : 284.687 | hit correction : 1.05234
hit initial : 296.327 | hit correction : 1.05247
hit initial : 285.234 | hit correction : 1.05262
hit initial : 258.824 | hit correction : 1.05269
hit initial : 253.386 | hit correction : 1.05273
hit initial : 190.788 | hit correction : 1.05281
hit initial : 213.573 | hit correction : 1.05285
hit initial : 217.713 | hit correction : 1.0529
hit initial : 252.678 | hit correction : 1.05304
*** Total Charge : 4913.14
Looking at view: 2 | Number of hits in view: 20
Begin processing the 10th record. run: 4696 subRun: 0 event: 3230 at 05-Dec-2025 06:13:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles: 0
True Neutron Energy: 939.568
True Electron Energy: 3.49906
Completed MCParticle Loop
True Neutrino Energy: 7.22316
Size of all hits: 0
05-Dec-2025 06:13:19 UTC Closed input file "matt_reco2.root"
====================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================
Full event 0.122998 0.224546 0.680002 0.164613 0.160806 10
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000480726 0.0457261 0.271874 0.000610912 0.0925459 10
end_path:ana:AnalyzeEvents 0.122239 0.178587 0.407928 0.155118 0.0787522 10
====================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 19476.3 MB
Peak resident set size usage (VmHWM): 1537.17 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0 