Jobsub ID 257717.48@dunegpschedd02.fnal.gov
| Jobsub ID | 257717.48@dunegpschedd02.fnal.gov |
| Workflow ID | 11006 |
| Stage ID | 1 |
| User name | osbiston@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-12-04 23:14:05 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-05 05:45:21 |
| From worker node | Hostname | dunegli-7828414-0-fnpc18002.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-05 00:17:34 |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225705Z_gen_000951_supernova_g4stage1_g4stage2_detsim_reco.root
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18945s) |
| CPU time | 5h (18878s = 99%) |
| Max RSS bytes | 3090460672 (2947 MiB) |
| Outputting started | 2025-12-05 05:33:19 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11006/1/001/analysisLowE_20251205T001734Z.root
|
| Finished | 2025-12-05 05:45:21 |
| Saved logs | justin-logs:257717.48-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ATUS_CODE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0005, LArDLVertexing, STATUS_CODE_NOT_INITIALIZED
Boundary wire vector sizes: 6656, 6573, 6653
minwire 0: 42
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1904, 2403
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.110199,
Output 1: 0.033532, 0.0317831, 0.0911454, 0.84354,
Output 2: 0.0669095, 0.28027, 0.610822, 0.0419994,
Output 3: 0.955745, 0.0276905, 0.00595003, 0.0106149,
Output 4: 0.213844, 0.651502, 0.125757, 0.0088975,
Output 5: 0.770297, 0.191645, 0.0312327, 0.00682533,
Output 6: 0.0163928, 0.0483174, 0.0669007, 0.868389,
05-Dec-2025 05:32:16 UTC Closed output file "matt_reco2.root"
05-Dec-2025 05:32:16 UTC Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/25/48/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225705Z_gen_000951_supernova_g4stage1_g4stage2_detsim_reco.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 1590.27 1875.97 2164.73 1886.7 134.262 10
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00154198 0.00855658 0.0278018 0.00539847 0.00789144 10
reco:pandora:StandardPandora 1586.43 1872.88 2160.92 1883.61 134.197 10
reco:pandoraTrack:LArPandoraTrackCreation 0.000339016 0.0280349 0.12131 0.0124904 0.0346302 10
reco:pandoraShower:LArPandoraModularShowerCreation 0.000375403 0.007281 0.0231002 0.00722269 0.00581142 10
reco:pandoracalo:Calorimetry 0.000588912 0.00865772 0.034903 0.002785 0.0119713 10
reco:pandorapid:Chi2ParticleID 8.7722e-05 0.000375774 0.0011538 0.0001884 0.000364073 10
reco:cvnmap:CVNMapper 0.0365839 0.0459501 0.0633427 0.0452712 0.0067357 10
reco:cvneva:CVNEvaluator 1.76766 2.40438 4.68142 1.9348 0.886495 10
reco:energyrecnumu:EnergyReco 0.00601225 0.0805031 0.161022 0.105999 0.0591872 10
reco:energyrecnue:EnergyReco 0.00153626 0.00586418 0.00986756 0.00617834 0.00373663 10
reco:energyrecnc:EnergyReco 0.00934765 0.0477082 0.122005 0.0120766 0.0465383 10
[art]:TriggerResults:TriggerResultInserter 2.1511e-05 3.65485e-05 8.4509e-05 2.9823e-05 1.7779e-05 10
end_path:out1:RootOutput 9.22e-06 1.32282e-05 2.8147e-05 1.08255e-05 5.48551e-06 10
end_path:out1:RootOutput(write) 0.364605 0.447883 0.634228 0.414374 0.0821787 10
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 21756.3 MB
Peak resident set size usage (VmHWM): 3090.46 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 381.27 | hit correction : 1.4075
hit initial : 156.301 | hit correction : 1.4077
*** Total Charge : 3931.97
Looking at view: 1 | Number of hits in view: 15
Begin processing the 9th record. run: 5027 subRun: 0 event: 9509 at 05-Dec-2025 05:33:11 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles: 2
This pfp has size: 55
Added hit list length: 55 | Max was set to: -3.40282e+38
True Electron Energy: 43.1052
Completed MCParticle Loop
True Neutrino Energy: 60.4597
Size of all hits: 55
hit initial : 101.312 | hit correction : 1.46618
hit initial : 44.8574 | hit correction : 1.47206
hit initial : 76.2382 | hit correction : 1.47551
hit initial : 192.316 | hit correction : 1.47536
hit initial : 212.964 | hit correction : 1.47524
hit initial : 215.174 | hit correction : 1.47515
hit initial : 168.294 | hit correction : 1.47505
hit initial : 170.317 | hit correction : 1.47488
hit initial : 179.93 | hit correction : 1.47467
hit initial : 164.326 | hit correction : 1.4745
hit initial : 204.856 | hit correction : 1.47436
hit initial : 223.803 | hit correction : 1.47419
hit initial : 209.886 | hit correction : 1.47402
hit initial : 221.299 | hit correction : 1.47379
hit initial : 212.906 | hit correction : 1.47358
hit initial : 220.173 | hit correction : 1.47334
hit initial : 257.631 | hit correction : 1.473
hit initial : 291.141 | hit correction : 1.47257
hit initial : 167.619 | hit correction : 1.47226
*** Total Charge : 5210.07
Looking at view: 0 | Number of hits in view: 19
hit initial : 78.1218 | hit correction : 1.47533
hit initial : 350.345 | hit correction : 1.47519
hit initial : 261.497 | hit correction : 1.47512
hit initial : 789.362 | hit correction : 1.47416
hit initial : 148.592 | hit correction : 1.47411
hit initial : 1080.62 | hit correction : 1.47405
hit initial : 174.24 | hit correction : 1.47233
hit initial : 241.67 | hit correction : 1.47254
hit initial : 36.1943 | hit correction : 1.47219
*** Total Charge : 4659.08
Looking at view: 1 | Number of hits in view: 9
hit initial : 40.0983 | hit correction : 1.4757
hit initial : 150.517 | hit correction : 1.47547
hit initial : 179.564 | hit correction : 1.47526
hit initial : 187.568 | hit correction : 1.47521
hit initial : 164.799 | hit correction : 1.47517
hit initial : 126.941 | hit correction : 1.47509
hit initial : 133.22 | hit correction : 1.47495
hit initial : 142.098 | hit correction : 1.47478
hit initial : 133.393 | hit correction : 1.47462
hit initial : 121.273 | hit correction : 1.47449
hit initial : 134.495 | hit correction : 1.47439
hit initial : 153.44 | hit correction : 1.4743
hit initial : 166.149 | hit correction : 1.47418
hit initial : 165.464 | hit correction : 1.47405
hit initial : 124.969 | hit correction : 1.4739
hit initial : 122.792 | hit correction : 1.47372
hit initial : 135.825 | hit correction : 1.47363
hit initial : 106.406 | hit correction : 1.4735
hit initial : 104.726 | hit correction : 1.47339
hit initial : 91.7698 | hit correction : 1.47325
hit initial : 103.652 | hit correction : 1.47312
hit initial : 90.535 | hit correction : 1.47297
hit initial : 127.778 | hit correction : 1.47256
hit initial : 112.882 | hit correction : 1.47274
hit initial : 130.533 | hit correction : 1.47231
hit initial : 117.988 | hit correction : 1.47211
hit initial : 34.9572 | hit correction : 1.47201
*** Total Charge : 5017.53
Looking at view: 2 | Number of hits in view: 27
Begin processing the 10th record. run: 5027 subRun: 0 event: 9510 at 05-Dec-2025 05:33:15 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles: 0
True Neutron Energy: 939.576
True Electron Energy: 1.95865
Completed MCParticle Loop
True Neutrino Energy: 5.24224
Size of all hits: 0
05-Dec-2025 05:33:18 UTC Closed input file "matt_reco2.root"
====================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================
Full event 0.0879347 0.106206 0.123758 0.10791 0.0107557 10
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000431347 0.000642676 0.00121673 0.000614439 0.00021979 10
end_path:ana:AnalyzeEvents 0.0872292 0.105341 0.121835 0.107292 0.0105487 10
====================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 19478.6 MB
Peak resident set size usage (VmHWM): 1536.91 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0 