Jobsub ID 255878.0@dunegpschedd01.fnal.gov
| Jobsub ID | 255878.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10562 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-23 23:09:34 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc01 |
| Last heartbeat | 2025-11-24 02:53:41 |
| From worker node | Hostname | wn-la-05.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-11-23 23:10:17 |
| Input files | monte-carlo-010562-000001
|
| Outputting started | 2025-11-24 02:53:41 |
| Output files | |
| Finished | 2025-11-24 03:37:36 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
3 32031 XUs and 32218 XVs -> 306 XUVs
C:0 T:4 13723 XUs and 15950 XVs -> 210 XUVs
C:0 T:5 58377 XUs and 83440 XVs -> 12047 XUVs
C:0 T:6 96404 XUs and 118337 XVs -> 7265 XUVs
C:0 T:7 40100 XUs and 39301 XVs -> 345 XUVs
C:0 T:8 4667 XUs and 4832 XVs -> 107 XUVs
C:0 T:9 67768 XUs and 92578 XVs -> 23252 XUVs
C:0 T:10 10826 XUs and 14796 XVs -> 1637 XUVs
C:0 T:11 63 XUs and 30 XVs -> 15 XUVs
61945 XUVs total
9634 collection wire objects
58395 potential space points
Neighbour search...
15843739 tests to find 6547034 neighbours
Iterating with no regularization...
Begin: 4.60299e+07
0 3.47507e+07
1 3.40117e+07
2 3.38966e+07
3 3.38607e+07
4 3.38445e+07
Now with regularization...
Begin: 2.69104e+07
0 2.685e+07
1 2.67922e+07
2 2.67456e+07
3 2.67076e+07
4 2.6676e+07
5 2.66491e+07
6 2.66268e+07
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s102-e19/label1/swarm/label2/SLF7/build/larpandoracontent/v03_22_01-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-package/BUILDTYPE/prof/QUAL/e19/label1/swarm/label2/SLF7/build/pandora/v03_16_00/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0079, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410698052
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410698052
fLifetime: 30000 [us]
24-Nov-2025 03:53:07 CET Closed output file "reco_stage1.root"
24-Nov-2025 03:53:07 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 261.675 368.49 500.382 358.452 61.715 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00137551 0.00537714 0.00742253 0.00626753 0.00204914 10
reco:ophit:OpHitFinder 0.306215 0.347926 0.396058 0.342213 0.026317 10
reco:opflash:OpFlashFinder 0.154786 0.196726 0.223893 0.198173 0.0211441 10
reco:opslicer:OpSlicer 0.563762 0.677685 0.807069 0.662279 0.0668944 10
reco:caldata:DataPrepModule 6.12738 6.42978 7.17939 6.34558 0.269908 10
reco:wclsdatasp:WireCellToolkit 42.6799 59.7379 68.6264 63.0374 8.07501 10
reco:gaushit:GausHitFinder 0.893806 1.12354 1.35891 1.10493 0.145 10
reco:nhitsfilter:NumberOfHitsFilter 0.00037605 0.000557688 0.000800913 0.000555574 0.000139955 10
reco:reco3d:SpacePointSolver 8.07914 15.4191 25.0734 15.7609 5.05688 10
reco:hitpdune:DisambigFromSpacePoints 0.690723 1.21499 1.70119 1.15738 0.275694 10
reco:pandora:StandardPandora 11.164 31.1254 62.4658 28.5201 13.3037 10
reco:pandoraWriter:StandardPandora 0.323287 0.432141 0.562322 0.431358 0.0714098 10
reco:pandoraTrack:LArPandoraTrackCreation 2.86936 5.49579 8.56737 4.66196 1.83543 10
reco:pandoraShower:LArPandoraShowerCreation 2.79683 6.21864 13.582 5.58925 3.33156 10
reco:pandoracalo:Calorimetry 1.28123 2.68585 4.12451 2.43448 0.919501 10
reco:pandoracalonosce:Calorimetry 1.27322 2.49889 3.95443 2.28355 0.828674 10
reco:pandorapid:Chi2ParticleID 0.00399001 0.0055282 0.00705243 0.00557222 0.00076075 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0331966 0.0457117 0.0585498 0.0450894 0.00721746 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00420593 0.00541585 0.00622843 0.00534575 0.000558946 10
reco:pandoraShowercalo:ShowerCalorimetry 2.19089 5.33305 12.3262 4.5192 2.92578 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.1133 5.04009 11.869 4.15002 2.80189 10
reco:emtrkmichelid:EmTrackMichelId 130.175 170.968 205.625 172.606 22.702 10
reco:crttag:SingleCRTMatchingProducer 0.00950476 0.0167332 0.0256485 0.0171328 0.00573619 10
reco:crtreco:TwoCRTMatchingProducer 0.00756147 0.0118262 0.0236963 0.0102874 0.00460258 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.737476 0.875659 1.10249 0.887347 0.116276 10
reco:pandora2Track:LArPandoraTrackCreation 8.44157 16.7166 35.3677 14.921 7.92658 10
reco:pandora2calo:Calorimetry 3.50073 7.59627 15.3083 6.90703 3.4181 10
reco:pandora2calonosce:Calorimetry 3.29606 7.14151 15.2058 6.08909 3.36036 10
reco:pandora2pid:Chi2ParticleID 0.00882967 0.0121318 0.0152616 0.0121914 0.00183916 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.040433 0.058587 0.0761238 0.0582031 0.00929219 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00893586 0.0122913 0.0155438 0.0123084 0.00186879 10
reco:pandora2Shower:LArPandoraShowerCreation 3.36848 6.30142 12.4121 5.65757 2.78268 10
reco:pandora2Showercalo:ShowerCalorimetry 2.95538 6.31231 11.9332 5.22018 2.92497 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.13177 5.40189 9.7319 4.5074 2.13805 10
[art]:TriggerResults:TriggerResultInserter 4.2334e-05 6.46756e-05 0.000140179 5.9228e-05 2.597e-05 10
end_path:out1:RootOutput 8.043e-06 1.21271e-05 4.0771e-05 8.7775e-06 9.57804e-06 10
end_path:out1:RootOutput(write) 2.04166 2.79504 3.48246 2.77594 0.40837 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4909.04 MB
Peak resident set size usage (VmHWM): 4106.05 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.96 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9142708
-rw-r--r--. 1 dune009 dune 2183629298 Nov 24 02:49 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2080925398 Nov 24 02:47 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 1812983805 Nov 24 03:53 reco_stage1.root
-rw-r--r--. 1 dune009 dune 1640746071 Nov 24 00:28 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1581274972 Nov 24 00:17 g4_stage1.root
-rw-r--r--. 1 dune009 dune 61963350 Nov 24 03:49 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 243770 Nov 24 03:53 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Nov 24 03:53 mem.db
-rw-r--r--. 1 dune009 dune 62376 Nov 24 03:53 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Nov 24 03:53 time.db
-rw-r--r--. 1 dune009 dune 519 Nov 24 02:49 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Nov 24 00:28 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Nov 24 03:53 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Nov 24 00:10 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Nov 24 03:53 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Nov 24 02:55 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Nov 24 02:49 debugprod.log 