Jobsub ID 263484.0@dunegpschedd01.fnal.gov
| Jobsub ID | 263484.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10998 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-04 16:45:43 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2025-12-04 22:30:22 |
| From worker node | Hostname | wn1205081.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-04 16:47:11 |
| Input files | monte-carlo-010998-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (20483s) |
| CPU time | 5h (19719s = 96%) |
| Max RSS bytes | 4088344576 (3898 MiB) |
| Outputting started | 2025-12-04 22:28:35 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10998/1/001/reco_stage1.root
|
| Finished | 2025-12-04 22:30:22 |
| Saved logs | justin-logs:263484.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
7994 XVs -> 4700 XUVs
C:0 T:2 146945 XUs and 146551 XVs -> 8019 XUVs
C:0 T:3 70081 XUs and 54094 XVs -> 424 XUVs
C:0 T:4 8858 XUs and 10508 XVs -> 75 XUVs
C:0 T:5 29406 XUs and 28489 XVs -> 2653 XUVs
C:0 T:6 102260 XUs and 93491 XVs -> 3470 XUVs
C:0 T:7 46320 XUs and 38834 XVs -> 860 XUVs
C:0 T:8 5866 XUs and 3863 XVs -> 57 XUVs
C:0 T:9 36587 XUs and 35635 XVs -> 2444 XUVs
C:0 T:10 11290 XUs and 5973 XVs -> 1485 XUVs
C:0 T:11 64 XUs and 39 XVs -> 12 XUVs
24583 XUVs total
10518 collection wire objects
22252 potential space points
Neighbour search...
1206070 tests to find 560986 neighbours
Iterating with no regularization...
Begin: 7.23231e+07
0 6.32489e+07
1 6.26785e+07
2 6.26088e+07
3 6.25935e+07
Now with regularization...
Begin: 5.26568e+07
0 5.26652e+07
Warning: metric increased
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s102-e19/label1/swarm/label2/SLF7/build/larpandoracontent/v03_22_01-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-package/BUILDTYPE/prof/QUAL/e19/label1/swarm/label2/SLF7/build/pandora/v03_16_00/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0079, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410913692
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410913692
fLifetime: 30000 [us]
04-Dec-2025 22:28:28 GMT Closed output file "reco_stage1.root"
04-Dec-2025 22:28:28 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 520.607 699.287 871.254 722.597 114.95 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00160365 0.00986609 0.053725 0.00553756 0.0147649 10
reco:ophit:OpHitFinder 0.331818 0.461246 0.536012 0.476747 0.0568895 10
reco:opflash:OpFlashFinder 0.219301 0.271694 0.325895 0.271902 0.0379324 10
reco:opslicer:OpSlicer 1.09068 1.23293 1.60528 1.20559 0.135059 10
reco:caldata:DataPrepModule 8.03022 9.00316 9.40005 9.1772 0.393127 10
reco:wclsdatasp:WireCellToolkit 52.9821 62.4198 69.3802 64.0023 5.0569 10
reco:gaushit:GausHitFinder 1.74319 2.17786 2.65466 2.12735 0.248397 10
reco:nhitsfilter:NumberOfHitsFilter 0.000784309 0.00260038 0.0167017 0.00108261 0.00470188 10
reco:reco3d:SpacePointSolver 14.1056 25.9678 41.2315 26.2035 8.12117 10
reco:hitpdune:DisambigFromSpacePoints 1.97655 2.93219 4.07417 2.89453 0.635288 10
reco:pandora:StandardPandora 34.7306 65.2657 91.624 65.1012 19.1451 10
reco:pandoraWriter:StandardPandora 0.507525 0.757112 0.931333 0.750197 0.115837 10
reco:pandoraTrack:LArPandoraTrackCreation 5.46654 8.75698 12.3752 9.22543 2.23215 10
reco:pandoraShower:LArPandoraShowerCreation 4.40476 9.6625 15.1795 10.2789 3.50631 10
reco:pandoracalo:Calorimetry 3.03872 5.2174 7.72934 5.32064 1.65174 10
reco:pandoracalonosce:Calorimetry 3.28262 5.10305 7.41272 4.65148 1.45421 10
reco:pandorapid:Chi2ParticleID 0.00913734 0.0129746 0.0180307 0.0123939 0.00261541 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0784114 0.1214 0.2195 0.109349 0.0379668 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0091558 0.0119227 0.0172587 0.0118355 0.00221156 10
reco:pandoraShowercalo:ShowerCalorimetry 5.06174 11.819 20.157 11.5685 4.99901 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.30987 10.8012 19.0043 11.0723 4.38093 10
reco:emtrkmichelid:EmTrackMichelId 314.457 382.511 452.667 383.885 47.0547 10
reco:crttag:SingleCRTMatchingProducer 0.0147441 0.0287579 0.0627075 0.0248953 0.0130791 10
reco:crtreco:TwoCRTMatchingProducer 0.0128263 0.0208334 0.0333354 0.0189531 0.00662244 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.14506 1.39541 1.71262 1.41018 0.194515 10
reco:pandora2Track:LArPandoraTrackCreation 16.3065 27.4762 38.3879 28.6919 7.32832 10
reco:pandora2calo:Calorimetry 7.97099 14.4829 23.1013 14.2889 4.55512 10
reco:pandora2calonosce:Calorimetry 7.29594 13.4891 19.0296 14.2271 3.88776 10
reco:pandora2pid:Chi2ParticleID 0.0183211 0.0282749 0.0437786 0.0263287 0.00693507 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.104249 0.135049 0.161113 0.140477 0.0175609 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0241946 0.028547 0.0353086 0.0276083 0.00347284 10
reco:pandora2Shower:LArPandoraShowerCreation 5.4301 9.44796 12.5511 10.4112 2.50785 10
reco:pandora2Showercalo:ShowerCalorimetry 5.9874 12.3401 18.6668 12.6702 3.75145 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.60146 10.8528 16.3391 11.0606 3.09947 10
[art]:TriggerResults:TriggerResultInserter 4.1999e-05 7.371e-05 0.000174189 5.3235e-05 4.15791e-05 10
end_path:out1:RootOutput 7.234e-06 5.87119e-05 0.000504702 7.9355e-06 0.000148686 10
end_path:out1:RootOutput(write) 3.97814 4.8165 5.62436 4.83813 0.568419 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4923.96 MB
Peak resident set size usage (VmHWM): 4088.34 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.74 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10119136
-rw-r--r-- 1 dune01 dune01 2382995233 Dec 4 20:28 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2263990865 Dec 4 20:24 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2056017980 Dec 4 22:28 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1825311987 Dec 4 17:16 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1761035270 Dec 4 16:57 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 72014380 Dec 4 22:19 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243876 Dec 4 22:28 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Dec 4 22:28 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Dec 4 22:28 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Dec 4 22:28 time.db
-rw-r--r-- 1 dune01 dune01 519 Dec 4 20:28 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Dec 4 17:16 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Dec 4 22:28 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Dec 4 16:47 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Dec 4 22:28 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Dec 4 20:39 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Dec 4 20:28 debugprod.log 