Jobsub ID 302181.0@dunegpschedd01.fnal.gov
| Jobsub ID | 302181.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12538 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-29 21:26:32 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2026-01-30 01:35:35 |
| From worker node | Hostname | wn2209251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 21:40:29 |
| Input files | monte-carlo-012538-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14015s) |
| CPU time | 3h (13534s = 96%) |
| Max RSS bytes | 4097486848 (3907 MiB) |
| Outputting started | 2026-01-30 01:34:06 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12538/1/001/reco_stage1.root
|
| Finished | 2026-01-30 01:35:35 |
| Saved logs | justin-logs:302181.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
C:0 T:0 40364 XUs and 30175 XVs -> 461 XUVs
C:0 T:1 80937 XUs and 60627 XVs -> 5040 XUVs
C:0 T:2 56761 XUs and 90484 XVs -> 3605 XUVs
C:0 T:3 30336 XUs and 33927 XVs -> 147 XUVs
C:0 T:4 5946 XUs and 6583 XVs -> 38 XUVs
C:0 T:5 21902 XUs and 14429 XVs -> 3198 XUVs
C:0 T:6 39862 XUs and 61163 XVs -> 1517 XUVs
C:0 T:7 18214 XUs and 27802 XVs -> 123 XUVs
C:0 T:8 8079 XUs and 4852 XVs -> 117 XUVs
C:0 T:9 57133 XUs and 43663 XVs -> 6858 XUVs
C:0 T:10 16533 XUs and 11047 XVs -> 2166 XUVs
23270 XUVs total
8115 collection wire objects
21667 potential space points
Neighbour search...
2013863 tests to find 940712 neighbours
Iterating with no regularization...
Begin: 5.68062e+07
0 4.48421e+07
1 4.40959e+07
2 4.39916e+07
3 4.39586e+07
Now with regularization...
Begin: 3.62898e+07
0 3.62687e+07
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s102-e19/label1/swarm/label2/SLF7/build/larpandoracontent/v03_22_01-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-package/BUILDTYPE/prof/QUAL/e19/label1/swarm/label2/SLF7/build/pandora/v03_16_00/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0079, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 412045408
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412045408
fLifetime: 30000 [us]
30-Jan-2026 01:34:03 GMT Closed output file "reco_stage1.root"
30-Jan-2026 01:34:03 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 235.373 340.277 419.499 350.749 60.563 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00152432 0.00445114 0.00755939 0.00468628 0.00183088 10
reco:ophit:OpHitFinder 0.239808 0.290495 0.335736 0.288409 0.0333391 10
reco:opflash:OpFlashFinder 0.113579 0.165757 0.227575 0.174334 0.0339336 10
reco:opslicer:OpSlicer 0.446537 0.701395 0.954061 0.713527 0.167012 10
reco:caldata:DataPrepModule 4.6241 5.19033 5.82807 5.14663 0.437847 10
reco:wclsdatasp:WireCellToolkit 30.8411 36.5427 43.1097 37.005 3.5258 10
reco:gaushit:GausHitFinder 0.843568 1.18383 1.66741 1.10164 0.256503 10
reco:nhitsfilter:NumberOfHitsFilter 0.000383361 0.000522065 0.000709335 0.000479978 0.000113185 10
reco:reco3d:SpacePointSolver 7.4718 15.7259 23.9888 17.2179 5.09257 10
reco:hitpdune:DisambigFromSpacePoints 0.870092 1.5982 2.27556 1.55636 0.438441 10
reco:pandora:StandardPandora 15.4091 29.4438 48.7817 29.1094 9.66597 10
reco:pandoraWriter:StandardPandora 0.307081 0.489702 0.660301 0.481545 0.0937476 10
reco:pandoraTrack:LArPandoraTrackCreation 1.86546 3.84548 5.05879 4.24473 1.05403 10
reco:pandoraShower:LArPandoraShowerCreation 1.87288 4.49047 6.91275 4.72859 1.50713 10
reco:pandoracalo:Calorimetry 1.04427 2.19691 3.31074 2.27018 0.695437 10
reco:pandoracalonosce:Calorimetry 0.954643 2.0072 2.86207 2.02316 0.652762 10
reco:pandorapid:Chi2ParticleID 0.00333585 0.00490026 0.00985003 0.00440142 0.00174861 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0330415 0.0473837 0.0806734 0.0456206 0.0121283 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00341269 0.00479771 0.00780237 0.00447567 0.00113274 10
reco:pandoraShowercalo:ShowerCalorimetry 2.29846 4.75224 7.91529 4.89048 1.60317 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.76584 4.4644 7.47146 4.7824 1.65636 10
reco:emtrkmichelid:EmTrackMichelId 134.881 180.719 214.694 183.574 25.6242 10
reco:crttag:SingleCRTMatchingProducer 0.0104872 0.0172016 0.0258977 0.0178818 0.00488301 10
reco:crtreco:TwoCRTMatchingProducer 0.00699844 0.0113527 0.015858 0.0118992 0.00284064 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.660434 0.868661 1.03433 0.902181 0.116171 10
reco:pandora2Track:LArPandoraTrackCreation 5.69145 13.681 21.8032 13.2034 4.93564 10
reco:pandora2calo:Calorimetry 2.46767 7.12037 10.664 8.13662 2.48401 10
reco:pandora2calonosce:Calorimetry 2.52849 6.4842 9.73935 6.40024 2.29168 10
reco:pandora2pid:Chi2ParticleID 0.00746549 0.0133027 0.0206294 0.0110661 0.00460642 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0355965 0.0665228 0.0956348 0.0596626 0.0222042 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0075868 0.0130824 0.0198608 0.0105462 0.0047185 10
reco:pandora2Shower:LArPandoraShowerCreation 1.87584 4.38107 6.65928 4.45036 1.42225 10
reco:pandora2Showercalo:ShowerCalorimetry 2.14558 5.54112 8.86082 5.60664 1.97248 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.26911 5.09693 7.79114 5.24978 1.65474 10
[art]:TriggerResults:TriggerResultInserter 5.9873e-05 8.8151e-05 0.000188515 7.6895e-05 3.57356e-05 10
end_path:out1:RootOutput 9.117e-06 1.65722e-05 3.4686e-05 1.25985e-05 8.71334e-06 10
end_path:out1:RootOutput(write) 2.04011 2.98387 3.98997 3.1192 0.567931 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4920.52 MB
Peak resident set size usage (VmHWM): 4097.49 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9792228
-rw-r--r-- 1 dune01 dune01 2314741903 Jan 30 00:35 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2197735491 Jan 30 00:32 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 1997529185 Jan 30 01:34 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1766373831 Jan 29 22:00 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1676542463 Jan 29 21:47 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 73686710 Jan 30 01:31 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243609 Jan 30 01:34 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Jan 30 01:34 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Jan 30 01:34 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Jan 30 01:34 time.db
-rw-r--r-- 1 dune01 dune01 519 Jan 30 00:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 29 22:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 30 01:34 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Jan 29 21:40 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Jan 30 01:34 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Jan 30 00:41 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Jan 30 00:35 debugprod.log 