Jobsub ID 249494.1@dunegpschedd02.fnal.gov
| Jobsub ID | 249494.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10494 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-22 00:20:07 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2025-11-22 05:16:05 |
| From worker node | Hostname | wn1207081.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-22 00:21:17 |
| Input files | monte-carlo-010494-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17595s) |
| CPU time | 4h (14805s = 84%) |
| Max RSS bytes | 4041506816 (3854 MiB) |
| Outputting started | 2025-11-22 05:14:33 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10494/1/001/reco_stage1.root
|
| Finished | 2025-11-22 05:16:05 |
| Saved logs | justin-logs:249494.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
1 149474 XUs and 108745 XVs -> 10549 XUVs
C:0 T:2 111091 XUs and 122130 XVs -> 4301 XUVs
C:0 T:3 53761 XUs and 52195 XVs -> 453 XUVs
C:0 T:4 21545 XUs and 18779 XVs -> 242 XUVs
C:0 T:5 160069 XUs and 89567 XVs -> 15997 XUVs
C:0 T:6 57050 XUs and 50508 XVs -> 1784 XUVs
C:0 T:7 28468 XUs and 24288 XVs -> 119 XUVs
C:0 T:8 7962 XUs and 8565 XVs -> 148 XUVs
C:0 T:9 63746 XUs and 74354 XVs -> 7004 XUVs
C:0 T:10 13462 XUs and 8557 XVs -> 1261 XUVs
C:0 T:11 180 XUs and 157 XVs -> 18 XUVs
42427 XUVs total
13039 collection wire objects
38484 potential space points
Neighbour search...
4403214 tests to find 2071712 neighbours
Iterating with no regularization...
Begin: 7.52058e+07
0 6.26336e+07
1 6.17843e+07
2 6.16691e+07
3 6.16373e+07
Now with regularization...
Begin: 5.13611e+07
0 5.13332e+07
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s102-e19/label1/swarm/label2/SLF7/build/larpandoracontent/v03_22_01-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-package/BUILDTYPE/prof/QUAL/e19/label1/swarm/label2/SLF7/build/pandora/v03_16_00/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0079, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410657069
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410657069
fLifetime: 30000 [us]
22-Nov-2025 05:14:30 GMT Closed output file "reco_stage1.root"
22-Nov-2025 05:14:30 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 381.496 684.782 987.036 704.932 192.279 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00222381 0.00533601 0.00982365 0.0051238 0.00246136 10
reco:ophit:OpHitFinder 0.342997 0.384879 0.443699 0.379144 0.0295612 10
reco:opflash:OpFlashFinder 0.161241 0.229018 0.262723 0.238869 0.0296863 10
reco:opslicer:OpSlicer 0.660569 0.978023 1.18538 1.00887 0.149299 10
reco:caldata:DataPrepModule 6.86925 8.12613 9.69537 8.01481 0.871749 10
reco:wclsdatasp:WireCellToolkit 47.8661 60.4436 69.9824 61.6753 7.26824 10
reco:gaushit:GausHitFinder 1.08302 1.7627 2.54302 1.87445 0.482124 10
reco:nhitsfilter:NumberOfHitsFilter 0.000630795 0.00157483 0.00227124 0.0016024 0.000523662 10
reco:reco3d:SpacePointSolver 6.82511 21.3788 34.8629 22.328 9.8759 10
reco:hitpdune:DisambigFromSpacePoints 0.884666 2.18557 4.14471 1.92752 0.991738 10
reco:pandora:StandardPandora 18.4067 51.9367 117.728 43.1836 30.004 10
reco:pandoraWriter:StandardPandora 0.397294 0.758228 1.08501 0.737802 0.19416 10
reco:pandoraTrack:LArPandoraTrackCreation 5.38714 10.5908 15.4466 10.5992 4.01413 10
reco:pandoraShower:LArPandoraShowerCreation 3.69832 12.1962 20.9241 12.1997 5.76288 10
reco:pandoracalo:Calorimetry 2.58063 6.17447 9.77149 6.98177 2.72322 10
reco:pandoracalonosce:Calorimetry 2.26613 6.16489 10.3084 6.26883 3.03821 10
reco:pandorapid:Chi2ParticleID 0.00652591 0.00988981 0.0163936 0.00913701 0.0029316 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0580273 0.092659 0.120378 0.0884714 0.0222792 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00660858 0.00996856 0.0130002 0.00915221 0.00203119 10
reco:pandoraShowercalo:ShowerCalorimetry 3.68152 14.1336 28.0198 14.504 7.78221 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.4672 13.042 24.8258 13.0193 6.92404 10
reco:emtrkmichelid:EmTrackMichelId 226.708 353.307 449.947 360.822 73.8276 10
reco:crttag:SingleCRTMatchingProducer 0.015576 0.0305709 0.0468132 0.0288402 0.0101535 10
reco:crtreco:TwoCRTMatchingProducer 0.0161718 0.0277488 0.0395927 0.0274873 0.00776369 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.86368 1.34379 1.6514 1.46663 0.278797 10
reco:pandora2Track:LArPandoraTrackCreation 14.5281 36.1598 53.0754 35.4985 13.6808 10
reco:pandora2calo:Calorimetry 6.64775 18.262 32.4291 19.3327 7.89533 10
reco:pandora2calonosce:Calorimetry 4.3798 18.5631 33.8299 17.6444 9.46214 10
reco:pandora2pid:Chi2ParticleID 0.0118937 0.0231429 0.0323781 0.0243045 0.00688982 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0600749 0.111348 0.161989 0.120125 0.0343442 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0122204 0.0229665 0.0315775 0.0232617 0.00686844 10
reco:pandora2Shower:LArPandoraShowerCreation 2.8774 12.133 18.7198 12.0696 4.96148 10
reco:pandora2Showercalo:ShowerCalorimetry 3.51129 15.0124 26.5469 14.9193 7.23401 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.57103 14.3707 28.8786 15.5712 7.41984 10
[art]:TriggerResults:TriggerResultInserter 3.8061e-05 7.63023e-05 0.000204124 5.82745e-05 4.64159e-05 10
end_path:out1:RootOutput 6.692e-06 9.7293e-06 1.7503e-05 9.167e-06 2.77858e-06 10
end_path:out1:RootOutput(write) 2.8111 4.52565 6.35252 4.43898 1.19608 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4884.06 MB
Peak resident set size usage (VmHWM): 4041.51 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9627904
-rw-r--r-- 1 dune01 dune01 2281053076 Nov 22 03:17 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2165418353 Nov 22 03:13 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 1952274076 Nov 22 05:14 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1730547183 Nov 22 01:00 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1657918097 Nov 22 00:30 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 71132510 Nov 22 05:03 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243535 Nov 22 05:14 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Nov 22 05:14 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Nov 22 05:14 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Nov 22 05:14 time.db
-rw-r--r-- 1 dune01 dune01 519 Nov 22 03:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 22 01:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 22 05:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Nov 22 00:21 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Nov 22 05:14 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Nov 22 03:28 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Nov 22 03:17 debugprod.log 