Jobsub ID 239364.0@dunegpschedd01.fnal.gov
| Jobsub ID | 239364.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9414 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-28 15:34:19 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc02 |
| Last heartbeat | 2025-10-28 19:17:35 |
| From worker node | Hostname | wn-lb-03.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-28 15:36:06 |
| Input files | monte-carlo-009414-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13201s) |
| CPU time | 3h (13077s = 99%) |
| Max RSS bytes | 4385107968 (4181 MiB) |
| Outputting started | 2025-10-28 19:16:09 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09414/1/001/reco_stage1.root
|
| Finished | 2025-10-28 19:17:35 |
| Saved logs | justin-logs:239364.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
:0 T:3 42849 XUs and 44804 XVs -> 810 XUVs
C:0 T:4 8094 XUs and 6922 XVs -> 65 XUVs
C:0 T:5 28193 XUs and 30217 XVs -> 3623 XUVs
C:0 T:6 87364 XUs and 70427 XVs -> 3572 XUVs
C:0 T:7 34851 XUs and 23708 XVs -> 260 XUVs
C:0 T:8 9180 XUs and 8941 XVs -> 157 XUVs
C:0 T:9 63347 XUs and 80973 XVs -> 5499 XUVs
C:0 T:10 51564 XUs and 37808 XVs -> 7277 XUVs
C:0 T:11 390 XUs and 325 XVs -> 37 XUVs
37931 XUVs total
11304 collection wire objects
34150 potential space points
Neighbour search...
3185282 tests to find 1596500 neighbours
Iterating with no regularization...
Begin: 7.32279e+07
0 5.98165e+07
1 5.86898e+07
2 5.84988e+07
3 5.84426e+07
Now with regularization...
Begin: 4.74719e+07
0 4.74188e+07
1 4.73896e+07
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s102-e19/label1/swarm/label2/SLF7/build/larpandoracontent/v03_22_01-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-package/BUILDTYPE/prof/QUAL/e19/label1/swarm/label2/SLF7/build/pandora/v03_16_00/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0079, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410169646
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410169646
fLifetime: 30000 [us]
28-Oct-2025 20:16:07 CET Closed output file "reco_stage1.root"
28-Oct-2025 20:16:07 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 301.605 365.127 461.666 353.093 43.2035 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00129886 0.00579301 0.00934954 0.00603054 0.00265433 10
reco:ophit:OpHitFinder 0.292123 0.326462 0.369866 0.321971 0.0235368 10
reco:opflash:OpFlashFinder 0.1725 0.217576 0.263699 0.215258 0.0307039 10
reco:opslicer:OpSlicer 0.586299 0.672786 0.863195 0.639588 0.0819287 10
reco:caldata:DataPrepModule 4.74603 4.93367 5.3784 4.86468 0.172464 10
reco:wclsdatasp:WireCellToolkit 34.7339 45.9083 53.7906 47.5811 6.32381 10
reco:gaushit:GausHitFinder 0.944882 1.09007 1.33453 1.05038 0.126912 10
reco:nhitsfilter:NumberOfHitsFilter 0.000364729 0.000598797 0.000991628 0.000542139 0.000222138 10
reco:reco3d:SpacePointSolver 10.5295 14.7096 18.7782 15.2161 2.37805 10
reco:hitpdune:DisambigFromSpacePoints 0.987403 1.40277 1.99248 1.31239 0.263266 10
reco:pandora:StandardPandora 22.6842 32.3692 48.8807 29.5541 8.28651 10
reco:pandoraWriter:StandardPandora 0.380742 0.431477 0.505014 0.41479 0.03434 10
reco:pandoraTrack:LArPandoraTrackCreation 4.84196 6.66751 10.589 6.36969 1.5298 10
reco:pandoraShower:LArPandoraShowerCreation 5.73915 7.97547 13.91 7.89108 2.33846 10
reco:pandoracalo:Calorimetry 2.62929 3.49026 4.56461 3.33969 0.60474 10
reco:pandoracalonosce:Calorimetry 2.40837 3.33531 4.46594 3.22688 0.678963 10
reco:pandorapid:Chi2ParticleID 0.00439095 0.00507458 0.00611474 0.00491705 0.000560083 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0388148 0.0443311 0.0519904 0.0427086 0.00384339 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00431119 0.00491728 0.00576806 0.00479963 0.000436591 10
reco:pandoraShowercalo:ShowerCalorimetry 5.78268 7.98785 11.12 8.22643 1.56791 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.44393 7.39191 10.5237 7.40138 1.5179 10
reco:emtrkmichelid:EmTrackMichelId 138.811 164.618 208.034 155.548 20.3392 10
reco:crttag:SingleCRTMatchingProducer 0.0118995 0.0204357 0.0269137 0.0211533 0.00442022 10
reco:crtreco:TwoCRTMatchingProducer 0.00994244 0.0145284 0.025599 0.0136085 0.00409724 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.617121 0.822959 1.02176 0.807741 0.121832 10
reco:pandora2Track:LArPandoraTrackCreation 14.4981 19.7726 26.8904 19.6919 3.66831 10
reco:pandora2calo:Calorimetry 7.49878 9.40526 12.6047 9.46185 1.52591 10
reco:pandora2calonosce:Calorimetry 6.89746 8.82679 11.5152 8.82974 1.30917 10
reco:pandora2pid:Chi2ParticleID 0.0100122 0.0113577 0.0150165 0.0107819 0.00139312 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0494375 0.0563301 0.0681357 0.0555917 0.00479343 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00984274 0.0111872 0.0145135 0.0106514 0.00128722 10
reco:pandora2Shower:LArPandoraShowerCreation 5.25027 6.44444 7.79284 6.37867 0.809786 10
reco:pandora2Showercalo:ShowerCalorimetry 6.2975 7.25333 8.74477 7.0199 0.76399 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.09195 6.01475 7.37919 5.81121 0.79904 10
[art]:TriggerResults:TriggerResultInserter 3.2458e-05 4.8589e-05 0.000126229 3.95745e-05 2.64595e-05 10
end_path:out1:RootOutput 6.289e-06 7.5484e-06 1.2359e-05 7.066e-06 1.65388e-06 10
end_path:out1:RootOutput(write) 2.22442 2.6407 3.26133 2.58612 0.255644 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5187.82 MB
Peak resident set size usage (VmHWM): 4385.11 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10697016
-rw-r--r--. 1 dune009 dune 2492426145 Oct 28 19:13 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2362732176 Oct 28 19:11 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2187089510 Oct 28 20:16 reco_stage1.root
-rw-r--r--. 1 dune009 dune 1961755287 Oct 28 16:54 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1872136829 Oct 28 16:42 g4_stage1.root
-rw-r--r--. 1 dune009 dune 76988910 Oct 28 20:12 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 243901 Oct 28 20:16 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Oct 28 20:16 mem.db
-rw-r--r--. 1 dune009 dune 62376 Oct 28 20:16 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Oct 28 20:16 time.db
-rw-r--r--. 1 dune009 dune 519 Oct 28 19:13 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Oct 28 16:54 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Oct 28 20:16 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Oct 28 16:36 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Oct 28 20:16 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Oct 28 19:19 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Oct 28 19:13 debugprod.log 