Jobsub ID 268367.1@dunegpschedd02.fnal.gov
| Jobsub ID | 268367.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11711 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-11 05:48:26 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2026-01-11 09:43:59 |
| From worker node | Hostname | wn6219290.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-11 05:49:03 |
| Input files | monte-carlo-011711-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14007s) |
| CPU time | 3h (13634s = 97%) |
| Max RSS bytes | 4344328192 (4143 MiB) |
| Outputting started | 2026-01-11 09:42:31 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11711/1/001/reco_stage1.root
|
| Finished | 2026-01-11 09:43:59 |
| Saved logs | justin-logs:268367.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 129359 traces, 0 summary
Retagger: tagging trace set: gauss with 95112 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95112 traces tagged "gauss"
FrameSaver: q=3.34598e+06 n=1629563 tag=gauss
wclsFrameSaver: saving 129359 traces tagged "wiener"
FrameSaver: q=3.57448e+06 n=1430394 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35387 XUs and 31464 XVs -> 867 XUVs
C:0 T:1 57915 XUs and 52060 XVs -> 7719 XUVs
C:0 T:2 112113 XUs and 156591 XVs -> 7540 XUVs
C:0 T:3 51000 XUs and 57536 XVs -> 435 XUVs
C:0 T:4 12787 XUs and 8749 XVs -> 2539 XUVs
C:0 T:5 18506 XUs and 17583 XVs -> 4639 XUVs
C:0 T:6 116774 XUs and 111078 XVs -> 12707 XUVs
C:0 T:7 44955 XUs and 38548 XVs -> 500 XUVs
C:0 T:8 11201 XUs and 10157 XVs -> 180 XUVs
C:0 T:9 88825 XUs and 88392 XVs -> 13425 XUVs
C:0 T:10 37788 XUs and 11676 XVs -> 4195 XUVs
C:0 T:11 73 XUs and 35 XVs -> 10 XUVs
54756 XUVs total
11242 collection wire objects
50268 potential space points
Neighbour search...
7745374 tests to find 3659690 neighbours
Iterating with no regularization...
Begin: 6.87743e+07
0 5.9649e+07
1 5.88181e+07
2 5.86824e+07
3 5.86422e+07
Now with regularization...
Begin: 4.82162e+07
0 4.81761e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411670227
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411670227
fLifetime: 30000 [us]
11-Jan-2026 09:42:29 GMT Closed output file "reco_stage1.root"
11-Jan-2026 09:42:29 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 290.041 380.373 517.673 390.335 70.2396 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000747803 0.00338967 0.00554194 0.00374117 0.0015488 10
reco:ophit:OpHitFinder 0.271532 0.298247 0.348623 0.287816 0.0264796 10
reco:opflash:OpFlashFinder 0.176539 0.213723 0.269652 0.204734 0.0313061 10
reco:opslicer:OpSlicer 0.599805 0.712189 0.855005 0.692637 0.0811151 10
reco:caldata:DataPrepModule 4.76275 4.93377 5.31612 4.89219 0.153313 10
reco:wclsdatasp:WireCellToolkit 32.2526 35.9902 38.4297 36.6846 2.10157 10
reco:gaushit:GausHitFinder 0.873472 1.14804 1.4215 1.17388 0.166542 10
reco:nhitsfilter:NumberOfHitsFilter 0.000478854 0.000603542 0.00075163 0.000605104 9.02523e-05 10
reco:reco3d:SpacePointSolver 13.063 20.0618 42.5131 16.4515 8.29739 10
reco:hitpdune:DisambigFromSpacePoints 1.17638 1.64397 2.35541 1.66814 0.36813 10
reco:pandora:StandardPandora 20.3846 38.5863 54.8625 41.6152 12.1018 10
reco:pandoraWriter:StandardPandora 0.3518 0.44274 0.546313 0.453002 0.0619923 10
reco:pandoraTrack:LArPandoraTrackCreation 2.83049 4.36782 6.62659 4.38745 1.28964 10
reco:pandoraShower:LArPandoraShowerCreation 3.16886 4.91089 8.74292 4.69771 1.69982 10
reco:pandoracalo:Calorimetry 1.51007 2.21615 3.1876 2.26382 0.572427 10
reco:pandoracalonosce:Calorimetry 1.37422 2.00958 2.94445 2.01992 0.524733 10
reco:pandorapid:Chi2ParticleID 0.00467371 0.00579661 0.00796406 0.00575222 0.000918312 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0405327 0.0501893 0.0635869 0.0501183 0.00702639 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00456235 0.00557299 0.00651743 0.00565177 0.000644736 10
reco:pandoraShowercalo:ShowerCalorimetry 3.0195 4.61171 7.50592 4.68727 1.38561 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.91184 4.47826 7.40607 4.4483 1.3704 10
reco:emtrkmichelid:EmTrackMichelId 162.507 202.017 246.256 204.263 27.1835 10
reco:crttag:SingleCRTMatchingProducer 0.00745485 0.0119879 0.0203082 0.01096 0.00375462 10
reco:crtreco:TwoCRTMatchingProducer 0.00682955 0.0103228 0.0190057 0.00916839 0.00365797 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.640409 0.906477 1.24705 0.899359 0.178901 10
reco:pandora2Track:LArPandoraTrackCreation 9.60415 16.1928 33.6883 15.5514 7.01963 10
reco:pandora2calo:Calorimetry 4.29705 7.23048 15.807 6.55281 3.31999 10
reco:pandora2calonosce:Calorimetry 4.08258 6.86051 15.0155 6.14077 3.15787 10
reco:pandora2pid:Chi2ParticleID 0.012723 0.0150518 0.0192432 0.0155816 0.00207424 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0524125 0.0657154 0.0862391 0.0664496 0.0100018 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0126603 0.0150203 0.0191566 0.0154289 0.00208834 10
reco:pandora2Shower:LArPandoraShowerCreation 3.63004 5.8626 12.231 5.59865 2.47649 10
reco:pandora2Showercalo:ShowerCalorimetry 3.72474 5.84352 12.8383 5.16719 2.5705 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.42174 5.32285 11.2128 4.85232 2.19952 10
[art]:TriggerResults:TriggerResultInserter 2.6951e-05 3.75912e-05 9.4689e-05 2.83235e-05 2.02482e-05 10
end_path:out1:RootOutput 4.889e-06 5.842e-06 9.588e-06 5.4855e-06 1.27154e-06 10
end_path:out1:RootOutput(write) 2.53443 3.19318 3.93061 3.14468 0.46459 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5163.38 MB
Peak resident set size usage (VmHWM): 4344.33 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10842352
-rw-r--r-- 1 dune01 dune01 2519929825 Jan 11 08:36 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2391702029 Jan 11 08:34 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2229752283 Jan 11 09:42 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1976092212 Jan 11 06:16 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1904001295 Jan 11 05:58 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 80457650 Jan 11 09:38 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243145 Jan 11 09:42 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Jan 11 09:42 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Jan 11 09:42 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Jan 11 09:42 time.db
-rw-r--r-- 1 dune01 dune01 519 Jan 11 08:36 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 11 06:16 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 11 09:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Jan 11 05:49 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Jan 11 09:42 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Jan 11 08:43 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Jan 11 08:36 debugprod.log