Jobsub ID 248318.1@dunegpschedd02.fnal.gov
| Jobsub ID | 248318.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10360 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-18 23:12:15 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2025-11-19 04:14:44 |
| From worker node | Hostname | wn2209251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-11-18 23:13:04 |
| Input files | monte-carlo-010360-000001
|
| Outputting started | 2025-11-19 04:01:32 |
| Output files | |
| Finished | 2025-11-19 04:30:37 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
itPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 119277 traces, 0 summary
Retagger: tagging trace set: gauss with 89140 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 89140 traces tagged "gauss"
FrameSaver: q=3.12172e+06 n=1580321 tag=gauss
wclsFrameSaver: saving 119277 traces tagged "wiener"
FrameSaver: q=3.31559e+06 n=1395978 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38204 XUs and 44129 XVs -> 591 XUVs
C:0 T:1 65052 XUs and 71820 XVs -> 5168 XUVs
C:0 T:2 122164 XUs and 141685 XVs -> 16584 XUVs
C:0 T:3 44611 XUs and 44037 XVs -> 710 XUVs
C:0 T:4 8712 XUs and 10706 XVs -> 307 XUVs
C:0 T:5 42794 XUs and 52784 XVs -> 13998 XUVs
C:0 T:6 88193 XUs and 81738 XVs -> 3249 XUVs
C:0 T:7 34952 XUs and 30112 XVs -> 309 XUVs
C:0 T:8 7528 XUs and 5881 XVs -> 66 XUVs
C:0 T:9 41634 XUs and 51034 XVs -> 7128 XUVs
C:0 T:10 32189 XUs and 13759 XVs -> 2483 XUVs
C:0 T:11 515 XUs and 268 XVs -> 36 XUVs
50629 XUVs total
9994 collection wire objects
46426 potential space points
Neighbour search...
6306764 tests to find 3063002 neighbours
Iterating with no regularization...
Begin: 5.92305e+07
0 4.72288e+07
1 4.63764e+07
2 4.62562e+07
3 4.62173e+07
Now with regularization...
Begin: 3.79637e+07
0 3.78933e+07
1 3.78446e+07
2 3.78061e+07
3 3.77741e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410598580
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410598580
fLifetime: 30000 [us]
19-Nov-2025 04:01:30 GMT Closed output file "reco_stage1.root"
19-Nov-2025 04:01:30 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 219.34 423.39 777.275 393.149 142.139 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00102871 0.00553773 0.00853322 0.00560738 0.00203994 10
reco:ophit:OpHitFinder 0.245102 0.319209 0.501012 0.300689 0.0812923 10
reco:opflash:OpFlashFinder 0.13011 0.177717 0.417207 0.149249 0.0816474 10
reco:opslicer:OpSlicer 0.494628 0.623914 0.742087 0.619387 0.0714413 10
reco:caldata:DataPrepModule 4.74503 6.5211 9.78921 6.36225 1.40151 10
reco:wclsdatasp:WireCellToolkit 30.4777 43.3584 71.8987 40.5297 12.3591 10
reco:gaushit:GausHitFinder 0.865276 1.38785 2.42629 1.33413 0.446004 10
reco:nhitsfilter:NumberOfHitsFilter 0.000344338 0.00108042 0.00462676 0.000696085 0.00121574 10
reco:reco3d:SpacePointSolver 9.0267 37.4726 96.0908 28.425 27.685 10
reco:hitpdune:DisambigFromSpacePoints 0.998805 2.11353 3.36923 2.00664 0.748004 10
reco:pandora:StandardPandora 19.7298 39.5927 105.245 32.7086 23.0816 10
reco:pandoraWriter:StandardPandora 0.319265 0.61249 0.97501 0.556788 0.214574 10
reco:pandoraTrack:LArPandoraTrackCreation 2.63609 6.13006 15.7504 4.96496 3.60769 10
reco:pandoraShower:LArPandoraShowerCreation 2.3779 8.16517 22.7157 6.30121 5.62675 10
reco:pandoracalo:Calorimetry 1.4895 3.66551 9.27282 3.17258 2.24115 10
reco:pandoracalonosce:Calorimetry 1.53342 3.43234 8.75956 2.80424 2.08904 10
reco:pandorapid:Chi2ParticleID 0.0039987 0.0074338 0.0130688 0.00598382 0.00339803 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0346757 0.0739108 0.134993 0.067117 0.0327285 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00389705 0.00691546 0.0127965 0.00574821 0.00311481 10
reco:pandoraShowercalo:ShowerCalorimetry 1.89681 8.37861 25.5822 6.26608 6.51953 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.56014 7.54149 22.3559 6.05429 5.50888 10
reco:emtrkmichelid:EmTrackMichelId 118.274 190.787 268.215 187.349 37.7645 10
reco:crttag:SingleCRTMatchingProducer 0.0120312 0.0274248 0.097988 0.0202063 0.0239557 10
reco:crtreco:TwoCRTMatchingProducer 0.00649276 0.0140789 0.040241 0.0100457 0.00990597 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.650975 1.12422 2.21173 1.07041 0.409799 10
reco:pandora2Track:LArPandoraTrackCreation 5.30576 20.9437 56.0618 18.291 13.0098 10
reco:pandora2calo:Calorimetry 2.57659 10.308 25.3883 9.23953 5.71261 10
reco:pandora2calonosce:Calorimetry 2.27097 8.60573 14.0797 8.44705 3.24807 10
reco:pandora2pid:Chi2ParticleID 0.00801104 0.0148353 0.0272814 0.0132532 0.00573071 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0418279 0.0763184 0.111236 0.0694886 0.0240581 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00798167 0.0132328 0.0197732 0.0120862 0.00411583 10
reco:pandora2Shower:LArPandoraShowerCreation 1.75787 5.75315 8.97247 5.96059 2.16811 10
reco:pandora2Showercalo:ShowerCalorimetry 2.00531 6.90885 11.9144 6.1464 2.79718 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.016 5.81807 9.05061 5.48307 1.94978 10
[art]:TriggerResults:TriggerResultInserter 4.9574e-05 7.88346e-05 0.000136858 7.0503e-05 2.32069e-05 10
end_path:out1:RootOutput 9.458e-06 1.54369e-05 4.0386e-05 1.20575e-05 8.57941e-06 10
end_path:out1:RootOutput(write) 1.76306 3.1675 4.33914 3.05936 0.695949 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5123.98 MB
Peak resident set size usage (VmHWM): 4266.07 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.75 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9814960
-rw-r--r-- 1 dune01 dune01 2316223369 Nov 19 02:48 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2200194259 Nov 19 02:45 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2017007817 Nov 19 04:01 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1753025163 Nov 18 23:45 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1685613568 Nov 18 23:21 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 77824580 Nov 19 03:57 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243397 Nov 19 04:01 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Nov 19 04:01 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Nov 19 04:01 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Nov 19 04:01 time.db
-rw-r--r-- 1 dune01 dune01 519 Nov 19 02:48 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 18 23:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 19 04:01 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Nov 18 23:13 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Nov 19 04:01 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Nov 19 03:00 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Nov 19 02:48 debugprod.log
