Jobsub ID 270042.1@dunegpschedd01.fnal.gov
| Jobsub ID | 270042.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11333 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-24 20:39:27 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep208 |
| Last heartbeat | 2025-12-25 01:12:12 |
| From worker node | Hostname | heplnc166.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-24 20:40:37 |
| Input files | monte-carlo-011333-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16269s) |
| CPU time | 4h (15580s = 95%) |
| Max RSS bytes | 4442152960 (4236 MiB) |
| Outputting started | 2025-12-25 01:11:47 |
| Output files | |
| Finished | 2025-12-25 01:12:12 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
epare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 101150 traces, 0 summary
Retagger: tagging trace set: gauss with 78364 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 78364 traces tagged "gauss"
FrameSaver: q=2.9512e+06 n=1428637 tag=gauss
wclsFrameSaver: saving 101150 traces tagged "wiener"
FrameSaver: q=3.13026e+06 n=1279610 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19862 XUs and 23352 XVs -> 67 XUVs
C:0 T:1 41545 XUs and 41376 XVs -> 2295 XUVs
C:0 T:2 87218 XUs and 93880 XVs -> 7244 XUVs
C:0 T:3 42708 XUs and 38207 XVs -> 362 XUVs
C:0 T:4 7189 XUs and 8813 XVs -> 58 XUVs
C:0 T:5 22270 XUs and 19593 XVs -> 1902 XUVs
C:0 T:6 78776 XUs and 46141 XVs -> 3061 XUVs
C:0 T:7 35271 XUs and 17399 XVs -> 141 XUVs
C:0 T:8 7083 XUs and 8748 XVs -> 125 XUVs
C:0 T:9 51924 XUs and 66881 XVs -> 6648 XUVs
C:0 T:10 54585 XUs and 32768 XVs -> 8138 XUVs
C:0 T:11 117 XUs and 74 XVs -> 9 XUVs
30050 XUVs total
8838 collection wire objects
27735 potential space points
Neighbour search...
2207093 tests to find 1141682 neighbours
Iterating with no regularization...
Begin: 6.96133e+07
0 5.92578e+07
1 5.84526e+07
2 5.83433e+07
3 5.8313e+07
Now with regularization...
Begin: 4.89114e+07
0 4.8863e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411320455
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411320455
fLifetime: 30000 [us]
25-Dec-2025 01:11:44 GMT Closed output file "reco_stage1.root"
25-Dec-2025 01:11:44 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 363.547 506.298 688.195 501.773 92.28 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000960518 0.00456097 0.00815877 0.00438054 0.00237362 10
reco:ophit:OpHitFinder 0.312979 0.435096 0.54415 0.457441 0.0649224 10
reco:opflash:OpFlashFinder 0.167846 0.260176 0.340652 0.264566 0.0459034 10
reco:opslicer:OpSlicer 0.681672 1.01157 1.48423 0.973743 0.218274 10
reco:caldata:DataPrepModule 4.74237 7.58689 8.46245 7.87599 0.979684 10
reco:wclsdatasp:WireCellToolkit 36.1099 40.3175 43.3907 40.8803 2.51884 10
reco:gaushit:GausHitFinder 1.22305 1.75925 2.16799 1.84518 0.317952 10
reco:nhitsfilter:NumberOfHitsFilter 0.000484497 0.00071013 0.000935681 0.000672644 0.000137392 10
reco:reco3d:SpacePointSolver 14.0545 28.0184 41.1434 30.2307 8.61456 10
reco:hitpdune:DisambigFromSpacePoints 1.05939 2.59314 3.79915 2.70823 0.724937 10
reco:pandora:StandardPandora 29.5751 59.0194 99.682 55.0321 20.1368 10
reco:pandoraWriter:StandardPandora 0.331982 0.650398 0.868602 0.66264 0.161582 10
reco:pandoraTrack:LArPandoraTrackCreation 2.74524 6.14475 9.89127 5.63801 1.95776 10
reco:pandoraShower:LArPandoraShowerCreation 4.10062 7.71466 14.7833 6.9688 3.00092 10
reco:pandoracalo:Calorimetry 2.37043 3.82455 5.56876 3.49855 0.955834 10
reco:pandoracalonosce:Calorimetry 2.14926 3.36695 5.26129 3.06193 0.997113 10
reco:pandorapid:Chi2ParticleID 0.00490052 0.00782342 0.0105471 0.00818609 0.00183121 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.046008 0.0736841 0.103358 0.0718448 0.0230669 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00476657 0.00734773 0.010456 0.00803195 0.00206905 10
reco:pandoraShowercalo:ShowerCalorimetry 3.61038 7.79851 13.6013 7.5583 3.00943 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.43366 7.61191 13.7007 6.67608 2.92449 10
reco:emtrkmichelid:EmTrackMichelId 204.302 257.05 320.969 254.936 33.9483 10
reco:crttag:SingleCRTMatchingProducer 0.0149525 0.0211935 0.0268129 0.0214815 0.00379516 10
reco:crtreco:TwoCRTMatchingProducer 0.00874514 0.0133405 0.0174159 0.0137024 0.00252859 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.91365 1.22815 1.60667 1.21119 0.238411 10
reco:pandora2Track:LArPandoraTrackCreation 12.565 20.7165 37.1317 16.9111 8.14429 10
reco:pandora2calo:Calorimetry 6.00718 10.7603 18.3118 9.32362 3.95866 10
reco:pandora2calonosce:Calorimetry 4.71376 9.87147 13.4843 9.93996 2.46519 10
reco:pandora2pid:Chi2ParticleID 0.0193625 0.0238847 0.0327748 0.0224597 0.00408461 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0845078 0.110127 0.147424 0.111534 0.0165553 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0110484 0.0213915 0.0304737 0.0210271 0.00462445 10
reco:pandora2Shower:LArPandoraShowerCreation 4.57163 7.432 10.7669 7.49187 1.89227 10
reco:pandora2Showercalo:ShowerCalorimetry 5.19231 9.18698 14.5212 8.99503 2.48022 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.4566 7.77585 12.3935 7.49608 2.40636 10
[art]:TriggerResults:TriggerResultInserter 5.1547e-05 8.39582e-05 0.000162475 7.66285e-05 3.25201e-05 10
end_path:out1:RootOutput 9.838e-06 1.383e-05 2.0018e-05 1.316e-05 2.98182e-06 10
end_path:out1:RootOutput(write) 2.89573 3.73306 4.89038 3.55625 0.63692 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5317.55 MB
Peak resident set size usage (VmHWM): 4442.15 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.81 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11378568
-rw-r--r-- 1 pltdune04 pltdune 2628804464 Dec 24 23:44 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2493903376 Dec 24 23:41 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2357779529 Dec 25 01:11 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2079215368 Dec 24 21:06 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2005953717 Dec 24 20:48 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 85387960 Dec 25 01:07 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune 242825 Dec 25 01:11 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune 217088 Dec 25 01:11 mem.db
-rw-r--r-- 1 pltdune04 pltdune 62376 Dec 25 01:11 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune 36864 Dec 25 01:11 time.db
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 24 23:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 24 21:06 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 25 01:11 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune 52 Dec 24 20:40 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune 7 Dec 25 01:11 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune 0 Dec 24 23:52 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune 0 Dec 24 23:44 debugprod.log
