Jobsub ID 294070.1@dunegpschedd02.fnal.gov
| Jobsub ID | 294070.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12291 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-23 06:43:56 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep207 |
| Last heartbeat | 2026-01-23 12:57:38 |
| From worker node | Hostname | heplnc140.pp.rl.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2026-01-23 06:44:53 |
| Input files | monte-carlo-012291-000001
|
| Jobscript | Exit code | 0 |
| Real time | 6h (22318s) |
| CPU time | 6h (21688s = 97%) |
| Max RSS bytes | 4398051328 (4194 MiB) |
| Outputting started | 2026-01-23 12:56:52 |
| Output files | |
| Finished | 2026-01-23 12:57:38 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
RawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 123078 traces, 0 summary
Retagger: tagging trace set: gauss with 88836 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88836 traces tagged "gauss"
FrameSaver: q=3.14464e+06 n=1515419 tag=gauss
wclsFrameSaver: saving 123078 traces tagged "wiener"
FrameSaver: q=3.37992e+06 n=1329432 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38088 XUs and 42001 XVs -> 764 XUVs
C:0 T:1 70602 XUs and 75989 XVs -> 6896 XUVs
C:0 T:2 93127 XUs and 120075 XVs -> 6692 XUVs
C:0 T:3 43297 XUs and 45723 XVs -> 485 XUVs
C:0 T:4 8368 XUs and 7834 XVs -> 440 XUVs
C:0 T:5 24153 XUs and 17950 XVs -> 4574 XUVs
C:0 T:6 108982 XUs and 169459 XVs -> 25422 XUVs
C:0 T:7 31166 XUs and 36329 XVs -> 864 XUVs
C:0 T:9 38506 XUs and 42609 XVs -> 7740 XUVs
C:0 T:10 44566 XUs and 48168 XVs -> 9931 XUVs
C:0 T:11 605 XUs and 404 XVs -> 53 XUVs
63861 XUVs total
10096 collection wire objects
57695 potential space points
Neighbour search...
12267083 tests to find 5310830 neighbours
Iterating with no regularization...
Begin: 5.76314e+07
0 4.77805e+07
1 4.69568e+07
2 4.68061e+07
3 4.67524e+07
4 4.67263e+07
Now with regularization...
Begin: 3.77288e+07
0 3.7671e+07
1 3.76184e+07
2 3.7574e+07
3 3.75383e+07
TestBeamParticleCreationAlgorithm::SetupTestBeamVertex - Test beam particle has no initial vertex
run: 1 ; subrun: 0 ; event: 10
evttime: 411912426
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411912426
fLifetime: 30000 [us]
23-Jan-2026 12:56:47 GMT Closed output file "reco_stage1.root"
23-Jan-2026 12:56:47 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 613.436 784.863 1156.73 739.112 171.519 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00155014 0.00506529 0.00903458 0.00506785 0.00235069 10
reco:ophit:OpHitFinder 0.266843 0.444406 0.608923 0.464721 0.0974492 10
reco:opflash:OpFlashFinder 0.214357 0.311692 0.41843 0.294792 0.0591374 10
reco:opslicer:OpSlicer 0.866211 1.18039 1.40237 1.20149 0.171405 10
reco:caldata:DataPrepModule 7.56539 9.77852 11.5655 10.0755 1.30206 10
reco:wclsdatasp:WireCellToolkit 60.6553 73.7202 82.6087 74.091 7.03546 10
reco:gaushit:GausHitFinder 1.82593 2.49685 3.49678 2.55199 0.509683 10
reco:nhitsfilter:NumberOfHitsFilter 0.000745035 0.000956997 0.00126468 0.000946695 0.000162745 10
reco:reco3d:SpacePointSolver 13.383 25.9182 37.2706 26.3282 7.08309 10
reco:hitpdune:DisambigFromSpacePoints 1.82456 3.59498 5.60755 3.58437 1.23536 10
reco:pandora:StandardPandora 30.0991 83.89 242.868 57.6723 62.0585 10
reco:pandoraWriter:StandardPandora 0.574784 0.86187 1.09853 0.871653 0.154783 10
reco:pandoraTrack:LArPandoraTrackCreation 8.11985 14.706 20.3225 14.839 3.18502 10
reco:pandoraShower:LArPandoraShowerCreation 10.2613 16.0277 23.6415 14.836 4.2739 10
reco:pandoracalo:Calorimetry 3.7328 6.78373 9.68027 6.85675 1.64354 10
reco:pandoracalonosce:Calorimetry 3.32265 5.89307 7.92235 5.86695 1.44164 10
reco:pandorapid:Chi2ParticleID 0.00673798 0.0103583 0.0133567 0.0104533 0.00199491 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0713901 0.105364 0.157801 0.105872 0.0254365 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00660159 0.00973833 0.012097 0.0103595 0.00177283 10
reco:pandoraShowercalo:ShowerCalorimetry 8.71506 13.8167 23.947 12.2116 4.34757 10
reco:pandoraShowercalonosce:ShowerCalorimetry 8.58771 13.4953 22.7647 11.3341 4.52648 10
reco:emtrkmichelid:EmTrackMichelId 315.913 378.833 480.638 369.666 54.516 10
reco:crttag:SingleCRTMatchingProducer 0.0267562 0.0387494 0.0473602 0.0403295 0.00632591 10
reco:crtreco:TwoCRTMatchingProducer 0.0212648 0.0302778 0.0366608 0.0321712 0.0053313 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.43275 1.8994 2.41995 1.90503 0.338066 10
reco:pandora2Track:LArPandoraTrackCreation 27.404 44.917 64.9099 41.9999 12.4924 10
reco:pandora2calo:Calorimetry 11.4764 19.656 29.1296 20.7933 5.40189 10
reco:pandora2calonosce:Calorimetry 11.0109 18.1601 27.4245 17.7631 5.26595 10
reco:pandora2pid:Chi2ParticleID 0.0149359 0.0230529 0.0296312 0.0232487 0.00508508 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0871516 0.126059 0.159404 0.121333 0.0209145 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0152687 0.0235589 0.0297287 0.0239051 0.00433949 10
reco:pandora2Shower:LArPandoraShowerCreation 10.4253 13.582 17.1304 13.4782 1.94235 10
reco:pandora2Showercalo:ShowerCalorimetry 10.8467 15.9698 22.7367 15.773 3.10282 10
reco:pandora2Showercalonosce:ShowerCalorimetry 9.187 13.6637 20.3944 13.4732 3.11389 10
[art]:TriggerResults:TriggerResultInserter 5.8655e-05 8.58555e-05 0.000198344 7.68455e-05 3.91725e-05 10
end_path:out1:RootOutput 7.948e-06 1.21567e-05 2.0796e-05 1.084e-05 3.31707e-06 10
end_path:out1:RootOutput(write) 3.68178 4.68154 5.65823 4.66132 0.691968 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5216.15 MB
Peak resident set size usage (VmHWM): 4398.05 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11061720
-rw-r--r-- 1 pltdune04 pltdune 2559800131 Jan 23 10:41 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2430941629 Jan 23 10:37 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2267983337 Jan 23 12:56 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2031301182 Jan 23 07:18 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1956494806 Jan 23 06:55 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 80060550 Jan 23 12:48 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune 243106 Jan 23 12:56 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune 217088 Jan 23 12:56 mem.db
-rw-r--r-- 1 pltdune04 pltdune 62376 Jan 23 12:56 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune 36864 Jan 23 12:56 time.db
-rw-r--r-- 1 pltdune04 pltdune 519 Jan 23 10:41 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Jan 23 07:18 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Jan 23 12:56 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune 52 Jan 23 06:44 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune 7 Jan 23 12:56 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune 0 Jan 23 10:53 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune 0 Jan 23 10:41 debugprod.log
