Jobsub ID 263934.1@dunegpschedd02.fnal.gov
| Jobsub ID | 263934.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11315 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-23 08:25:34 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep206 |
| Last heartbeat | 2025-12-23 12:41:05 |
| From worker node | Hostname | heplnc169.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-23 08:25:54 |
| Input files | monte-carlo-011315-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15289s) |
| CPU time | 4h (14741s = 96%) |
| Max RSS bytes | 4455161856 (4248 MiB) |
| Outputting started | 2025-12-23 12:40:44 |
| Output files | |
| Finished | 2025-12-23 12:41:05 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
set: wiener with 168771 traces, 0 summary
Retagger: tagging trace set: gauss with 131853 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 131853 traces tagged "gauss"
FrameSaver: q=4.58459e+06 n=2440075 tag=gauss
wclsFrameSaver: saving 168771 traces tagged "wiener"
FrameSaver: q=4.84234e+06 n=2177190 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38484 XUs and 24581 XVs -> 312 XUVs
C:0 T:1 89607 XUs and 59055 XVs -> 6356 XUVs
C:0 T:2 182965 XUs and 134168 XVs -> 8799 XUVs
C:0 T:3 67910 XUs and 49311 XVs -> 809 XUVs
C:0 T:4 16903 XUs and 14016 XVs -> 163 XUVs
C:0 T:5 81251 XUs and 49109 XVs -> 6351 XUVs
C:0 T:6 266787 XUs and 236354 XVs -> 14057 XUVs
C:0 T:7 88030 XUs and 76868 XVs -> 1368 XUVs
C:0 T:8 11083 XUs and 9240 XVs -> 101 XUVs
C:0 T:9 81794 XUs and 104724 XVs -> 7608 XUVs
C:0 T:10 59077 XUs and 29793 XVs -> 5126 XUVs
C:0 T:11 233 XUs and 156 XVs -> 18 XUVs
51068 XUVs total
17430 collection wire objects
45114 potential space points
Neighbour search...
3176520 tests to find 1599698 neighbours
Iterating with no regularization...
Begin: 9.51826e+07
0 7.19572e+07
1 7.02675e+07
2 6.99765e+07
3 6.98791e+07
4 6.9834e+07
Now with regularization...
Begin: 5.70648e+07
0 5.70068e+07
1 5.69696e+07
TestBeamParticleCreationAlgorithm::SetupTestBeamVertex - Test beam particle has no initial vertex
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411290218
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411290218
fLifetime: 30000 [us]
23-Dec-2025 12:40:42 GMT Closed output file "reco_stage1.root"
23-Dec-2025 12:40:42 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 359.032 515.395 597.917 547.809 77.9202 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00108496 0.00477311 0.00801233 0.00435187 0.00228831 10
reco:ophit:OpHitFinder 0.294021 0.434811 0.532591 0.457673 0.0745626 10
reco:opflash:OpFlashFinder 0.202186 0.283275 0.331011 0.283242 0.0364407 10
reco:opslicer:OpSlicer 0.635609 0.967662 1.30382 1.06273 0.236987 10
reco:caldata:DataPrepModule 4.90878 6.25666 8.10645 6.11656 1.07842 10
reco:wclsdatasp:WireCellToolkit 34.2204 39.5089 45.5122 39.8152 3.67042 10
reco:gaushit:GausHitFinder 1.08604 1.74379 2.28938 1.90563 0.431999 10
reco:nhitsfilter:NumberOfHitsFilter 0.000557234 0.000769544 0.00103565 0.000793986 0.000158212 10
reco:reco3d:SpacePointSolver 15.6925 25.8817 33.5418 28.8795 6.20914 10
reco:hitpdune:DisambigFromSpacePoints 1.40725 2.43612 3.34408 2.38369 0.604765 10
reco:pandora:StandardPandora 25.5524 53.7694 71.5805 58.1162 15.5974 10
reco:pandoraWriter:StandardPandora 0.446806 0.677192 0.820943 0.692147 0.121845 10
reco:pandoraTrack:LArPandoraTrackCreation 3.42122 7.23439 10.9225 7.23487 2.07507 10
reco:pandoraShower:LArPandoraShowerCreation 3.68976 7.96709 11.2513 8.40382 2.48727 10
reco:pandoracalo:Calorimetry 2.0423 3.91862 5.593 4.10217 1.07281 10
reco:pandoracalonosce:Calorimetry 1.92531 3.4142 5.30016 3.23468 0.988447 10
reco:pandorapid:Chi2ParticleID 0.00499715 0.00772852 0.0128201 0.00615743 0.00276147 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0452862 0.0710943 0.107085 0.0541086 0.0267563 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00482375 0.00734402 0.0121999 0.00597593 0.00248429 10
reco:pandoraShowercalo:ShowerCalorimetry 4.31379 7.95081 12.0098 8.11816 2.3576 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.95646 7.92413 11.6497 8.63335 2.16908 10
reco:emtrkmichelid:EmTrackMichelId 196.052 265.993 307.002 271.544 33.3456 10
reco:crttag:SingleCRTMatchingProducer 0.0172365 0.0233506 0.0467636 0.0205506 0.00819712 10
reco:crtreco:TwoCRTMatchingProducer 0.0101341 0.0143309 0.0188707 0.0136662 0.00240675 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.950908 1.25206 1.64285 1.22636 0.223213 10
reco:pandora2Track:LArPandoraTrackCreation 15.6074 23.5851 28.0034 25.1189 4.1526 10
reco:pandora2calo:Calorimetry 6.77039 12.2969 15.2927 13.1238 2.52305 10
reco:pandora2calonosce:Calorimetry 6.80667 11.3422 14.0751 11.7042 2.47441 10
reco:pandora2pid:Chi2ParticleID 0.0118632 0.0180733 0.0283339 0.0149255 0.00603187 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0572348 0.0896638 0.145586 0.0794477 0.0306898 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0104096 0.0168061 0.0281598 0.0136743 0.00608108 10
reco:pandora2Shower:LArPandoraShowerCreation 4.00452 7.8162 10.114 8.43922 1.78521 10
reco:pandora2Showercalo:ShowerCalorimetry 4.73677 9.71087 12.1516 9.86474 2.0425 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.12802 8.48572 11.0396 8.01311 1.59174 10
[art]:TriggerResults:TriggerResultInserter 6.6134e-05 0.000107883 0.00026709 9.5448e-05 5.51872e-05 10
end_path:out1:RootOutput 1.2754e-05 2.18819e-05 5.363e-05 1.71725e-05 1.25907e-05 10
end_path:out1:RootOutput(write) 3.04337 4.12458 4.86487 4.26542 0.521026 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5315.92 MB
Peak resident set size usage (VmHWM): 4455.16 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.90 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11833944
-rw-r--r-- 1 pltdune04 pltdune 2713369198 Dec 23 11:12 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2571612417 Dec 23 11:09 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2468658901 Dec 23 12:40 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2176796796 Dec 23 08:47 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2095659619 Dec 23 08:33 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 91243920 Dec 23 12:33 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune 243592 Dec 23 12:40 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune 217088 Dec 23 12:40 mem.db
-rw-r--r-- 1 pltdune04 pltdune 62376 Dec 23 12:40 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune 36864 Dec 23 12:40 time.db
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 23 11:12 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 23 08:47 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 23 12:40 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune 52 Dec 23 08:25 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune 7 Dec 23 12:40 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune 0 Dec 23 11:20 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune 0 Dec 23 11:12 debugprod.log
