Jobsub ID 269768.1@dunegpschedd01.fnal.gov
| Jobsub ID | 269768.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11316 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-23 08:25:34 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep206 |
| Last heartbeat | 2025-12-23 12:19:02 |
| From worker node | Hostname | heplnc156.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-23 08:27:08 |
| Input files | monte-carlo-011316-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13894s) |
| CPU time | 3h (13342s = 96%) |
| Max RSS bytes | 4385021952 (4181 MiB) |
| Outputting started | 2025-12-23 12:18:42 |
| Output files | |
| Finished | 2025-12-23 12:19:02 |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ng tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144336 traces, 0 summary
Retagger: tagging trace set: gauss with 113914 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 113914 traces tagged "gauss"
FrameSaver: q=3.85619e+06 n=1992339 tag=gauss
wclsFrameSaver: saving 144336 traces tagged "wiener"
FrameSaver: q=4.0627e+06 n=1773203 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 23848 XUs and 22299 XVs -> 223 XUVs
C:0 T:1 67859 XUs and 44059 XVs -> 4720 XUVs
C:0 T:2 181950 XUs and 164538 XVs -> 8156 XUVs
C:0 T:3 90959 XUs and 69810 XVs -> 709 XUVs
C:0 T:4 13699 XUs and 15109 XVs -> 161 XUVs
C:0 T:5 120526 XUs and 65885 XVs -> 11103 XUVs
C:0 T:6 85469 XUs and 72610 XVs -> 2474 XUVs
C:0 T:7 40993 XUs and 32057 XVs -> 286 XUVs
C:0 T:8 7086 XUs and 7894 XVs -> 80 XUVs
C:0 T:9 41493 XUs and 63394 XVs -> 3013 XUVs
C:0 T:10 30805 XUs and 16291 XVs -> 2970 XUVs
C:0 T:11 296 XUs and 190 XVs -> 33 XUVs
33928 XUVs total
11373 collection wire objects
31055 potential space points
Neighbour search...
3018165 tests to find 1374806 neighbours
Iterating with no regularization...
Begin: 8.20959e+07
0 6.89857e+07
1 6.82337e+07
2 6.81418e+07
3 6.81137e+07
Now with regularization...
Begin: 5.81495e+07
0 5.81437e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411290208
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411290208
fLifetime: 30000 [us]
23-Dec-2025 12:18:40 GMT Closed output file "reco_stage1.root"
23-Dec-2025 12:18:40 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 294.234 443.948 536.676 455.648 85.3443 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00129883 0.00451807 0.00816432 0.00465849 0.00217156 10
reco:ophit:OpHitFinder 0.25323 0.412389 0.559738 0.421465 0.0850797 10
reco:opflash:OpFlashFinder 0.146318 0.272745 0.414234 0.264244 0.0651144 10
reco:opslicer:OpSlicer 0.512719 0.981273 1.2061 1.03814 0.200541 10
reco:caldata:DataPrepModule 4.93878 6.60561 8.10307 6.77513 1.11951 10
reco:wclsdatasp:WireCellToolkit 31.1281 39.1278 44.7938 40.0197 4.00098 10
reco:gaushit:GausHitFinder 0.910799 1.61292 2.06173 1.93198 0.463389 10
reco:nhitsfilter:NumberOfHitsFilter 0.000384221 0.000877335 0.00248361 0.000780804 0.000580718 10
reco:reco3d:SpacePointSolver 9.12699 21.7935 36.6478 22.4051 7.83014 10
reco:hitpdune:DisambigFromSpacePoints 0.971623 2.36928 3.46082 2.52522 0.829588 10
reco:pandora:StandardPandora 18.5443 44.5985 65.7216 49.3576 15.6485 10
reco:pandoraWriter:StandardPandora 0.431168 0.654867 0.815172 0.692704 0.143402 10
reco:pandoraTrack:LArPandoraTrackCreation 3.38525 6.23135 8.28199 6.69065 1.71391 10
reco:pandoraShower:LArPandoraShowerCreation 2.60074 6.29886 9.48708 6.53842 2.31853 10
reco:pandoracalo:Calorimetry 1.74189 3.51437 5.04091 3.96627 1.11631 10
reco:pandoracalonosce:Calorimetry 1.65515 3.14356 4.12344 3.48344 0.910801 10
reco:pandorapid:Chi2ParticleID 0.00484323 0.00881498 0.0128254 0.00954684 0.0023722 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0365669 0.0752002 0.103859 0.0799271 0.0211064 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00491576 0.0081291 0.00995201 0.0087461 0.0016968 10
reco:pandoraShowercalo:ShowerCalorimetry 2.51522 6.97996 10.1683 7.97146 2.5164 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.5013 6.67674 9.79257 7.0764 2.51598 10
reco:emtrkmichelid:EmTrackMichelId 165.361 229.377 270.654 231.596 35.0504 10
reco:crttag:SingleCRTMatchingProducer 0.0118318 0.0220237 0.0328241 0.021878 0.006378 10
reco:crtreco:TwoCRTMatchingProducer 0.00638052 0.0135478 0.0178384 0.0143743 0.00365442 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.570862 1.07254 1.37967 1.03797 0.238685 10
reco:pandora2Track:LArPandoraTrackCreation 9.08494 18.5076 26.7436 19.4844 5.62247 10
reco:pandora2calo:Calorimetry 4.38164 9.49991 13.8832 9.4292 2.97604 10
reco:pandora2calonosce:Calorimetry 4.20279 9.32292 13.7231 9.22679 3.15486 10
reco:pandora2pid:Chi2ParticleID 0.0124767 0.0201034 0.0296522 0.0202322 0.00504301 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0582211 0.0981265 0.135627 0.105096 0.0230446 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0124031 0.0200595 0.029741 0.0200127 0.00490411 10
reco:pandora2Shower:LArPandoraShowerCreation 3.49231 6.31676 8.16052 6.66733 1.50608 10
reco:pandora2Showercalo:ShowerCalorimetry 3.81549 7.69648 11.5747 7.84375 2.47395 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.4777 6.81875 9.85891 7.08378 1.97434 10
[art]:TriggerResults:TriggerResultInserter 5.4723e-05 7.31563e-05 0.000124654 6.64995e-05 1.92817e-05 10
end_path:out1:RootOutput 9.528e-06 1.73296e-05 6.0033e-05 1.3375e-05 1.43136e-05 10
end_path:out1:RootOutput(write) 2.76018 3.62906 4.70927 3.63996 0.636236 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5255.62 MB
Peak resident set size usage (VmHWM): 4385.02 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11354148
-rw-r--r-- 1 pltdune04 pltdune 2614425192 Dec 23 11:02 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2476005690 Dec 23 10:59 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2330780609 Dec 23 12:18 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2104367132 Dec 23 08:48 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2018568882 Dec 23 08:34 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 81885890 Dec 23 12:13 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune 242876 Dec 23 12:18 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune 217088 Dec 23 12:18 mem.db
-rw-r--r-- 1 pltdune04 pltdune 62376 Dec 23 12:18 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune 36864 Dec 23 12:18 time.db
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 23 11:02 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 23 08:48 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune 519 Dec 23 12:18 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune 52 Dec 23 08:27 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune 7 Dec 23 12:18 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune 0 Dec 23 11:10 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune 0 Dec 23 11:02 debugprod.log
