Jobsub ID 263933.0@dunegpschedd02.fnal.gov
| Jobsub ID | 263933.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11314 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-23 08:25:34 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce4 |
| Last heartbeat | 2025-12-23 10:57:34 |
| From worker node | Hostname | n255.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-23 08:26:03 |
| Input files | monte-carlo-011314-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9070s) |
| CPU time | 2h (8858s = 97%) |
| Max RSS bytes | 4494295040 (4286 MiB) |
| Outputting started | 2025-12-23 10:57:14 |
| Output files | |
| Finished | 2025-12-23 10:57:34 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
PrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120433 traces, 0 summary
Retagger: tagging trace set: gauss with 93091 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93091 traces tagged "gauss"
FrameSaver: q=3.15641e+06 n=1656170 tag=gauss
wclsFrameSaver: saving 120433 traces tagged "wiener"
FrameSaver: q=3.33968e+06 n=1467949 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44540 XUs and 41575 XVs -> 1048 XUVs
C:0 T:1 137326 XUs and 345739 XVs -> 30873 XUVs
C:0 T:2 53497 XUs and 62745 XVs -> 1782 XUVs
C:0 T:3 29191 XUs and 30133 XVs -> 182 XUVs
C:0 T:4 10570 XUs and 12294 XVs -> 184 XUVs
C:0 T:5 54194 XUs and 124013 XVs -> 13992 XUVs
C:0 T:6 76227 XUs and 90207 XVs -> 3654 XUVs
C:0 T:7 31267 XUs and 36782 XVs -> 232 XUVs
C:0 T:8 9018 XUs and 7700 XVs -> 106 XUVs
C:0 T:9 52715 XUs and 64796 XVs -> 4967 XUVs
C:0 T:10 31163 XUs and 17140 XVs -> 3622 XUVs
C:0 T:11 72 XUs and 38 XVs -> 8 XUVs
60650 XUVs total
11332 collection wire objects
54386 potential space points
Neighbour search...
12889766 tests to find 5172560 neighbours
Iterating with no regularization...
Begin: 5.55983e+07
0 4.24485e+07
1 4.14296e+07
2 4.12892e+07
3 4.12472e+07
4 4.12287e+07
Now with regularization...
Begin: 3.27542e+07
0 3.2707e+07
1 3.26665e+07
2 3.26362e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411290229
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411290229
fLifetime: 30000 [us]
23-Dec-2025 10:57:12 GMT Closed output file "reco_stage1.root"
23-Dec-2025 10:57:13 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 190.558 270.486 336.051 258.755 43.9825 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000905879 0.00338741 0.00541199 0.00365918 0.00154993 10
reco:ophit:OpHitFinder 0.23589 0.268252 0.305486 0.258782 0.0237181 10
reco:opflash:OpFlashFinder 0.164268 0.196724 0.258304 0.182533 0.0275622 10
reco:opslicer:OpSlicer 0.434611 0.559723 0.648099 0.568443 0.0652511 10
reco:caldata:DataPrepModule 4.05116 4.25319 4.44465 4.22139 0.110963 10
reco:wclsdatasp:WireCellToolkit 25.3728 27.9654 29.7321 28.4604 1.4226 10
reco:gaushit:GausHitFinder 0.769227 0.974314 1.15842 0.939911 0.134074 10
reco:nhitsfilter:NumberOfHitsFilter 0.000377997 0.00044823 0.00054829 0.000443306 4.97158e-05 10
reco:reco3d:SpacePointSolver 7.59797 12.3166 17.4124 11.2966 3.37859 10
reco:hitpdune:DisambigFromSpacePoints 0.923971 1.38129 1.89235 1.29239 0.310501 10
reco:pandora:StandardPandora 14.7724 27.1658 37.4711 25.9995 7.36423 10
reco:pandoraWriter:StandardPandora 0.278535 0.37412 0.487876 0.348513 0.0690571 10
reco:pandoraTrack:LArPandoraTrackCreation 1.89348 3.2779 4.54877 2.94887 0.818354 10
reco:pandoraShower:LArPandoraShowerCreation 2.19081 3.4962 5.12036 3.0874 1.03183 10
reco:pandoracalo:Calorimetry 1.02592 1.89102 2.46797 1.84534 0.399848 10
reco:pandoracalonosce:Calorimetry 0.864879 1.85165 2.44696 1.83125 0.440879 10
reco:pandorapid:Chi2ParticleID 0.0039365 0.00455972 0.00579126 0.00430799 0.000575882 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0293585 0.0403068 0.0477321 0.0383442 0.00545183 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0035038 0.00440647 0.00583947 0.00432523 0.000599118 10
reco:pandoraShowercalo:ShowerCalorimetry 2.03673 3.9699 6.02636 3.58724 1.22587 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.00013 3.81747 5.39586 3.64797 1.06177 10
reco:emtrkmichelid:EmTrackMichelId 104.281 139.385 168.143 134.319 18.3393 10
reco:crttag:SingleCRTMatchingProducer 0.00915934 0.0114015 0.0186683 0.0101098 0.00275835 10
reco:crtreco:TwoCRTMatchingProducer 0.00548111 0.00711944 0.0103329 0.00655033 0.00133232 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.563451 0.709661 0.818909 0.732837 0.0887037 10
reco:pandora2Track:LArPandoraTrackCreation 5.85492 10.5611 15.1535 9.50911 2.994 10
reco:pandora2calo:Calorimetry 2.7972 5.54247 7.90186 5.01869 1.56548 10
reco:pandora2calonosce:Calorimetry 2.60916 5.25991 7.18626 4.84955 1.43113 10
reco:pandora2pid:Chi2ParticleID 0.00832289 0.010225 0.0119527 0.0100526 0.00108335 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0384283 0.0506981 0.0612649 0.0484368 0.00678365 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00854903 0.0102144 0.0119756 0.00982812 0.00102781 10
reco:pandora2Shower:LArPandoraShowerCreation 2.04002 3.62529 5.05742 3.2451 0.992738 10
reco:pandora2Showercalo:ShowerCalorimetry 2.34215 4.69772 6.51658 4.3376 1.26544 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.06412 4.24782 6.08695 3.94206 1.14552 10
[art]:TriggerResults:TriggerResultInserter 4.5166e-05 5.71054e-05 0.000108385 5.1052e-05 1.7421e-05 10
end_path:out1:RootOutput 9.188e-06 1.01703e-05 1.3636e-05 9.7585e-06 1.20377e-06 10
end_path:out1:RootOutput(write) 1.8192 2.43396 2.95977 2.30038 0.349831 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5296.93 MB
Peak resident set size usage (VmHWM): 4494.3 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.68 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10935968
-rw-r--r--. 1 dune004 dune 2544476611 Dec 23 10:10 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2414501651 Dec 23 10:08 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2248720809 Dec 23 10:57 reco_stage1.root
-rw-r--r--. 1 dune004 dune 1996250666 Dec 23 08:41 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1914378677 Dec 23 08:31 g4_stage1.root
-rw-r--r--. 1 dune004 dune 79471720 Dec 23 10:54 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune 242898 Dec 23 10:57 jobscript.log
-rw-r--r--. 1 dune004 dune 217088 Dec 23 10:57 mem.db
-rw-r--r--. 1 dune004 dune 62376 Dec 23 10:57 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune 36864 Dec 23 10:57 time.db
-rw-r--r--. 1 dune004 dune 519 Dec 23 10:10 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune 519 Dec 23 08:41 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune 519 Dec 23 10:57 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune 52 Dec 23 08:26 all-input-dids.txt
-rw-r--r--. 1 dune004 dune 7 Dec 23 10:57 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune 0 Dec 23 10:13 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune 0 Dec 23 10:10 debugprod.log
