Jobsub ID 248321.1@dunegpschedd02.fnal.gov
| Jobsub ID | 248321.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10364 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-18 23:14:15 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2025-11-19 04:15:57 |
| From worker node | Hostname | wn1905240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-11-18 23:15:36 |
| Input files | monte-carlo-010364-000001
|
| Outputting started | 2025-11-19 04:14:47 |
| Output files | |
| Finished | 2025-11-19 04:30:37 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
eepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 103316 traces, 0 summary
Retagger: tagging trace set: gauss with 81723 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 81723 traces tagged "gauss"
FrameSaver: q=2.71907e+06 n=1466777 tag=gauss
wclsFrameSaver: saving 103316 traces tagged "wiener"
FrameSaver: q=2.87429e+06 n=1313138 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22803 XUs and 21107 XVs -> 156 XUVs
C:0 T:1 41724 XUs and 36643 XVs -> 2016 XUVs
C:0 T:2 98915 XUs and 145426 XVs -> 4249 XUVs
C:0 T:3 49813 XUs and 60258 XVs -> 377 XUVs
C:0 T:4 13514 XUs and 10712 XVs -> 118 XUVs
C:0 T:5 97899 XUs and 39188 XVs -> 7626 XUVs
C:0 T:6 77862 XUs and 94296 XVs -> 3868 XUVs
C:0 T:7 33259 XUs and 38765 XVs -> 176 XUVs
C:0 T:8 8266 XUs and 7193 XVs -> 99 XUVs
C:0 T:9 50479 XUs and 62556 XVs -> 4394 XUVs
C:0 T:10 5756 XUs and 3114 XVs -> 782 XUVs
C:0 T:11 347 XUs and 332 XVs -> 41 XUVs
23902 XUVs total
9702 collection wire objects
22398 potential space points
Neighbour search...
1453038 tests to find 739032 neighbours
Iterating with no regularization...
Begin: 5.70543e+07
0 4.72661e+07
1 4.65746e+07
2 4.6471e+07
3 4.64405e+07
Now with regularization...
Begin: 3.88829e+07
0 3.88429e+07
1 3.88249e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410598536
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410598536
fLifetime: 30000 [us]
19-Nov-2025 04:14:44 GMT Closed output file "reco_stage1.root"
19-Nov-2025 04:14:44 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 439.694 562.589 876.72 513.595 133.591 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00437072 0.0067666 0.0165324 0.00569355 0.00343068 10
reco:ophit:OpHitFinder 0.256847 0.389842 0.573073 0.382091 0.0875827 10
reco:opflash:OpFlashFinder 0.145888 0.224232 0.310831 0.229437 0.0548377 10
reco:opslicer:OpSlicer 0.59875 0.872789 1.35411 0.816006 0.231425 10
reco:caldata:DataPrepModule 4.89687 7.46655 9.41573 7.74432 1.51617 10
reco:wclsdatasp:WireCellToolkit 39.3804 48.9862 64.3186 45.2187 8.74288 10
reco:gaushit:GausHitFinder 1.175 1.69477 2.2806 1.68498 0.283172 10
reco:nhitsfilter:NumberOfHitsFilter 0.000923456 0.00182883 0.00450353 0.00156053 0.00103704 10
reco:reco3d:SpacePointSolver 14.226 23.6167 40.911 21.1399 8.56616 10
reco:hitpdune:DisambigFromSpacePoints 1.64863 2.28819 2.99056 2.31141 0.444725 10
reco:pandora:StandardPandora 28.693 57.0805 104.634 50.7242 21.3235 10
reco:pandoraWriter:StandardPandora 0.500105 0.873241 1.6812 0.806692 0.298105 10
reco:pandoraTrack:LArPandoraTrackCreation 5.39844 10.5733 26.0556 9.43008 5.43651 10
reco:pandoraShower:LArPandoraShowerCreation 6.90684 13.1771 34.543 10.1662 8.09732 10
reco:pandoracalo:Calorimetry 2.71112 5.4813 14.6974 4.83342 3.25927 10
reco:pandoracalonosce:Calorimetry 2.24692 5.10151 15.7491 4.54795 3.68122 10
reco:pandorapid:Chi2ParticleID 0.00453866 0.00876372 0.0158829 0.00790011 0.00381912 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0484069 0.0841181 0.127211 0.0774742 0.0288216 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00423334 0.00887253 0.0191405 0.00782482 0.00455874 10
reco:pandoraShowercalo:ShowerCalorimetry 5.94122 14.5438 47.1167 11.1891 11.4841 10
reco:pandoraShowercalonosce:ShowerCalorimetry 7.72785 13.3115 34.1873 11.6317 7.58311 10
reco:emtrkmichelid:EmTrackMichelId 208.093 248.356 321.625 236.662 33.3367 10
reco:crttag:SingleCRTMatchingProducer 0.0112312 0.0349856 0.068998 0.035435 0.0165769 10
reco:crtreco:TwoCRTMatchingProducer 0.00754197 0.0265056 0.0475378 0.0304167 0.0124906 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.840365 1.16945 1.87136 1.06146 0.297949 10
reco:pandora2Track:LArPandoraTrackCreation 17.9174 32.0675 53.2533 28.3029 12.8911 10
reco:pandora2calo:Calorimetry 8.92662 16.7343 32.1034 13.1081 7.43966 10
reco:pandora2calonosce:Calorimetry 8.63488 15.941 26.0527 12.5577 6.46023 10
reco:pandora2pid:Chi2ParticleID 0.0107616 0.0194702 0.0303938 0.0203601 0.00581139 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0614711 0.106432 0.181159 0.102314 0.0324602 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0108992 0.0192846 0.0309616 0.01965 0.00598071 10
reco:pandora2Shower:LArPandoraShowerCreation 6.725 11.7356 19.2216 9.6838 4.73339 10
reco:pandora2Showercalo:ShowerCalorimetry 7.17469 14.149 25.4527 12.3986 5.99982 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.99096 12.1586 22.6044 10.517 4.78742 10
[art]:TriggerResults:TriggerResultInserter 6.4852e-05 0.000106318 0.000210005 9.61355e-05 3.82317e-05 10
end_path:out1:RootOutput 1.2223e-05 1.68547e-05 2.4086e-05 1.5314e-05 4.29185e-06 10
end_path:out1:RootOutput(write) 2.65402 3.96115 5.23081 4.09766 0.738794 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4983.43 MB
Peak resident set size usage (VmHWM): 4155.65 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.55 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10002792
-rw-r--r-- 1 dune01 dune01 2351162007 Nov 19 02:38 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2231024391 Nov 19 02:35 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2063490825 Nov 19 04:14 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1792835343 Nov 18 23:50 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1722450881 Nov 18 23:24 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 81266480 Nov 19 04:08 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 242920 Nov 19 04:14 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Nov 19 04:14 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Nov 19 04:14 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Nov 19 04:14 time.db
-rw-r--r-- 1 dune01 dune01 519 Nov 19 02:38 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 18 23:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 19 04:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Nov 18 23:15 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Nov 19 04:14 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Nov 19 02:48 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Nov 19 02:38 debugprod.log
