Jobsub ID 273837.1@dunegpschedd02.fnal.gov
| Jobsub ID | 273837.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11993 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-16 21:23:37 |
| Site | UK_Brunel |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_22 |
| Last heartbeat | 2026-01-17 01:05:42 |
| From worker node | Hostname | wn-b8-28-00.brunel.ac.uk |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2026-01-16 21:24:44 |
| Input files | monte-carlo-011993-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13197s) |
| CPU time | 3h (12714s = 96%) |
| Max RSS bytes | 4254179328 (4057 MiB) |
| Outputting started | 2026-01-17 01:04:42 |
| Output files | |
| Finished | 2026-01-17 01:05:42 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
SignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128280 traces, 0 summary
Retagger: tagging trace set: gauss with 100726 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100726 traces tagged "gauss"
FrameSaver: q=3.56936e+06 n=1866534 tag=gauss
wclsFrameSaver: saving 128280 traces tagged "wiener"
FrameSaver: q=3.76805e+06 n=1681065 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27387 XUs and 26308 XVs -> 194 XUVs
C:0 T:1 42835 XUs and 40254 XVs -> 2648 XUVs
C:0 T:2 115725 XUs and 166724 XVs -> 6472 XUVs
C:0 T:3 60211 XUs and 66253 XVs -> 538 XUVs
C:0 T:4 14635 XUs and 15643 XVs -> 111 XUVs
C:0 T:5 44587 XUs and 38774 XVs -> 3871 XUVs
C:0 T:6 82411 XUs and 99127 XVs -> 3670 XUVs
C:0 T:7 37405 XUs and 45432 XVs -> 394 XUVs
C:0 T:8 6728 XUs and 7692 XVs -> 48 XUVs
C:0 T:9 31956 XUs and 44488 XVs -> 2176 XUVs
C:0 T:10 56035 XUs and 52053 XVs -> 8372 XUVs
C:0 T:11 110 XUs and 70 XVs -> 11 XUVs
28505 XUVs total
11302 collection wire objects
26654 potential space points
Neighbour search...
1142206 tests to find 596102 neighbours
Iterating with no regularization...
Begin: 7.54921e+07
0 6.38942e+07
1 6.28811e+07
2 6.2714e+07
3 6.26667e+07
Now with regularization...
Begin: 5.13586e+07
0 5.13043e+07
1 5.12862e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411783844
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411783844
fLifetime: 30000 [us]
17-Jan-2026 01:04:39 GMT Closed output file "reco_stage1.root"
17-Jan-2026 01:04:39 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 317.073 433.138 563.716 439.709 76.463 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000774562 0.00341571 0.00499392 0.00366703 0.00132163 10
reco:ophit:OpHitFinder 0.244487 0.291741 0.340232 0.296228 0.0317131 10
reco:opflash:OpFlashFinder 0.149008 0.203596 0.259844 0.202731 0.0301504 10
reco:opslicer:OpSlicer 0.573263 0.735468 0.866284 0.749113 0.0859887 10
reco:caldata:DataPrepModule 5.07895 5.61369 6.38173 5.33527 0.462099 10
reco:wclsdatasp:WireCellToolkit 41.2881 48.25 56.4159 48.4692 5.22226 10
reco:gaushit:GausHitFinder 1.1738 1.61641 1.92061 1.63427 0.210672 10
reco:nhitsfilter:NumberOfHitsFilter 0.00043877 0.000671005 0.000884109 0.000665972 0.000117405 10
reco:reco3d:SpacePointSolver 8.79484 17.6723 29.1488 16.2713 6.14993 10
reco:hitpdune:DisambigFromSpacePoints 1.84527 3.04335 4.13132 3.03534 0.814469 10
reco:pandora:StandardPandora 28.3509 59.1094 95.503 56.4524 21.8744 10
reco:pandoraWriter:StandardPandora 0.381445 0.497115 0.6043 0.499349 0.0690051 10
reco:pandoraTrack:LArPandoraTrackCreation 3.59526 5.62314 7.94972 5.44958 1.20326 10
reco:pandoraShower:LArPandoraShowerCreation 3.43423 6.00405 9.57318 6.27969 1.70067 10
reco:pandoracalo:Calorimetry 1.9486 2.8734 4.45195 2.7759 0.635837 10
reco:pandoracalonosce:Calorimetry 1.93409 2.56281 3.54007 2.52319 0.447499 10
reco:pandorapid:Chi2ParticleID 0.00598848 0.00698201 0.00780449 0.00694056 0.000594301 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0701912 0.0774616 0.0955349 0.0732924 0.00810565 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00549255 0.00644333 0.00790538 0.00629868 0.000801126 10
reco:pandoraShowercalo:ShowerCalorimetry 4.27415 6.17699 8.96906 5.88809 1.61902 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.8216 6.18984 9.26116 5.79383 1.83116 10
reco:emtrkmichelid:EmTrackMichelId 160.935 204.452 248.153 205.73 27.3533 10
reco:crttag:SingleCRTMatchingProducer 0.0136181 0.0180267 0.0201564 0.0184447 0.00198016 10
reco:crtreco:TwoCRTMatchingProducer 0.00856228 0.0107063 0.0131229 0.0110638 0.00125639 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.5115 1.78646 2.16978 1.71722 0.235792 10
reco:pandora2Track:LArPandoraTrackCreation 11.5927 19.4513 27.5027 20.5827 5.34968 10
reco:pandora2calo:Calorimetry 5.46636 8.74645 12.5356 8.93703 2.0223 10
reco:pandora2calonosce:Calorimetry 5.19613 8.28334 11.5981 8.44922 1.77917 10
reco:pandora2pid:Chi2ParticleID 0.0129593 0.0179462 0.0234602 0.0181749 0.00304896 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0796663 0.0992926 0.119508 0.0989903 0.0114978 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0127415 0.0175272 0.0248076 0.0175612 0.00316616 10
reco:pandora2Shower:LArPandoraShowerCreation 4.01069 6.41346 9.34577 6.52078 1.49009 10
reco:pandora2Showercalo:ShowerCalorimetry 4.85384 7.30856 10.0579 7.24443 1.59089 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.49411 6.90574 9.35915 7.26482 1.44392 10
[art]:TriggerResults:TriggerResultInserter 3.9412e-05 0.000150809 0.00093364 5.45495e-05 0.000262117 10
end_path:out1:RootOutput 8.939e-06 1.12371e-05 1.9343e-05 9.8185e-06 3.05261e-06 10
end_path:out1:RootOutput(write) 2.18458 2.97286 4.12707 2.81962 0.550213 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5059.91 MB
Peak resident set size usage (VmHWM): 4254.18 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.62 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10969236
-rw-r--r--. 1 dune000 dune 2540948258 Jan 16 23:49 detsim_stage2.root
-rw-r--r--. 1 dune000 dune 2408668154 Jan 16 23:46 detsim_stage1.root
-rw-r--r--. 1 dune000 dune 2270544095 Jan 17 01:04 reco_stage1.root
-rw-r--r--. 1 dune000 dune 2001291916 Jan 16 21:47 g4_stage2.root
-rw-r--r--. 1 dune000 dune 1924759349 Jan 16 21:32 g4_stage1.root
-rw-r--r--. 1 dune000 dune 85674290 Jan 17 00:59 Pandora_Events.pndr
-rw-r--r--. 1 dune000 dune 243368 Jan 17 01:04 jobscript.log
-rw-r--r--. 1 dune000 dune 217088 Jan 17 01:04 mem.db
-rw-r--r--. 1 dune000 dune 62376 Jan 17 01:04 Pandora_Geometry.xml
-rw-r--r--. 1 dune000 dune 36864 Jan 17 01:04 time.db
-rw-r--r--. 1 dune000 dune 519 Jan 16 23:49 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune000 dune 519 Jan 16 21:47 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune000 dune 519 Jan 17 01:04 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune000 dune 52 Jan 16 21:24 all-input-dids.txt
-rw-r--r--. 1 dune000 dune 7 Jan 17 01:04 justin-processed-pfns.txt
-rw-r--r--. 1 dune000 dune 0 Jan 16 23:55 ProtoDUNE.log
-rw-r--r--. 1 dune000 dune 0 Jan 16 23:49 debugprod.log
