Jobsub ID 294534.0@dunegpschedd02.fnal.gov
| Jobsub ID | 294534.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12362 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-24 11:01:34 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce02 |
| Last heartbeat | 2026-01-24 14:38:56 |
| From worker node | Hostname | cn504.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2026-01-24 11:02:35 |
| Input files | monte-carlo-012362-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12559s) |
| CPU time | 3h (12392s = 98%) |
| Max RSS bytes | 4245573632 (4048 MiB) |
| Outputting started | 2026-01-24 14:31:55 |
| Output files | |
| Finished | 2026-01-24 14:38:56 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
g tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 107892 traces, 0 summary
Retagger: tagging trace set: gauss with 86381 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 86381 traces tagged "gauss"
FrameSaver: q=2.93809e+06 n=1568429 tag=gauss
wclsFrameSaver: saving 107892 traces tagged "wiener"
FrameSaver: q=3.08324e+06 n=1410451 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35977 XUs and 29400 XVs -> 327 XUVs
C:0 T:1 54646 XUs and 45020 XVs -> 2663 XUVs
C:0 T:2 69058 XUs and 83213 XVs -> 2545 XUVs
C:0 T:3 32633 XUs and 35329 XVs -> 216 XUVs
C:0 T:4 7074 XUs and 8646 XVs -> 51 XUVs
C:0 T:5 23389 XUs and 18541 XVs -> 1672 XUVs
C:0 T:6 127459 XUs and 125776 XVs -> 4721 XUVs
C:0 T:7 52209 XUs and 49323 XVs -> 441 XUVs
C:0 T:8 4560 XUs and 4543 XVs -> 51 XUVs
C:0 T:9 37830 XUs and 37437 XVs -> 4007 XUVs
C:0 T:10 28087 XUs and 25239 XVs -> 3478 XUVs
C:0 T:11 500 XUs and 403 XVs -> 66 XUVs
20238 XUVs total
9203 collection wire objects
18715 potential space points
Neighbour search...
992161 tests to find 487210 neighbours
Iterating with no regularization...
Begin: 6.16948e+07
0 5.22125e+07
1 5.17161e+07
2 5.16622e+07
3 5.16471e+07
Now with regularization...
Begin: 4.44128e+07
0 4.44025e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411936140
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411936140
fLifetime: 30000 [us]
24-Jan-2026 14:31:53 GMT Closed output file "reco_stage1.root"
24-Jan-2026 14:31:53 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 372.102 539.563 737.68 516.721 102.916 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00162883 0.00390247 0.0055061 0.00412958 0.00132536 10
reco:ophit:OpHitFinder 0.289028 0.333965 0.435651 0.313383 0.0470207 10
reco:opflash:OpFlashFinder 0.209209 0.251276 0.30845 0.244527 0.0274432 10
reco:opslicer:OpSlicer 0.65575 0.815544 1.32808 0.770132 0.190184 10
reco:caldata:DataPrepModule 6.20562 6.91936 10.3315 6.41852 1.17834 10
reco:wclsdatasp:WireCellToolkit 51.7628 55.0558 58.3546 54.5516 1.72616 10
reco:gaushit:GausHitFinder 1.13737 1.88066 2.98261 1.72853 0.5877 10
reco:nhitsfilter:NumberOfHitsFilter 0.000595356 0.000860179 0.00132099 0.000818094 0.000192501 10
reco:reco3d:SpacePointSolver 12.4869 20.6202 40.1673 19.3867 7.72016 10
reco:hitpdune:DisambigFromSpacePoints 1.53886 2.60559 4.18279 2.3552 0.759123 10
reco:pandora:StandardPandora 21.5794 44.2239 69.4493 41.4142 15.2135 10
reco:pandoraWriter:StandardPandora 0.408429 0.572083 0.7977 0.560014 0.107306 10
reco:pandoraTrack:LArPandoraTrackCreation 6.48909 11.598 15.0669 11.6936 2.62615 10
reco:pandoraShower:LArPandoraShowerCreation 6.54643 13.4287 20.9051 12.4604 4.02022 10
reco:pandoracalo:Calorimetry 2.68345 5.35125 7.01442 5.48865 1.29465 10
reco:pandoracalonosce:Calorimetry 2.6084 5.09002 6.84959 5.15342 1.28678 10
reco:pandorapid:Chi2ParticleID 0.00557376 0.00672921 0.00907859 0.00655038 0.000973081 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0514669 0.072373 0.0818199 0.0740584 0.00902229 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00533363 0.00640179 0.00768629 0.00632682 0.000735607 10
reco:pandoraShowercalo:ShowerCalorimetry 4.61824 12.0471 19.605 11.6028 3.99655 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.97846 11.7554 18.9867 11.7217 3.79437 10
reco:emtrkmichelid:EmTrackMichelId 188.174 227.445 290.811 217.743 30.0475 10
reco:crttag:SingleCRTMatchingProducer 0.0238566 0.0341164 0.0432814 0.0335937 0.00524166 10
reco:crtreco:TwoCRTMatchingProducer 0.018184 0.0289572 0.038727 0.0286723 0.00509386 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.03265 1.56401 2.49504 1.47123 0.403586 10
reco:pandora2Track:LArPandoraTrackCreation 20.5767 41.4207 60.0879 39.3551 11.6082 10
reco:pandora2calo:Calorimetry 7.33879 17.1606 26.8079 17.3174 5.745 10
reco:pandora2calonosce:Calorimetry 7.38895 17.0127 30.439 15.2181 6.95415 10
reco:pandora2pid:Chi2ParticleID 0.0124778 0.0185963 0.0367888 0.0151366 0.00780065 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.065928 0.102279 0.163139 0.092237 0.0292843 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0123409 0.0181952 0.0359562 0.0148411 0.00749098 10
reco:pandora2Shower:LArPandoraShowerCreation 6.23533 12.913 22.2811 12.469 4.10094 10
reco:pandora2Showercalo:ShowerCalorimetry 5.85244 13.6819 20.6092 13.626 3.79998 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.28588 12.246 16.7114 12.8163 3.18807 10
[art]:TriggerResults:TriggerResultInserter 5.1126e-05 6.68454e-05 0.000138081 5.7845e-05 2.43675e-05 10
end_path:out1:RootOutput 8.169e-06 1.00806e-05 1.4751e-05 9.008e-06 2.32416e-06 10
end_path:out1:RootOutput(write) 2.27023 3.09998 3.81446 3.15515 0.431293 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5056.33 MB
Peak resident set size usage (VmHWM): 4245.57 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10210780
-rw-r--r-- 1 pildune22 pildune 2402061539 Jan 24 12:59 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2280339709 Jan 24 12:57 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2094007546 Jan 24 14:31 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 1840412588 Jan 24 11:24 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1762293937 Jan 24 11:09 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune 76110230 Jan 24 14:26 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune 242804 Jan 24 14:31 jobscript.log
-rw-r--r-- 1 pildune22 pildune 217088 Jan 24 14:31 mem.db
-rw-r--r-- 1 pildune22 pildune 62376 Jan 24 14:31 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune 36864 Jan 24 14:31 time.db
-rw-r--r-- 1 pildune22 pildune 519 Jan 24 12:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune 519 Jan 24 11:24 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune 519 Jan 24 14:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune 52 Jan 24 11:02 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune 7 Jan 24 14:31 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune 0 Jan 24 13:09 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune 0 Jan 24 12:59 debugprod.log
