Jobsub ID 272045.0@dunegpschedd02.fnal.gov
| Jobsub ID | 272045.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11903 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-14 14:30:39 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-01-14 19:51:08 |
| From worker node | Hostname | td808.pic.es |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-14 14:32:11 |
| Input files | monte-carlo-011903-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (19092s) |
| CPU time | 5h (18050s = 94%) |
| Max RSS bytes | 4458098688 (4251 MiB) |
| Outputting started | 2026-01-14 19:50:24 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11903/1/001/reco_stage1.root
|
| Finished | 2026-01-14 19:51:08 |
| Saved logs | justin-logs:272045.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
asedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 183928 traces, 0 summary
Retagger: tagging trace set: gauss with 137643 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 137643 traces tagged "gauss"
FrameSaver: q=4.88958e+06 n=2395197 tag=gauss
wclsFrameSaver: saving 183928 traces tagged "wiener"
FrameSaver: q=5.18122e+06 n=2100717 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33331 XUs and 43819 XVs -> 514 XUVs
C:0 T:1 63842 XUs and 75378 XVs -> 5485 XUVs
C:0 T:2 249318 XUs and 235775 XVs -> 23575 XUVs
C:0 T:3 90885 XUs and 70968 XVs -> 1160 XUVs
C:0 T:4 14093 XUs and 19521 XVs -> 116 XUVs
C:0 T:5 66272 XUs and 75542 XVs -> 6332 XUVs
C:0 T:6 199850 XUs and 223985 XVs -> 34811 XUVs
C:0 T:7 57014 XUs and 52085 XVs -> 1058 XUVs
C:0 T:8 11618 XUs and 10852 XVs -> 155 XUVs
C:0 T:9 65408 XUs and 80710 XVs -> 4013 XUVs
C:0 T:10 54171 XUs and 31954 XVs -> 6424 XUVs
C:0 T:11 203 XUs and 134 XVs -> 22 XUVs
83665 XUVs total
17079 collection wire objects
75372 potential space points
Neighbour search...
15418644 tests to find 6726346 neighbours
Iterating with no regularization...
Begin: 1.05152e+08
0 8.92919e+07
1 8.8015e+07
2 8.78221e+07
3 8.77599e+07
Now with regularization...
Begin: 7.26863e+07
0 7.25948e+07
1 7.25189e+07
2 7.24614e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411737758
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411737758
fLifetime: 30000 [us]
14-Jan-2026 20:50:22 CET Closed output file "reco_stage1.root"
14-Jan-2026 20:50:22 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 449.429 692.422 968.894 659.343 139.924 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00156997 0.00362573 0.00546029 0.00373281 0.00121024 10
reco:ophit:OpHitFinder 0.364471 0.459312 0.550117 0.452388 0.0567087 10
reco:opflash:OpFlashFinder 0.245989 0.304167 0.414834 0.288875 0.0555623 10
reco:opslicer:OpSlicer 0.903717 1.18575 1.55836 1.24151 0.183659 10
reco:caldata:DataPrepModule 5.55914 7.48259 8.54885 7.97918 1.05226 10
reco:wclsdatasp:WireCellToolkit 41.1107 47.011 54.9314 48.0436 4.01381 10
reco:gaushit:GausHitFinder 1.54723 2.0707 2.5219 2.16938 0.337775 10
reco:nhitsfilter:NumberOfHitsFilter 0.000555962 0.000886904 0.00112579 0.000912143 0.00015608 10
reco:reco3d:SpacePointSolver 16.3553 33.5329 63.2732 30.0109 13.8332 10
reco:hitpdune:DisambigFromSpacePoints 1.81411 3.40162 5.6497 3.17591 0.998668 10
reco:pandora:StandardPandora 22.3954 63.3356 112.687 58.4337 24.415 10
reco:pandoraWriter:StandardPandora 0.381345 0.730087 1.06001 0.753423 0.169033 10
reco:pandoraTrack:LArPandoraTrackCreation 3.01027 7.41711 12.1582 7.63279 2.48542 10
reco:pandoraShower:LArPandoraShowerCreation 2.84655 9.05822 15.1501 8.9418 3.26446 10
reco:pandoracalo:Calorimetry 1.4914 3.6732 6.10236 3.56748 1.28357 10
reco:pandoracalonosce:Calorimetry 1.33816 3.73698 5.90837 3.96122 1.43416 10
reco:pandorapid:Chi2ParticleID 0.00562904 0.00915418 0.0124163 0.00961659 0.00229457 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0480617 0.0911606 0.138745 0.0911959 0.0269792 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00522623 0.00891645 0.0124526 0.00926628 0.00234591 10
reco:pandoraShowercalo:ShowerCalorimetry 2.4888 9.01224 14.7266 8.91784 3.76741 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.35163 7.92365 12.1941 6.91358 2.88539 10
reco:emtrkmichelid:EmTrackMichelId 302.342 408.148 528.572 385.682 66.6509 10
reco:crttag:SingleCRTMatchingProducer 0.0157757 0.0241289 0.0379962 0.0239719 0.00676246 10
reco:crtreco:TwoCRTMatchingProducer 0.00920222 0.0159536 0.0228533 0.0154203 0.00431088 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.981408 1.45183 1.87465 1.47236 0.247707 10
reco:pandora2Track:LArPandoraTrackCreation 10.8592 26.1721 44.3614 22.7509 9.04336 10
reco:pandora2calo:Calorimetry 5.07984 11.833 23.4118 10.704 4.61791 10
reco:pandora2calonosce:Calorimetry 4.86619 11.8039 20.9102 10.424 4.66956 10
reco:pandora2pid:Chi2ParticleID 0.0178178 0.0235925 0.0346357 0.023223 0.00501031 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.080466 0.125527 0.180896 0.123287 0.0354208 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0174426 0.0242146 0.0341391 0.0245674 0.00578994 10
reco:pandora2Shower:LArPandoraShowerCreation 4.16048 9.48828 17.173 8.16254 3.5314 10
reco:pandora2Showercalo:ShowerCalorimetry 4.66898 9.49485 14.6094 8.54271 2.79671 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.25854 8.52399 12.3619 7.81189 2.60545 10
[art]:TriggerResults:TriggerResultInserter 3.471e-05 5.86004e-05 0.00016237 4.48305e-05 3.62945e-05 10
end_path:out1:RootOutput 9.851e-06 1.14643e-05 1.744e-05 1.0915e-05 2.11138e-06 10
end_path:out1:RootOutput(write) 3.73358 4.67517 6.43393 4.45533 0.892576 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5279.44 MB
Peak resident set size usage (VmHWM): 4458.1 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.75 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11310556
-rw-r--r-- 1 dune001 dune 2613495320 Jan 14 18:51 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2475827900 Jan 14 18:47 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2353287576 Jan 14 20:50 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2065133791 Jan 14 16:03 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1986411213 Jan 14 15:43 g4_stage1.root
-rw-r--r-- 1 dune001 dune 87212970 Jan 14 20:39 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243130 Jan 14 20:50 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 14 20:50 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 14 20:50 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 14 20:50 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 14 18:51 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 14 16:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 14 20:50 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 14 15:32 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 14 20:50 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 14 19:02 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 14 18:51 debugprod.log
