Jobsub ID 276738.0@dunegpschedd01.fnal.gov
| Jobsub ID | 276738.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11788 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-13 06:11:00 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-13 10:27:05 |
| From worker node | Hostname | hnode72.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-13 06:11:41 |
| Input files | monte-carlo-011788-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15251s) |
| CPU time | 2h (10621s = 69%) |
| Max RSS bytes | 4551217152 (4340 MiB) |
| Outputting started | 2026-01-13 10:25:53 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11788/1/001/reco_stage1.root
|
| Finished | 2026-01-13 10:27:05 |
| Saved logs | justin-logs:276738.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
unning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 137276 traces, 0 summary
Retagger: tagging trace set: gauss with 104441 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 104441 traces tagged "gauss"
FrameSaver: q=3.68151e+06 n=1843774 tag=gauss
wclsFrameSaver: saving 137276 traces tagged "wiener"
FrameSaver: q=3.89063e+06 n=1630422 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 46525 XUs and 44290 XVs -> 542 XUVs
C:0 T:1 88060 XUs and 75425 XVs -> 6430 XUVs
C:0 T:2 62885 XUs and 87120 XVs -> 3431 XUVs
C:0 T:3 33222 XUs and 41627 XVs -> 118 XUVs
C:0 T:4 10943 XUs and 11007 XVs -> 222 XUVs
C:0 T:5 51099 XUs and 34709 XVs -> 5914 XUVs
C:0 T:6 76539 XUs and 71068 XVs -> 3412 XUVs
C:0 T:7 31284 XUs and 24782 XVs -> 254 XUVs
C:0 T:8 12193 XUs and 10745 XVs -> 253 XUVs
C:0 T:9 117898 XUs and 125861 XVs -> 11046 XUVs
C:0 T:10 27755 XUs and 22074 XVs -> 2724 XUVs
C:0 T:11 109 XUs and 71 XVs -> 11 XUVs
34357 XUVs total
11931 collection wire objects
31251 potential space points
Neighbour search...
2516569 tests to find 1263304 neighbours
Iterating with no regularization...
Begin: 8.36776e+07
0 7.06306e+07
1 6.97576e+07
2 6.96416e+07
3 6.96101e+07
Now with regularization...
Begin: 5.85863e+07
0 5.85437e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411710812
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411710812
fLifetime: 30000 [us]
13-Jan-2026 11:25:51 CET Closed output file "reco_stage1.root"
13-Jan-2026 11:25:51 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 277.159 324.311 412.679 309.16 39.8168 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000979162 0.00313253 0.0049695 0.0033164 0.00142689 10
reco:ophit:OpHitFinder 0.222919 0.264513 0.388345 0.255689 0.0438217 10
reco:opflash:OpFlashFinder 0.130143 0.193912 0.243841 0.199771 0.0312254 10
reco:opslicer:OpSlicer 0.449327 0.574517 0.646487 0.601686 0.0652244 10
reco:caldata:DataPrepModule 3.76151 4.09298 5.67069 3.89438 0.549717 10
reco:wclsdatasp:WireCellToolkit 26.4604 27.9325 35.4412 27.2598 2.52178 10
reco:gaushit:GausHitFinder 0.790657 1.14564 1.9611 1.06411 0.302369 10
reco:nhitsfilter:NumberOfHitsFilter 0.000346128 0.000494522 0.000822189 0.000420555 0.000153296 10
reco:reco3d:SpacePointSolver 9.1882 15.238 18.7579 16.2486 3.40907 10
reco:hitpdune:DisambigFromSpacePoints 1.07392 1.63093 2.90772 1.56243 0.467042 10
reco:pandora:StandardPandora 19.3385 35.1561 65.1446 30.7267 11.828 10
reco:pandoraWriter:StandardPandora 0.289902 0.347988 0.414732 0.334451 0.041111 10
reco:pandoraTrack:LArPandoraTrackCreation 2.62334 4.27803 6.40154 3.68234 1.35111 10
reco:pandoraShower:LArPandoraShowerCreation 2.99184 5.48051 8.3258 4.94916 1.99084 10
reco:pandoracalo:Calorimetry 1.54751 2.34239 3.77189 2.17055 0.669885 10
reco:pandoracalonosce:Calorimetry 1.4695 2.13264 3.59312 1.98532 0.608132 10
reco:pandorapid:Chi2ParticleID 0.00375187 0.004467 0.00603821 0.00416322 0.000712044 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0359029 0.0411388 0.0560773 0.0401352 0.00531369 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00318806 0.00399471 0.00473509 0.00403005 0.000433473 10
reco:pandoraShowercalo:ShowerCalorimetry 3.17772 5.79997 8.51518 5.54122 1.8126 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.32717 5.66984 7.86639 5.36386 1.64933 10
reco:emtrkmichelid:EmTrackMichelId 137.605 157.028 186.524 154.501 13.1507 10
reco:crttag:SingleCRTMatchingProducer 0.00761738 0.0149747 0.0265944 0.0151577 0.00583973 10
reco:crtreco:TwoCRTMatchingProducer 0.00600699 0.013229 0.0237121 0.0127452 0.00649651 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.694352 0.827093 0.921071 0.837555 0.0718123 10
reco:pandora2Track:LArPandoraTrackCreation 8.6907 15.9195 25.458 15.1239 5.13459 10
reco:pandora2calo:Calorimetry 4.96052 8.37685 12.8087 7.98253 2.58957 10
reco:pandora2calonosce:Calorimetry 4.58215 8.36955 15.494 8.23453 2.98969 10
reco:pandora2pid:Chi2ParticleID 0.00888776 0.0104299 0.0128184 0.010122 0.00117027 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0455116 0.0516296 0.059736 0.0513156 0.00442558 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00897601 0.0105405 0.0128225 0.0103811 0.00114622 10
reco:pandora2Shower:LArPandoraShowerCreation 3.55796 5.59205 7.86671 5.60538 1.48107 10
reco:pandora2Showercalo:ShowerCalorimetry 4.2005 6.89322 8.77985 6.83498 1.65196 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.78383 6.30937 9.45496 5.96941 1.64198 10
[art]:TriggerResults:TriggerResultInserter 2.16e-05 3.99287e-05 8.1092e-05 3.56755e-05 1.60703e-05 10
end_path:out1:RootOutput 4.1e-06 5.701e-06 9.17e-06 5.195e-06 1.52867e-06 10
end_path:out1:RootOutput(write) 2.02509 2.43655 2.87852 2.47082 0.243269 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5358.58 MB
Peak resident set size usage (VmHWM): 4551.22 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.67 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11537848
-rw-r--r-- 1 dune001 dune 2660553316 Jan 13 10:29 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2525113074 Jan 13 10:28 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2399250585 Jan 13 11:25 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2114635846 Jan 13 08:09 g4_stage2.root
-rw-r--r-- 1 dune001 dune 2027027924 Jan 13 07:31 g4_stage1.root
-rw-r--r-- 1 dune001 dune 87547480 Jan 13 11:22 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242942 Jan 13 11:25 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 13 11:25 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 13 11:25 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 13 11:25 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 13 10:29 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 13 08:09 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 13 11:25 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 13 07:11 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 13 11:25 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 13 10:36 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 13 10:29 debugprod.log