Jobsub ID 293863.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293863.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12279 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-22 22:09:30 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-23 01:51:19 |
| From worker node | Hostname | tdm003.pic.es |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 22:11:00 |
| Input files | monte-carlo-012279-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11420s) |
| CPU time | 3h (10860s = 95%) |
| Max RSS bytes | 4439552000 (4233 MiB) |
| Outputting started | 2026-01-23 01:21:22 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12279/1/001/reco_stage1.root
|
| Finished | 2026-01-23 01:51:10 |
| Saved logs | justin-logs:293863.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
l adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 142285 traces, 0 summary
Retagger: tagging trace set: gauss with 109170 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109170 traces tagged "gauss"
FrameSaver: q=3.92205e+06 n=1979561 tag=gauss
wclsFrameSaver: saving 142285 traces tagged "wiener"
FrameSaver: q=4.13851e+06 n=1763867 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 47028 XUs and 46452 XVs -> 1728 XUVs
C:0 T:1 153441 XUs and 130473 XVs -> 15947 XUVs
C:0 T:2 75922 XUs and 80146 XVs -> 7793 XUVs
C:0 T:3 36453 XUs and 35270 XVs -> 265 XUVs
C:0 T:4 20551 XUs and 20705 XVs -> 157 XUVs
C:0 T:5 74499 XUs and 62240 XVs -> 6434 XUVs
C:0 T:6 129729 XUs and 105972 XVs -> 4210 XUVs
C:0 T:7 62038 XUs and 44204 XVs -> 532 XUVs
C:0 T:8 6843 XUs and 6856 XVs -> 109 XUVs
C:0 T:9 42223 XUs and 51219 XVs -> 7826 XUVs
C:0 T:10 43877 XUs and 22964 XVs -> 3499 XUVs
C:0 T:11 109 XUs and 57 XVs -> 12 XUVs
48512 XUVs total
12210 collection wire objects
43890 potential space points
Neighbour search...
5157240 tests to find 2420076 neighbours
Iterating with no regularization...
Begin: 7.05451e+07
0 5.82544e+07
1 5.7295e+07
2 5.71469e+07
3 5.71048e+07
Now with regularization...
Begin: 4.61824e+07
0 4.61337e+07
1 4.60994e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411905251
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411905251
fLifetime: 30000 [us]
23-Jan-2026 02:21:19 CET Closed output file "reco_stage1.root"
23-Jan-2026 02:21:19 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 317.329 422.559 643.031 403.82 91.4385 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000939336 0.00376559 0.00626266 0.00353318 0.00178737 10
reco:ophit:OpHitFinder 0.247188 0.320076 0.359945 0.329893 0.0347629 10
reco:opflash:OpFlashFinder 0.120738 0.212982 0.270434 0.225598 0.0436032 10
reco:opslicer:OpSlicer 0.544861 0.757336 0.89253 0.769354 0.111136 10
reco:caldata:DataPrepModule 4.94042 5.37368 5.65456 5.45146 0.225375 10
reco:wclsdatasp:WireCellToolkit 34.7271 39.2331 43.049 39.727 2.42587 10
reco:gaushit:GausHitFinder 1.10865 1.41412 2.02127 1.31478 0.266656 10
reco:nhitsfilter:NumberOfHitsFilter 0.000474548 0.000646511 0.000834765 0.000612731 0.000109402 10
reco:reco3d:SpacePointSolver 10.2463 18.0211 40.6869 15.9219 8.30755 10
reco:hitpdune:DisambigFromSpacePoints 1.16388 1.87509 3.25392 1.72167 0.609035 10
reco:pandora:StandardPandora 25.9925 43.3873 84.7555 34.7574 18.383 10
reco:pandoraWriter:StandardPandora 0.388029 0.493192 0.696391 0.469474 0.0892836 10
reco:pandoraTrack:LArPandoraTrackCreation 2.66633 5.0893 7.73835 4.85008 1.52952 10
reco:pandoraShower:LArPandoraShowerCreation 2.87337 5.67046 11.2501 4.8077 2.44925 10
reco:pandoracalo:Calorimetry 1.40911 2.50608 3.93191 2.44537 0.711365 10
reco:pandoracalonosce:Calorimetry 1.24782 2.29417 3.43065 2.24438 0.63767 10
reco:pandorapid:Chi2ParticleID 0.00483552 0.00657988 0.00794458 0.00657233 0.000974062 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0445224 0.0565367 0.0794942 0.0545079 0.00948249 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00497442 0.00629298 0.00769532 0.00598136 0.000849915 10
reco:pandoraShowercalo:ShowerCalorimetry 2.39054 5.11969 9.37776 4.52283 1.91714 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.47949 4.99184 9.4409 4.25269 1.97667 10
reco:emtrkmichelid:EmTrackMichelId 186.307 235.15 324.075 228.336 39.9301 10
reco:crttag:SingleCRTMatchingProducer 0.00968705 0.0150842 0.0194646 0.0143825 0.0034033 10
reco:crtreco:TwoCRTMatchingProducer 0.00696978 0.0106563 0.0156919 0.0100031 0.0028206 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.824685 0.985158 1.35665 0.955313 0.1546 10
reco:pandora2Track:LArPandoraTrackCreation 7.80232 15.6106 30.1974 14.3359 6.13096 10
reco:pandora2calo:Calorimetry 3.40435 6.95822 13.6464 6.57309 2.91762 10
reco:pandora2calonosce:Calorimetry 3.18002 6.57055 12.3261 6.27016 2.67297 10
reco:pandora2pid:Chi2ParticleID 0.0115982 0.0164126 0.0236522 0.0160955 0.00319525 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0532387 0.0723466 0.107804 0.0697237 0.0147015 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0108058 0.0162063 0.0239128 0.0155936 0.00342822 10
reco:pandora2Shower:LArPandoraShowerCreation 2.8165 5.59931 10.2093 5.19959 2.1161 10
reco:pandora2Showercalo:ShowerCalorimetry 3.01009 5.84842 10.1038 5.52953 2.13243 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.7829 5.26931 9.02476 4.95474 1.84433 10
[art]:TriggerResults:TriggerResultInserter 4.328e-05 5.58918e-05 0.000114222 4.9715e-05 1.96696e-05 10
end_path:out1:RootOutput 6.62e-06 1.01693e-05 1.462e-05 9.8655e-06 1.83428e-06 10
end_path:out1:RootOutput(write) 2.58405 3.45924 4.94693 3.35484 0.642569 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5241.2 MB
Peak resident set size usage (VmHWM): 4439.55 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10616568
-rw-r--r-- 1 dune001 dune 2481377241 Jan 23 01:08 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2357351950 Jan 23 01:06 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2187826587 Jan 23 02:21 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1919132208 Jan 22 23:34 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1845053240 Jan 22 23:20 g4_stage1.root
-rw-r--r-- 1 dune001 dune 79994440 Jan 23 02:15 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242921 Jan 23 02:21 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 23 02:21 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 23 02:21 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 23 02:21 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 23 01:08 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 23:34 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 23 02:21 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 22 23:11 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 23 02:21 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 23 01:14 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 23 01:08 debugprod.log
