Jobsub ID 296361.0@dunegpschedd02.fnal.gov
| Jobsub ID | 296361.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12490 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-28 16:18:52 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce2 |
| Last heartbeat | 2026-01-28 20:55:24 |
| From worker node | Hostname | mahagon17.farm.particle.cz |
| cpuinfo | AMD EPYC 7301 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-28 16:19:51 |
| Input files | monte-carlo-012490-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16373s) |
| CPU time | 4h (15710s = 95%) |
| Max RSS bytes | 4051410944 (3863 MiB) |
| Outputting started | 2026-01-28 20:52:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12490/1/001/reco_stage1.root
|
| Finished | 2026-01-28 20:55:24 |
| Saved logs | justin-logs:296361.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
oolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 110793 traces, 0 summary
Retagger: tagging trace set: gauss with 83184 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83184 traces tagged "gauss"
FrameSaver: q=2.95355e+06 n=1458806 tag=gauss
wclsFrameSaver: saving 110793 traces tagged "wiener"
FrameSaver: q=3.13097e+06 n=1287536 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 14641 XUs and 20607 XVs -> 164 XUVs
C:0 T:1 33160 XUs and 33378 XVs -> 3325 XUVs
C:0 T:2 64949 XUs and 77829 XVs -> 3274 XUVs
C:0 T:3 31230 XUs and 36069 XVs -> 156 XUVs
C:0 T:4 8173 XUs and 8963 XVs -> 195 XUVs
C:0 T:5 56239 XUs and 91662 XVs -> 15345 XUVs
C:0 T:6 98047 XUs and 126190 XVs -> 5496 XUVs
C:0 T:7 37265 XUs and 47772 XVs -> 435 XUVs
C:0 T:8 7240 XUs and 6783 XVs -> 80 XUVs
C:0 T:9 35027 XUs and 43846 XVs -> 3221 XUVs
C:0 T:10 38683 XUs and 28813 XVs -> 6124 XUVs
C:0 T:11 125 XUs and 83 XVs -> 15 XUVs
37830 XUVs total
9487 collection wire objects
35421 potential space points
Neighbour search...
5624597 tests to find 2364630 neighbours
Iterating with no regularization...
Begin: 5.6245e+07
0 4.47852e+07
1 4.39108e+07
2 4.37618e+07
3 4.3713e+07
4 4.36907e+07
Now with regularization...
Begin: 3.4255e+07
0 3.41731e+07
1 3.41052e+07
2 3.40473e+07
3 3.39985e+07
4 3.39574e+07
5 3.39241e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 412021006
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412021006
fLifetime: 30000 [us]
28-Jan-2026 21:52:43 CET Closed output file "reco_stage1.root"
28-Jan-2026 21:52:43 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 374.318 489.216 622.856 465.491 94.8244 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00153759 0.0039 0.00697999 0.00407881 0.00138894 10
reco:ophit:OpHitFinder 0.280071 0.345639 0.442364 0.341871 0.0431931 10
reco:opflash:OpFlashFinder 0.135527 0.179539 0.212186 0.176927 0.0238894 10
reco:opslicer:OpSlicer 0.691059 0.870285 1.25286 0.849012 0.151605 10
reco:caldata:DataPrepModule 6.34112 7.87212 9.69897 8.00578 0.947884 10
reco:wclsdatasp:WireCellToolkit 43.6445 53.4787 65.5859 53.8191 5.707 10
reco:gaushit:GausHitFinder 1.14551 1.59778 2.18151 1.52381 0.307705 10
reco:nhitsfilter:NumberOfHitsFilter 0.000420392 0.0007135 0.00131217 0.000634534 0.000281481 10
reco:reco3d:SpacePointSolver 8.67847 20.1317 48.6534 15.6616 11.8452 10
reco:hitpdune:DisambigFromSpacePoints 1.46441 2.04924 2.98047 1.78871 0.509672 10
reco:pandora:StandardPandora 25.0114 39.5158 70.71 29.4081 16.5977 10
reco:pandoraWriter:StandardPandora 0.436231 0.615983 0.804552 0.592472 0.124308 10
reco:pandoraTrack:LArPandoraTrackCreation 3.35923 5.43722 7.89517 5.30071 1.3262 10
reco:pandoraShower:LArPandoraShowerCreation 3.58504 6.27035 10.0545 5.70358 2.09126 10
reco:pandoracalo:Calorimetry 1.9236 3.01328 4.202 2.6748 0.846333 10
reco:pandoracalonosce:Calorimetry 1.63438 2.58478 3.56714 2.43765 0.653217 10
reco:pandorapid:Chi2ParticleID 0.00565135 0.00884527 0.0109956 0.00861035 0.00157324 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.065864 0.0823865 0.107335 0.0768402 0.0138238 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00528134 0.00782456 0.0099581 0.0080082 0.00163715 10
reco:pandoraShowercalo:ShowerCalorimetry 3.666 6.02263 9.22776 5.4249 2.15284 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.26246 5.90519 9.43684 4.80944 2.33931 10
reco:emtrkmichelid:EmTrackMichelId 206.397 274.563 354.603 269.671 50.7846 10
reco:crttag:SingleCRTMatchingProducer 0.0144606 0.02184 0.0363984 0.0189164 0.0073755 10
reco:crtreco:TwoCRTMatchingProducer 0.00948333 0.0140009 0.0211443 0.0125392 0.00387204 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.982278 1.25026 1.49167 1.26751 0.172172 10
reco:pandora2Track:LArPandoraTrackCreation 11.0713 17.1617 26.4292 14.6131 5.45355 10
reco:pandora2calo:Calorimetry 5.24175 8.43801 12.4698 7.5782 2.73718 10
reco:pandora2calonosce:Calorimetry 5.15911 7.62474 12.1135 6.43214 2.53231 10
reco:pandora2pid:Chi2ParticleID 0.0140049 0.0201933 0.0312411 0.0194862 0.0047558 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0551103 0.0970936 0.162911 0.0965186 0.0310366 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0135108 0.0203593 0.030521 0.0196436 0.00528029 10
reco:pandora2Shower:LArPandoraShowerCreation 4.31353 6.50484 9.36578 5.87569 1.82936 10
reco:pandora2Showercalo:ShowerCalorimetry 4.85868 7.12078 10.045 6.11766 2.05724 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.08647 6.45809 9.41327 5.31274 2.16558 10
[art]:TriggerResults:TriggerResultInserter 6.2328e-05 0.000106321 0.000231656 8.20245e-05 5.49033e-05 10
end_path:out1:RootOutput 1.048e-05 1.58239e-05 3.5517e-05 1.26795e-05 7.93917e-06 10
end_path:out1:RootOutput(write) 2.99746 3.79673 4.94224 3.5728 0.642351 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4863.64 MB
Peak resident set size usage (VmHWM): 4051.41 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.88 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9275532
-rw-r--r-- 1 fermilab users 2206878542 Jan 28 20:28 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2100448517 Jan 28 20:25 detsim_stage1.root
-rw-r--r-- 1 fermilab users 1857490219 Jan 28 21:52 reco_stage1.root
-rw-r--r-- 1 fermilab users 1664726022 Jan 28 17:48 g4_stage2.root
-rw-r--r-- 1 fermilab users 1601748111 Jan 28 17:31 g4_stage1.root
-rw-r--r-- 1 fermilab users 66227610 Jan 28 21:47 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 242910 Jan 28 21:52 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 28 21:52 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 28 21:52 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 28 21:52 time.db
-rw-r--r-- 1 fermilab users 519 Jan 28 20:28 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 28 17:48 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 28 21:52 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 28 17:19 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 28 21:52 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 28 20:38 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 28 20:28 debugprod.log
