Jobsub ID 274689.0@dunegpschedd02.fnal.gov
| Jobsub ID | 274689.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12046 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 06:09:30 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce1 |
| Last heartbeat | 2026-01-18 11:08:03 |
| From worker node | Hostname | mahagon21.farm.particle.cz |
| cpuinfo | AMD EPYC 7301 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 06:09:55 |
| Input files | monte-carlo-012046-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17839s) |
| CPU time | 4h (17285s = 96%) |
| Max RSS bytes | 4183728128 (3989 MiB) |
| Outputting started | 2026-01-18 11:07:15 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12046/1/001/reco_stage1.root
|
| Finished | 2026-01-18 11:08:03 |
| Saved logs | justin-logs:274689.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
itPrepService:prepare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 95695 traces, 0 summary
Retagger: tagging trace set: gauss with 74125 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 74125 traces tagged "gauss"
FrameSaver: q=2.57587e+06 n=1356600 tag=gauss
wclsFrameSaver: saving 95695 traces tagged "wiener"
FrameSaver: q=2.70559e+06 n=1206737 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 39475 XUs and 36648 XVs -> 4499 XUVs
C:0 T:2 69859 XUs and 107097 XVs -> 4674 XUVs
C:0 T:3 31396 XUs and 44060 XVs -> 280 XUVs
C:0 T:4 8004 XUs and 9607 XVs -> 82 XUVs
C:0 T:5 40307 XUs and 33444 XVs -> 6232 XUVs
C:0 T:6 74041 XUs and 60040 XVs -> 4265 XUVs
C:0 T:7 23988 XUs and 21245 XVs -> 161 XUVs
C:0 T:8 6926 XUs and 6169 XVs -> 179 XUVs
C:0 T:9 32380 XUs and 35609 XVs -> 2340 XUVs
C:0 T:10 55045 XUs and 34186 XVs -> 6757 XUVs
C:0 T:11 68 XUs and 49 XVs -> 12 XUVs
29481 XUVs total
9303 collection wire objects
27793 potential space points
Neighbour search...
3098361 tests to find 1628842 neighbours
Iterating with no regularization...
Begin: 5.09153e+07
0 4.32167e+07
1 4.26924e+07
2 4.26041e+07
3 4.25764e+07
Now with regularization...
Begin: 3.55849e+07
0 3.55539e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411811254
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411811254
fLifetime: 30000 [us]
18-Jan-2026 12:07:12 CET Closed output file "reco_stage1.root"
18-Jan-2026 12:07:12 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 388.925 537.986 750.235 501.309 120.972 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00152337 0.00462828 0.00749791 0.00474011 0.0018925 10
reco:ophit:OpHitFinder 0.334427 0.419989 0.536711 0.393101 0.0695756 10
reco:opflash:OpFlashFinder 0.16413 0.251552 0.341955 0.258935 0.0493965 10
reco:opslicer:OpSlicer 0.861083 1.1387 1.46754 1.16708 0.225358 10
reco:caldata:DataPrepModule 6.16658 7.748 9.37944 7.82791 1.0427 10
reco:wclsdatasp:WireCellToolkit 45.7964 51.4355 63.2751 50.3164 4.83533 10
reco:gaushit:GausHitFinder 1.54689 1.78975 2.1485 1.7568 0.188253 10
reco:nhitsfilter:NumberOfHitsFilter 0.00050347 0.000716798 0.00103956 0.000656995 0.000193338 10
reco:reco3d:SpacePointSolver 9.13833 18.7836 24.796 20.7086 5.66922 10
reco:hitpdune:DisambigFromSpacePoints 1.16866 2.41346 3.56326 2.65357 0.771208 10
reco:pandora:StandardPandora 30.3063 59.4024 105.468 46.3701 28.437 10
reco:pandoraWriter:StandardPandora 0.504389 0.657139 0.940853 0.608342 0.125791 10
reco:pandoraTrack:LArPandoraTrackCreation 4.74996 7.63323 11.6276 7.34952 2.29442 10
reco:pandoraShower:LArPandoraShowerCreation 3.64244 8.42573 14.0253 8.97729 3.10401 10
reco:pandoracalo:Calorimetry 2.47552 4.17361 6.66382 4.19542 1.24593 10
reco:pandoracalonosce:Calorimetry 2.56041 3.98085 6.66618 3.64513 1.27631 10
reco:pandorapid:Chi2ParticleID 0.00658553 0.0106813 0.014579 0.010102 0.00240779 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0586028 0.0889457 0.114237 0.090961 0.0179797 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00608697 0.0101769 0.0155519 0.00938337 0.0028177 10
reco:pandoraShowercalo:ShowerCalorimetry 3.27653 8.36784 15.1705 7.90799 3.77719 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.47501 7.64377 13.7136 7.57823 3.20218 10
reco:emtrkmichelid:EmTrackMichelId 197.899 278.509 376.063 262.498 55.733 10
reco:crttag:SingleCRTMatchingProducer 0.0130228 0.0232162 0.0315536 0.0238254 0.00630285 10
reco:crtreco:TwoCRTMatchingProducer 0.00819347 0.014871 0.01966 0.0150659 0.00347931 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.943622 1.25616 1.48312 1.27236 0.170455 10
reco:pandora2Track:LArPandoraTrackCreation 11.6056 23.2591 34.4446 23.6872 7.58352 10
reco:pandora2calo:Calorimetry 4.56067 11.0744 18.8855 11.6448 4.01611 10
reco:pandora2calonosce:Calorimetry 4.0937 10.3433 15.9003 11.0007 3.35112 10
reco:pandora2pid:Chi2ParticleID 0.0147298 0.0225836 0.0365084 0.0207795 0.00649304 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0530518 0.0973482 0.157646 0.0940639 0.0275461 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0132944 0.0214334 0.0341114 0.0212865 0.00561015 10
reco:pandora2Shower:LArPandoraShowerCreation 3.64712 7.97392 12.8635 8.01148 2.5737 10
reco:pandora2Showercalo:ShowerCalorimetry 3.70793 8.9644 13.3384 10.1025 2.8427 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.68543 7.73486 12.0082 8.14367 2.45469 10
[art]:TriggerResults:TriggerResultInserter 7.2367e-05 0.000104025 0.00021171 8.63075e-05 3.91859e-05 10
end_path:out1:RootOutput 1.2002e-05 1.61975e-05 3.1379e-05 1.3986e-05 5.44158e-06 10
end_path:out1:RootOutput(write) 3.13405 4.1682 5.20363 3.90263 0.683801 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4999.14 MB
Peak resident set size usage (VmHWM): 4183.73 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.76 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10399192
-rw-r--r-- 1 fermilab users 2440314504 Jan 18 10:34 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2316138339 Jan 18 10:30 detsim_stage1.root
-rw-r--r-- 1 fermilab users 2126359390 Jan 18 12:07 reco_stage1.root
-rw-r--r-- 1 fermilab users 1885924164 Jan 18 07:40 g4_stage2.root
-rw-r--r-- 1 fermilab users 1804087569 Jan 18 07:19 g4_stage1.root
-rw-r--r-- 1 fermilab users 75319550 Jan 18 12:02 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 243008 Jan 18 12:07 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 18 12:07 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 18 12:07 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 18 12:07 time.db
-rw-r--r-- 1 fermilab users 519 Jan 18 10:34 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 18 07:40 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 18 12:07 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 18 07:09 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 18 12:07 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 18 10:41 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 18 10:34 debugprod.log
