Jobsub ID 265392.0@dunegpschedd02.fnal.gov
| Jobsub ID | 265392.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11458 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 07:48:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 12:20:14 |
| From worker node | Hostname | dunegli-8053767-0-fnpc17129.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 08:17:09 |
| Input files | monte-carlo-011458-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (14569s) |
| CPU time | 3h (13486s = 92%) |
| Max RSS bytes | 4167741440 (3974 MiB) |
| Outputting started | 2026-01-01 12:19:59 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11458/1/001/reco_stage1.root
|
| Finished | 2026-01-01 12:20:14 |
| Saved logs | justin-logs:265392.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
llSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 97168 traces, 0 summary
Retagger: tagging trace set: gauss with 72567 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 72567 traces tagged "gauss"
FrameSaver: q=2.57204e+06 n=1251819 tag=gauss
wclsFrameSaver: saving 97168 traces tagged "wiener"
FrameSaver: q=2.72874e+06 n=1102422 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 14830 XUs and 18896 XVs -> 84 XUVs
C:0 T:1 27245 XUs and 33106 XVs -> 1687 XUVs
C:0 T:2 143360 XUs and 95779 XVs -> 14945 XUVs
C:0 T:4 8030 XUs and 8553 XVs -> 59 XUVs
C:0 T:5 21723 XUs and 19168 XVs -> 2750 XUVs
C:0 T:6 69985 XUs and 74563 XVs -> 7060 XUVs
C:0 T:7 23924 XUs and 25077 XVs -> 264 XUVs
C:0 T:8 4086 XUs and 3858 XVs -> 36 XUVs
C:0 T:9 25148 XUs and 33206 XVs -> 3047 XUVs
C:0 T:10 29311 XUs and 32050 XVs -> 4997 XUVs
C:0 T:11 455 XUs and 443 XVs -> 70 XUVs
34999 XUVs total
7866 collection wire objects
32365 potential space points
Neighbour search...
6109883 tests to find 2611432 neighbours
Iterating with no regularization...
Begin: 8.1118e+07
0 6.3931e+07
1 6.25375e+07
2 6.24625e+07
3 6.24416e+07
Now with regularization...
Begin: 5.51655e+07
0 5.51092e+07
1 5.50868e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411470694
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411470694
fLifetime: 30000 [us]
01-Jan-2026 12:19:35 UTC Closed output file "reco_stage1.root"
01-Jan-2026 12:19:35 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 293.089 462.16 690.349 413.86 132.283 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00139631 0.00362198 0.00550664 0.00376417 0.00138023 10
reco:ophit:OpHitFinder 0.237069 0.310012 0.460897 0.293478 0.0644324 10
reco:opflash:OpFlashFinder 0.171827 0.238526 0.354819 0.217103 0.0598031 10
reco:opslicer:OpSlicer 0.473911 0.678532 1.11201 0.655794 0.183096 10
reco:caldata:DataPrepModule 5.81148 6.41054 7.70942 6.28464 0.506329 10
reco:wclsdatasp:WireCellToolkit 48.5218 52.9095 62.5263 51.6179 3.93905 10
reco:gaushit:GausHitFinder 1.04245 1.49274 2.01656 1.39047 0.289207 10
reco:nhitsfilter:NumberOfHitsFilter 0.000561545 0.000768646 0.000935629 0.000764536 0.000140488 10
reco:reco3d:SpacePointSolver 7.92059 16.5813 34.3608 12.7443 7.73519 10
reco:hitpdune:DisambigFromSpacePoints 1.25026 2.3434 3.98021 2.02853 0.942538 10
reco:pandora:StandardPandora 15.7151 41.7134 83.7278 33.2248 21.2433 10
reco:pandoraWriter:StandardPandora 0.364741 0.537703 0.726726 0.510909 0.124557 10
reco:pandoraTrack:LArPandoraTrackCreation 5.83103 10.583 17.3342 9.4698 3.94278 10
reco:pandoraShower:LArPandoraShowerCreation 4.718 11.752 21.7271 9.36356 6.17485 10
reco:pandoracalo:Calorimetry 2.46793 4.63808 7.49588 4.33584 1.7936 10
reco:pandoracalonosce:Calorimetry 2.24993 4.33106 6.71788 4.19293 1.6934 10
reco:pandorapid:Chi2ParticleID 0.00516527 0.0064474 0.00828598 0.00656298 0.00105431 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0467563 0.0686279 0.0880864 0.0699242 0.0132124 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00511316 0.00616736 0.00790239 0.00613252 0.000921621 10
reco:pandoraShowercalo:ShowerCalorimetry 3.69387 10.12 18.3523 8.63335 5.29915 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.4482 9.78848 19.0909 8.05676 5.32305 10
reco:emtrkmichelid:EmTrackMichelId 137.848 197.035 264.037 186.876 41.1319 10
reco:crttag:SingleCRTMatchingProducer 0.0187386 0.0288906 0.0382294 0.0286635 0.00682515 10
reco:crtreco:TwoCRTMatchingProducer 0.0124448 0.0225274 0.0320736 0.0216332 0.00686775 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.944984 1.31484 1.78043 1.26796 0.268272 10
reco:pandora2Track:LArPandoraTrackCreation 16.0695 32.2286 54.5722 28.4131 13.7676 10
reco:pandora2calo:Calorimetry 5.98654 13.1316 23.3632 10.4571 6.02771 10
reco:pandora2calonosce:Calorimetry 5.52182 12.1675 22.6913 10.4462 5.67156 10
reco:pandora2pid:Chi2ParticleID 0.0108269 0.0144937 0.0198427 0.0130065 0.0031749 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0547831 0.0988327 0.232872 0.0863398 0.0481333 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0106376 0.0142077 0.0198311 0.0127119 0.0030811 10
reco:pandora2Shower:LArPandoraShowerCreation 4.72609 9.23457 15.9136 8.25418 3.75969 10
reco:pandora2Showercalo:ShowerCalorimetry 4.73486 10.1551 17.0611 9.41851 4.16209 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.805 8.52489 14.507 8.38773 3.34395 10
[art]:TriggerResults:TriggerResultInserter 6.1111e-05 9.47356e-05 0.00016623 8.52115e-05 3.17061e-05 10
end_path:out1:RootOutput 8.859e-06 1.03572e-05 1.5266e-05 9.841e-06 1.77801e-06 10
end_path:out1:RootOutput(write) 2.0023 3.49703 6.09524 3.32005 1.35551 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4981.6 MB
Peak resident set size usage (VmHWM): 4167.74 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.83 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10005040
-rw-r--r-- 1 dunegli fnalgrid 2356199335 Jan 1 10:59 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2236723978 Jan 1 10:47 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2032308849 Jan 1 12:19 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1812298283 Jan 1 08:39 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1734601574 Jan 1 08:23 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72397730 Jan 1 12:16 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242825 Jan 1 12:19 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 12:19 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 12:19 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 12:19 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 10:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 08:39 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 12:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 08:17 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 12:19 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 11:05 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 10:59 debugprod.log
