Jobsub ID 261517.0@dunegpschedd02.fnal.gov
| Jobsub ID | 261517.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11183 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 08:07:11 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 15:47:17 |
| From worker node | Hostname | dunegli-7890439-0-fnpc19135.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:22 |
| Input files | monte-carlo-011183-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15020s) |
| CPU time | 4h (14861s = 98%) |
| Max RSS bytes | 4385951744 (4182 MiB) |
| Outputting started | 2025-12-12 15:46:43 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11183/1/001/reco_stage1.root
|
| Finished | 2025-12-12 15:47:17 |
| Saved logs | justin-logs:261517.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
repare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 148789 traces, 0 summary
Retagger: tagging trace set: gauss with 116988 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 116988 traces tagged "gauss"
FrameSaver: q=4.21454e+06 n=2147887 tag=gauss
wclsFrameSaver: saving 148789 traces tagged "wiener"
FrameSaver: q=4.45681e+06 n=1927073 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 53471 XUs and 39579 XVs -> 686 XUVs
C:0 T:1 104136 XUs and 85176 XVs -> 8624 XUVs
C:0 T:2 116418 XUs and 158058 XVs -> 10802 XUVs
C:0 T:3 52862 XUs and 62084 XVs -> 432 XUVs
C:0 T:4 18580 XUs and 19339 XVs -> 192 XUVs
C:0 T:5 77587 XUs and 59088 XVs -> 8161 XUVs
C:0 T:6 77911 XUs and 79207 XVs -> 2765 XUVs
C:0 T:7 33915 XUs and 34937 XVs -> 175 XUVs
C:0 T:8 8768 XUs and 5057 XVs -> 64 XUVs
C:0 T:9 70147 XUs and 53075 XVs -> 4829 XUVs
C:0 T:10 68237 XUs and 44664 XVs -> 10594 XUVs
C:0 T:11 517 XUs and 363 XVs -> 133 XUVs
47457 XUVs total
13329 collection wire objects
43509 potential space points
Neighbour search...
4584287 tests to find 2349706 neighbours
Iterating with no regularization...
Begin: 9.96162e+07
0 8.46183e+07
1 8.35237e+07
2 8.33648e+07
3 8.3317e+07
Now with regularization...
Begin: 6.92757e+07
0 6.92247e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058630
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058630
fLifetime: 30000 [us]
12-Dec-2025 15:46:40 UTC Closed output file "reco_stage1.root"
12-Dec-2025 15:46:40 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 350.959 562.958 725.637 579.73 107.514 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00186708 0.00520112 0.00947694 0.00559647 0.00221765 10
reco:ophit:OpHitFinder 0.266087 0.315785 0.36797 0.316133 0.025983 10
reco:opflash:OpFlashFinder 0.185885 0.237856 0.289694 0.243091 0.0313692 10
reco:opslicer:OpSlicer 0.513506 0.714495 0.835921 0.732242 0.0803305 10
reco:caldata:DataPrepModule 4.98398 5.16333 5.30888 5.17564 0.101059 10
reco:wclsdatasp:WireCellToolkit 39.5977 47.8061 52.7333 48.2663 3.79693 10
reco:gaushit:GausHitFinder 0.946096 1.36738 1.64026 1.38159 0.195114 10
reco:nhitsfilter:NumberOfHitsFilter 0.00192681 0.00218619 0.00274879 0.00207434 0.000267687 10
reco:reco3d:SpacePointSolver 9.72617 17.4716 22.855 17.9152 3.50266 10
reco:hitpdune:DisambigFromSpacePoints 1.17006 2.1381 2.8409 2.08754 0.503296 10
reco:pandora:StandardPandora 21.9262 52.4986 78.4519 50.6392 15.2977 10
reco:pandoraWriter:StandardPandora 0.615572 0.771646 0.913118 0.797967 0.0999946 10
reco:pandoraTrack:LArPandoraTrackCreation 10.8355 15.0193 22.671 13.2337 3.97837 10
reco:pandoraShower:LArPandoraShowerCreation 5.75887 18.1657 28.6877 18.8913 6.58784 10
reco:pandoracalo:Calorimetry 3.70284 6.55246 10.2521 6.92105 2.06789 10
reco:pandoracalonosce:Calorimetry 3.61948 6.24838 9.54667 6.18581 1.67824 10
reco:pandorapid:Chi2ParticleID 0.00653113 0.00776572 0.0124292 0.00703824 0.00171494 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0486107 0.0598948 0.0666006 0.0617912 0.00603009 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00560195 0.00655826 0.00784765 0.00650553 0.000782394 10
reco:pandoraShowercalo:ShowerCalorimetry 6.18953 17.3673 33.4992 17.1764 7.34408 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.85447 16.1059 27.1611 16.4544 6.45316 10
reco:emtrkmichelid:EmTrackMichelId 158.603 214.819 246.021 221.687 27.4025 10
reco:crttag:SingleCRTMatchingProducer 0.017566 0.036842 0.0509247 0.0382022 0.00934625 10
reco:crtreco:TwoCRTMatchingProducer 0.0195608 0.0321432 0.0447159 0.0326159 0.0071186 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.701019 1.00657 1.26873 0.996231 0.187941 10
reco:pandora2Track:LArPandoraTrackCreation 20.3363 44.6349 65.2629 44.5773 13.1372 10
reco:pandora2calo:Calorimetry 8.94399 22.8304 37.3749 22.1554 7.8122 10
reco:pandora2calonosce:Calorimetry 9.12314 22.8268 34.7846 22.8561 7.91183 10
reco:pandora2pid:Chi2ParticleID 0.0121695 0.0190573 0.0246031 0.0188328 0.00352154 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0591785 0.0828003 0.105476 0.0850181 0.0122414 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0118377 0.0179748 0.0256032 0.0173717 0.00343449 10
reco:pandora2Shower:LArPandoraShowerCreation 7.09023 14.8062 20.7591 15.8767 4.27395 10
reco:pandora2Showercalo:ShowerCalorimetry 7.30997 17.3272 29.0938 18.946 6.7224 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.60981 12.7486 18.8284 14.4857 4.32666 10
[art]:TriggerResults:TriggerResultInserter 6.1631e-05 0.000104401 0.000253303 7.2436e-05 6.01902e-05 10
end_path:out1:RootOutput 1.164e-05 0.000117145 0.00102669 1.3765e-05 0.000303225 10
end_path:out1:RootOutput(write) 2.49101 3.38837 4.00111 3.48115 0.47118 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5198.63 MB
Peak resident set size usage (VmHWM): 4385.95 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.94 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11348376
-rw-r--r-- 1 dunegli fnalgrid 2629250908 Dec 12 14:10 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2491729277 Dec 12 14:05 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2349672839 Dec 12 15:46 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2073515852 Dec 12 11:57 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1992225856 Dec 12 11:41 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 83522140 Dec 12 15:37 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242809 Dec 12 15:46 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 15:46 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 15:46 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 15:46 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:10 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 15:46 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 15:46 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 14:17 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 14:10 debugprod.log
