Jobsub ID 256115.0@dunegpschedd01.fnal.gov
| Jobsub ID | 256115.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10582 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-24 10:42:01 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-24 14:37:06 |
| From worker node | Hostname | dunegli-7712094-0-fnpc18006.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-24 10:42:56 |
| Input files | monte-carlo-010582-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14014s) |
| CPU time | 3h (13884s = 99%) |
| Max RSS bytes | 4133654528 (3942 MiB) |
| Outputting started | 2025-11-24 14:36:30 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10582/1/001/reco_stage1.root
|
| Finished | 2025-11-24 14:37:06 |
| Saved logs | justin-logs:256115.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
are: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 104108 traces, 0 summary
Retagger: tagging trace set: gauss with 77845 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77845 traces tagged "gauss"
FrameSaver: q=2.77039e+06 n=1360194 tag=gauss
wclsFrameSaver: saving 104108 traces tagged "wiener"
FrameSaver: q=2.91533e+06 n=1187544 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36661 XUs and 31549 XVs -> 385 XUVs
C:0 T:1 114340 XUs and 73910 XVs -> 10931 XUVs
C:0 T:2 60101 XUs and 69192 XVs -> 3530 XUVs
C:0 T:3 21631 XUs and 24567 XVs -> 193 XUVs
C:0 T:4 8616 XUs and 9563 XVs -> 124 XUVs
C:0 T:5 28957 XUs and 39527 XVs -> 4000 XUVs
C:0 T:6 127236 XUs and 109970 XVs -> 5656 XUVs
C:0 T:7 51886 XUs and 42683 XVs -> 455 XUVs
C:0 T:8 3900 XUs and 4929 XVs -> 44 XUVs
C:0 T:9 22928 XUs and 33354 XVs -> 1741 XUVs
C:0 T:10 32515 XUs and 41817 XVs -> 7242 XUVs
C:0 T:11 186 XUs and 128 XVs -> 18 XUVs
34319 XUVs total
9252 collection wire objects
31394 potential space points
Neighbour search...
3584050 tests to find 1685738 neighbours
Iterating with no regularization...
Begin: 6.28747e+07
0 4.92548e+07
1 4.84291e+07
2 4.83008e+07
3 4.82601e+07
Now with regularization...
Begin: 4.02366e+07
0 4.02014e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410708706
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410708706
fLifetime: 30000 [us]
24-Nov-2025 14:36:28 UTC Closed output file "reco_stage1.root"
24-Nov-2025 14:36:28 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 360.95 511.609 680.358 496.704 90.2277 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00123242 0.00426594 0.00648738 0.00443733 0.00165551 10
reco:ophit:OpHitFinder 0.263201 0.341072 0.430064 0.353764 0.0481168 10
reco:opflash:OpFlashFinder 0.153287 0.18663 0.243828 0.181221 0.0309031 10
reco:opslicer:OpSlicer 0.614698 0.844296 1.15401 0.804091 0.188372 10
reco:caldata:DataPrepModule 6.03372 7.33768 9.52791 6.60965 1.31962 10
reco:wclsdatasp:WireCellToolkit 34.619 47.9683 58.93 49.0943 6.19299 10
reco:gaushit:GausHitFinder 1.05065 1.56683 2.56701 1.44462 0.445429 10
reco:nhitsfilter:NumberOfHitsFilter 0.000604832 0.000829561 0.00115591 0.000827982 0.000144524 10
reco:reco3d:SpacePointSolver 11.6355 18.2104 32.8922 15.8541 6.14724 10
reco:hitpdune:DisambigFromSpacePoints 1.10469 1.92091 3.74478 1.71374 0.709629 10
reco:pandora:StandardPandora 24.6372 46.9028 94.9418 41.2486 18.5325 10
reco:pandoraWriter:StandardPandora 0.442089 0.630117 0.897329 0.607767 0.131411 10
reco:pandoraTrack:LArPandoraTrackCreation 5.5491 8.72733 11.9011 7.8869 2.43697 10
reco:pandoraShower:LArPandoraShowerCreation 6.25091 10.03 14.1067 10.4903 2.86659 10
reco:pandoracalo:Calorimetry 2.64287 4.49343 6.27755 4.104 1.40706 10
reco:pandoracalonosce:Calorimetry 2.4882 4.20799 6.4286 3.83189 1.39821 10
reco:pandorapid:Chi2ParticleID 0.0063453 0.00840814 0.0132976 0.00752855 0.00223725 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0439878 0.0744851 0.122737 0.0592546 0.0305514 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00540056 0.00803464 0.0126155 0.00707786 0.00230065 10
reco:pandoraShowercalo:ShowerCalorimetry 4.72857 9.50338 15.2936 8.8539 3.50526 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.57002 8.95796 14.4213 8.66549 3.02072 10
reco:emtrkmichelid:EmTrackMichelId 174.65 251.199 326.123 248.194 43.2514 10
reco:crttag:SingleCRTMatchingProducer 0.0244264 0.0280298 0.0328307 0.0264928 0.00308591 10
reco:crtreco:TwoCRTMatchingProducer 0.0170278 0.0220541 0.0266231 0.022193 0.00304812 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.912075 1.22698 1.43507 1.25217 0.175813 10
reco:pandora2Track:LArPandoraTrackCreation 17.9159 27.3539 34.4547 27.8576 5.75867 10
reco:pandora2calo:Calorimetry 8.42347 12.9908 17.649 12.5654 3.13012 10
reco:pandora2calonosce:Calorimetry 7.5776 12.4352 18.4772 12.2466 3.58093 10
reco:pandora2pid:Chi2ParticleID 0.013703 0.0205678 0.0278862 0.02048 0.00444345 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0702897 0.102939 0.155487 0.0914444 0.0287244 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.013674 0.0205858 0.0265863 0.0201993 0.00437761 10
reco:pandora2Shower:LArPandoraShowerCreation 7.11743 9.99416 13.2768 9.60566 2.02223 10
reco:pandora2Showercalo:ShowerCalorimetry 6.37438 10.6936 15.7972 9.84866 3.13299 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.24073 9.40254 13.9144 8.42661 2.65503 10
[art]:TriggerResults:TriggerResultInserter 6.5854e-05 8.63731e-05 0.000130677 8.4249e-05 1.81104e-05 10
end_path:out1:RootOutput 1.0941e-05 1.35095e-05 1.5419e-05 1.35205e-05 1.26853e-06 10
end_path:out1:RootOutput(write) 3.20236 3.96366 4.98542 3.83676 0.623356 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4949.57 MB
Peak resident set size usage (VmHWM): 4133.65 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.62 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9433740
-rw-r--r-- 1 dunegli fnalgrid 2251880198 Nov 24 13:08 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2142333681 Nov 24 13:06 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1909321005 Nov 24 14:36 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1675820361 Nov 24 11:01 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1611806904 Nov 24 10:48 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 68376790 Nov 24 14:31 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242865 Nov 24 14:36 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 24 14:36 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 24 14:36 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 24 14:36 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 13:08 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 11:01 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 14:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 24 10:42 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 24 14:36 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 13:14 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 13:08 debugprod.log
