Jobsub ID 265423.1@dunegpschedd02.fnal.gov
| Jobsub ID | 265423.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11461 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 16:11:23 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2026-01-01 20:08:58 |
| From worker node | Hostname | dunegli-49724-0-cmswn2357.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 16:27:18 |
| Input files | monte-carlo-011461-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13285s) |
| CPU time | 3h (13209s = 99%) |
| Max RSS bytes | 4732092416 (4512 MiB) |
| Outputting started | 2026-01-01 20:08:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11461/1/001/reco_stage1.root
|
| Finished | 2026-01-01 20:08:58 |
| Saved logs | justin-logs:265423.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
are: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 118048 traces, 0 summary
Retagger: tagging trace set: gauss with 91320 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91320 traces tagged "gauss"
FrameSaver: q=3.18105e+06 n=1629849 tag=gauss
wclsFrameSaver: saving 118048 traces tagged "wiener"
FrameSaver: q=3.37021e+06 n=1459201 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19096 XUs and 24704 XVs -> 99 XUVs
C:0 T:1 25160 XUs and 28948 XVs -> 2197 XUVs
C:0 T:2 93034 XUs and 115479 XVs -> 7142 XUVs
C:0 T:3 41137 XUs and 47380 XVs -> 748 XUVs
C:0 T:4 10362 XUs and 10870 XVs -> 103 XUVs
C:0 T:5 24825 XUs and 21193 XVs -> 2304 XUVs
C:0 T:6 158157 XUs and 169476 XVs -> 8187 XUVs
C:0 T:7 56806 XUs and 63578 XVs -> 727 XUVs
C:0 T:8 5645 XUs and 5821 XVs -> 29 XUVs
C:0 T:9 26050 XUs and 36805 XVs -> 1696 XUVs
C:0 T:10 33447 XUs and 20158 XVs -> 2751 XUVs
C:0 T:11 439 XUs and 321 XVs -> 71 XUVs
26054 XUVs total
9083 collection wire objects
22911 potential space points
Neighbour search...
1123021 tests to find 607950 neighbours
Iterating with no regularization...
Begin: 6.05002e+07
0 5.34259e+07
1 5.28281e+07
2 5.27491e+07
3 5.27282e+07
Now with regularization...
Begin: 4.38539e+07
0 4.38522e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411477807
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411477807
fLifetime: 30000 [us]
01-Jan-2026 20:08:42 UTC Closed output file "reco_stage1.root"
01-Jan-2026 20:08:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 293.215 433.568 740.856 389.94 127.105 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000829518 0.00326259 0.00584386 0.00325925 0.00149382 10
reco:ophit:OpHitFinder 0.242792 0.261179 0.305024 0.248919 0.0203102 10
reco:opflash:OpFlashFinder 0.129658 0.172783 0.233724 0.164262 0.0286244 10
reco:opslicer:OpSlicer 0.600257 0.679209 0.815869 0.680934 0.0627444 10
reco:caldata:DataPrepModule 5.22092 5.38896 5.61517 5.36096 0.127333 10
reco:wclsdatasp:WireCellToolkit 41.3848 49.6168 54.8503 52.1758 5.27561 10
reco:gaushit:GausHitFinder 1.25664 1.56283 2.17482 1.45629 0.288897 10
reco:nhitsfilter:NumberOfHitsFilter 0.000344752 0.000529144 0.000863432 0.000509595 0.000163584 10
reco:reco3d:SpacePointSolver 9.48524 19.6224 41.0833 15.2081 10.7416 10
reco:hitpdune:DisambigFromSpacePoints 1.72896 2.93937 5.18598 2.76493 0.992932 10
reco:pandora:StandardPandora 23.4796 60.3047 187.762 43.724 46.0344 10
reco:pandoraWriter:StandardPandora 0.370311 0.504106 1.00293 0.435445 0.180633 10
reco:pandoraTrack:LArPandoraTrackCreation 3.45403 5.22426 9.92365 3.97032 2.21207 10
reco:pandoraShower:LArPandoraShowerCreation 3.17018 5.83694 10.9717 4.9133 2.35022 10
reco:pandoracalo:Calorimetry 1.93336 2.84428 4.71263 2.32007 1.00077 10
reco:pandoracalonosce:Calorimetry 1.72856 2.58517 4.44368 2.08969 0.961773 10
reco:pandorapid:Chi2ParticleID 0.00511181 0.00642745 0.00872829 0.00593691 0.00125244 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0576302 0.0758087 0.0919283 0.0730922 0.011825 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0048555 0.00604848 0.00847466 0.00550135 0.00129415 10
reco:pandoraShowercalo:ShowerCalorimetry 3.39464 6.28648 10.4424 5.60437 2.20224 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.29558 6.1951 10.2393 5.51592 2.19982 10
reco:emtrkmichelid:EmTrackMichelId 154.171 202.12 295.773 189.438 40.3754 10
reco:crttag:SingleCRTMatchingProducer 0.0166543 0.0187079 0.0217367 0.0187043 0.00153281 10
reco:crtreco:TwoCRTMatchingProducer 0.00989632 0.0113853 0.0131281 0.0114417 0.000947327 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.28753 1.95705 2.56948 1.86052 0.372161 10
reco:pandora2Track:LArPandoraTrackCreation 11.1701 18.3577 33.6873 15.1348 7.18715 10
reco:pandora2calo:Calorimetry 5.50528 8.71951 15.0684 7.40553 3.06938 10
reco:pandora2calonosce:Calorimetry 4.62758 8.20582 14.2806 7.12663 2.95561 10
reco:pandora2pid:Chi2ParticleID 0.0129917 0.0165482 0.0238446 0.0149096 0.00354933 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0698132 0.095942 0.122314 0.0957004 0.0170381 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0126119 0.0161229 0.0228567 0.0145033 0.00346799 10
reco:pandora2Shower:LArPandoraShowerCreation 3.64253 6.36796 12.4161 5.43515 2.54198 10
reco:pandora2Showercalo:ShowerCalorimetry 4.31919 7.56804 13.0067 6.59778 2.6197 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.02426 6.99588 11.8015 6.21455 2.30013 10
[art]:TriggerResults:TriggerResultInserter 3.4966e-05 5.2001e-05 0.000114226 4.73585e-05 2.15174e-05 10
end_path:out1:RootOutput 7.555e-06 9.3266e-06 1.433e-05 8.6835e-06 1.90119e-06 10
end_path:out1:RootOutput(write) 2.26819 2.91529 4.16453 2.64173 0.605719 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5549.68 MB
Peak resident set size usage (VmHWM): 4732.09 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.47 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11240032
-rw-r--r-- 1 dunegli fnalgrid 2621687313 Jan 1 18:54 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2496103304 Jan 1 18:52 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2352517049 Jan 1 20:08 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2036307828 Jan 1 16:46 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1916406053 Jan 1 16:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 86157630 Jan 1 20:04 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243100 Jan 1 20:08 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 20:08 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 20:08 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 20:08 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 18:54 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 16:46 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 20:08 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 16:27 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 20:08 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:59 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:54 debugprod.log
