Jobsub ID 246359.0@dunegpschedd02.fnal.gov
| Jobsub ID | 246359.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10223 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-15 16:43:53 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-15 19:02:01 |
| From worker node | Hostname | dunegli-7767682-0-fnpc23031.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-15 16:48:31 |
| Input files | monte-carlo-010223-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7813s) |
| CPU time | 2h (7744s = 99%) |
| Max RSS bytes | 4350586880 (4149 MiB) |
| Outputting started | 2025-11-15 18:58:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10223/1/001/reco_stage1.root
|
| Finished | 2025-11-15 19:02:01 |
| Saved logs | justin-logs:246359.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
dFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 172524 traces, 0 summary
Retagger: tagging trace set: gauss with 129182 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 129182 traces tagged "gauss"
FrameSaver: q=4.60722e+06 n=2262989 tag=gauss
wclsFrameSaver: saving 172524 traces tagged "wiener"
FrameSaver: q=4.91739e+06 n=1986904 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 40669 XUs and 41051 XVs -> 646 XUVs
C:0 T:1 73248 XUs and 70515 XVs -> 5550 XUVs
C:0 T:2 254766 XUs and 264577 XVs -> 16588 XUVs
C:0 T:3 80399 XUs and 94121 XVs -> 1403 XUVs
C:0 T:4 13699 XUs and 10575 XVs -> 661 XUVs
C:0 T:5 39357 XUs and 21494 XVs -> 2643 XUVs
C:0 T:6 143531 XUs and 110854 XVs -> 9632 XUVs
C:0 T:7 46058 XUs and 36797 XVs -> 489 XUVs
C:0 T:8 10023 XUs and 9235 XVs -> 189 XUVs
C:0 T:9 74812 XUs and 69815 XVs -> 10589 XUVs
C:0 T:10 110582 XUs and 91081 XVs -> 13005 XUVs
C:0 T:11 128 XUs and 86 XVs -> 12 XUVs
61407 XUVs total
16295 collection wire objects
55884 potential space points
Neighbour search...
7761684 tests to find 3284640 neighbours
Iterating with no regularization...
Begin: 1.1176e+08
0 8.15424e+07
1 7.88649e+07
2 7.84281e+07
3 7.83025e+07
4 7.82512e+07
Now with regularization...
Begin: 6.23363e+07
0 6.21814e+07
1 6.21186e+07
2 6.20816e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410532709
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410532709
fLifetime: 30000 [us]
15-Nov-2025 18:58:43 UTC Closed output file "reco_stage1.root"
15-Nov-2025 18:58:43 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 196.341 235.879 300.084 228.228 37.4809 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000758532 0.00286728 0.00487371 0.00294506 0.0013289 10
reco:ophit:OpHitFinder 0.187279 0.208985 0.252245 0.205344 0.0173689 10
reco:opflash:OpFlashFinder 0.10294 0.135967 0.200836 0.133524 0.0250826 10
reco:opslicer:OpSlicer 0.368079 0.435606 0.545842 0.417177 0.0570871 10
reco:caldata:DataPrepModule 3.42846 3.52299 3.65443 3.52049 0.0612794 10
reco:wclsdatasp:WireCellToolkit 22.7349 23.5023 24.1916 23.5523 0.410278 10
reco:gaushit:GausHitFinder 0.705072 0.851366 1.0781 0.822693 0.113673 10
reco:nhitsfilter:NumberOfHitsFilter 0.000285788 0.000371014 0.000502112 0.000354178 6.63506e-05 10
reco:reco3d:SpacePointSolver 6.27013 10.5669 17.8875 9.39004 3.33638 10
reco:hitpdune:DisambigFromSpacePoints 0.885601 1.21948 1.79092 1.13917 0.304947 10
reco:pandora:StandardPandora 14.1262 27.7207 42.434 26.3402 8.72763 10
reco:pandoraWriter:StandardPandora 0.250793 0.291262 0.358528 0.274506 0.0405479 10
reco:pandoraTrack:LArPandoraTrackCreation 1.69056 2.44528 3.25799 2.52764 0.443439 10
reco:pandoraShower:LArPandoraShowerCreation 2.00766 2.81738 4.15455 2.64366 0.785823 10
reco:pandoracalo:Calorimetry 1.12161 1.48299 1.93853 1.50758 0.233793 10
reco:pandoracalonosce:Calorimetry 1.02489 1.37675 1.80279 1.40892 0.22315 10
reco:pandorapid:Chi2ParticleID 0.00289028 0.00386864 0.00454306 0.00392906 0.00043688 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0299822 0.0347392 0.0404452 0.0347068 0.00355247 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00275455 0.00343563 0.00385053 0.00354453 0.000344924 10
reco:pandoraShowercalo:ShowerCalorimetry 2.25016 3.22197 4.64532 3.02918 0.880341 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.20505 3.16104 4.52779 2.98645 0.852475 10
reco:emtrkmichelid:EmTrackMichelId 106.173 122.823 148.88 119.065 15.7946 10
reco:crttag:SingleCRTMatchingProducer 0.00539221 0.00895877 0.0126141 0.0088965 0.00205573 10
reco:crtreco:TwoCRTMatchingProducer 0.00384644 0.00512322 0.00609643 0.00522547 0.000578119 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.440318 0.608629 0.807396 0.60768 0.103264 10
reco:pandora2Track:LArPandoraTrackCreation 5.78122 8.1651 11.8087 7.90509 2.09897 10
reco:pandora2calo:Calorimetry 3.28404 4.48076 6.22385 4.40672 1.03574 10
reco:pandora2calonosce:Calorimetry 3.12661 4.26207 5.93169 4.14947 0.981577 10
reco:pandora2pid:Chi2ParticleID 0.00685834 0.00916033 0.0111609 0.00902071 0.00128118 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.036686 0.0439813 0.0533642 0.0434359 0.00592628 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00662553 0.00885421 0.0108816 0.00886261 0.00126807 10
reco:pandora2Shower:LArPandoraShowerCreation 2.16005 2.91487 3.95468 2.85815 0.649533 10
reco:pandora2Showercalo:ShowerCalorimetry 2.86344 3.87815 5.27681 3.77155 0.845372 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.66692 3.56184 4.77722 3.42654 0.765957 10
[art]:TriggerResults:TriggerResultInserter 3.4095e-05 4.86501e-05 0.000115862 4.2206e-05 2.25637e-05 10
end_path:out1:RootOutput 1.1562e-05 1.25378e-05 1.4588e-05 1.23585e-05 8.83166e-07 10
end_path:out1:RootOutput(write) 1.68816 2.04429 2.51672 1.9743 0.283647 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5166.7 MB
Peak resident set size usage (VmHWM): 4350.59 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10556860
-rw-r--r-- 1 dunegli fnalgrid 2479398504 Nov 15 18:18 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2358695118 Nov 15 18:16 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2194033282 Nov 15 18:58 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1886537271 Nov 15 16:59 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1808035537 Nov 15 16:51 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82900970 Nov 15 18:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243297 Nov 15 18:58 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 15 18:58 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 15 18:58 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 15 18:58 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 18:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 16:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 18:58 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 15 16:48 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 15 18:58 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:21 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:18 debugprod.log
