Jobsub ID 249739.1@dunegpschedd01.fnal.gov
| Jobsub ID | 249739.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10179 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 10:12:21 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 14:00:12 |
| From worker node | Hostname | dunegli-7594222-0-fnpc23023.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 11:56:03 |
| Input files | monte-carlo-010179-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7290s) |
| CPU time | 1h (7143s = 97%) |
| Max RSS bytes | 3969376256 (3785 MiB) |
| Outputting started | 2025-11-14 13:57:34 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10179/1/001/reco_stage1.root
|
| Finished | 2025-11-14 14:00:12 |
| Saved logs | justin-logs:249739.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
eToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 119619 traces, 0 summary
Retagger: tagging trace set: gauss with 88005 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88005 traces tagged "gauss"
FrameSaver: q=3.04359e+06 n=1525709 tag=gauss
wclsFrameSaver: saving 119619 traces tagged "wiener"
FrameSaver: q=3.2441e+06 n=1335301 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 42680 XUs and 45765 XVs -> 1110 XUVs
C:0 T:1 117105 XUs and 184465 XVs -> 31208 XUVs
C:0 T:2 62835 XUs and 61523 XVs -> 3002 XUVs
C:0 T:3 34652 XUs and 26332 XVs -> 373 XUVs
C:0 T:4 8357 XUs and 12645 XVs -> 171 XUVs
C:0 T:5 44445 XUs and 64566 XVs -> 15258 XUVs
C:0 T:6 67601 XUs and 61701 XVs -> 3670 XUVs
C:0 T:7 28946 XUs and 25268 XVs -> 221 XUVs
C:0 T:8 8877 XUs and 6600 XVs -> 63 XUVs
C:0 T:9 54796 XUs and 57104 XVs -> 4244 XUVs
C:0 T:10 19331 XUs and 11795 XVs -> 3423 XUVs
C:0 T:11 90 XUs and 58 XVs -> 7 XUVs
62750 XUVs total
10734 collection wire objects
56483 potential space points
Neighbour search...
12774919 tests to find 5477724 neighbours
Iterating with no regularization...
Begin: 5.15485e+07
0 4.47382e+07
1 4.4139e+07
2 4.4024e+07
3 4.39847e+07
Now with regularization...
Begin: 3.55459e+07
0 3.54926e+07
1 3.54443e+07
2 3.5405e+07
3 3.53719e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410507115
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410507115
fLifetime: 30000 [us]
14-Nov-2025 13:57:33 UTC Closed output file "reco_stage1.root"
14-Nov-2025 13:57:33 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 167.976 215.196 295.274 218.907 37.2018 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000615658 0.0024747 0.00350687 0.00261562 0.000922284 10
reco:ophit:OpHitFinder 0.181664 0.217436 0.328151 0.201622 0.0417597 10
reco:opflash:OpFlashFinder 0.0872931 0.117428 0.139344 0.117336 0.0167516 10
reco:opslicer:OpSlicer 0.322052 0.418105 0.474929 0.431571 0.0508076 10
reco:caldata:DataPrepModule 3.43026 3.71305 4.24424 3.73397 0.233813 10
reco:wclsdatasp:WireCellToolkit 21.9412 23.1413 24.1357 23.1036 0.69696 10
reco:gaushit:GausHitFinder 0.57392 0.769099 0.978367 0.736102 0.138625 10
reco:nhitsfilter:NumberOfHitsFilter 0.00023529 0.000330584 0.000489547 0.000315969 6.73441e-05 10
reco:reco3d:SpacePointSolver 6.67284 10.1768 12.7688 10.4593 1.67791 10
reco:hitpdune:DisambigFromSpacePoints 0.722062 1.02407 1.40762 1.02767 0.228475 10
reco:pandora:StandardPandora 12.0289 23.1945 67.4053 18.8755 15.663 10
reco:pandoraWriter:StandardPandora 0.184841 0.270852 0.366937 0.273472 0.0494782 10
reco:pandoraTrack:LArPandoraTrackCreation 1.46772 2.07976 2.69795 2.13857 0.45344 10
reco:pandoraShower:LArPandoraShowerCreation 1.49908 2.41252 3.21472 2.52854 0.630619 10
reco:pandoracalo:Calorimetry 0.846918 1.27801 1.72351 1.30148 0.274288 10
reco:pandoracalonosce:Calorimetry 0.778282 1.17684 1.56236 1.20318 0.248103 10
reco:pandorapid:Chi2ParticleID 0.00274834 0.00337797 0.00385182 0.00342469 0.000376129 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0259847 0.0322905 0.0362912 0.0333964 0.00331459 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00258458 0.00312326 0.00370906 0.00310648 0.000382406 10
reco:pandoraShowercalo:ShowerCalorimetry 1.56204 2.74228 3.65572 2.93339 0.742365 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.51995 2.68772 3.61235 2.88832 0.735146 10
reco:emtrkmichelid:EmTrackMichelId 91.1234 113.016 135.448 113.856 13.738 10
reco:crttag:SingleCRTMatchingProducer 0.00597443 0.0108187 0.0279562 0.0085625 0.006044 10
reco:crtreco:TwoCRTMatchingProducer 0.00380058 0.00509093 0.00643887 0.00507668 0.000687972 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.455556 0.563164 0.644202 0.56978 0.0641307 10
reco:pandora2Track:LArPandoraTrackCreation 4.47727 6.97749 9.66059 7.43389 1.79262 10
reco:pandora2calo:Calorimetry 2.27345 3.86075 5.07367 4.11136 1.00418 10
reco:pandora2calonosce:Calorimetry 2.16132 3.70326 4.87102 3.98508 0.968525 10
reco:pandora2pid:Chi2ParticleID 0.00656349 0.00826518 0.00970124 0.00834924 0.00128251 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0311144 0.0481434 0.128631 0.0414002 0.027187 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00628522 0.00809566 0.0100596 0.00808122 0.00133606 10
reco:pandora2Shower:LArPandoraShowerCreation 1.72265 2.59448 3.46246 2.7585 0.588303 10
reco:pandora2Showercalo:ShowerCalorimetry 2.04684 3.38233 4.39741 3.62323 0.835802 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.8968 3.22361 4.65225 3.32602 0.878444 10
[art]:TriggerResults:TriggerResultInserter 2.7443e-05 4.21497e-05 8.9351e-05 3.60085e-05 1.6971e-05 10
end_path:out1:RootOutput 6.944e-06 8.7799e-06 1.3566e-05 8.1455e-06 1.83835e-06 10
end_path:out1:RootOutput(write) 1.70416 2.27548 3.30782 2.07917 0.495201 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4783.69 MB
Peak resident set size usage (VmHWM): 3969.38 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9509236
-rw-r--r-- 1 dunegli fnalgrid 2261571732 Nov 14 13:20 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2149420125 Nov 14 13:18 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1947034014 Nov 14 13:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1691407575 Nov 14 12:05 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1612554566 Nov 14 11:59 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 74657240 Nov 14 13:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242758 Nov 14 13:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 13:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 13:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 13:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:20 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 12:05 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 11:56 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 13:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:23 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:20 debugprod.log
