Jobsub ID 238859.0@dunegpschedd01.fnal.gov
| Jobsub ID | 238859.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9376 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-27 14:33:04 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-10-27 16:56:06 |
| From worker node | Hostname | dunegli-7542002-0-fnpc22033.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-27 14:35:35 |
| Input files | monte-carlo-009376-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8414s) |
| CPU time | 2h (8325s = 98%) |
| Max RSS bytes | 4422250496 (4217 MiB) |
| Outputting started | 2025-10-27 16:55:50 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09376/1/001/reco_stage1.root
|
| Finished | 2025-10-27 16:56:06 |
| Saved logs | justin-logs:238859.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
epare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 170867 traces, 0 summary
Retagger: tagging trace set: gauss with 127753 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 127753 traces tagged "gauss"
FrameSaver: q=4.5796e+06 n=2215362 tag=gauss
wclsFrameSaver: saving 170867 traces tagged "wiener"
FrameSaver: q=4.85386e+06 n=1948030 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 42427 XUs and 41596 XVs -> 1052 XUVs
C:0 T:1 118565 XUs and 102544 XVs -> 10815 XUVs
C:0 T:2 81353 XUs and 64459 XVs -> 3327 XUVs
C:0 T:3 40639 XUs and 26328 XVs -> 324 XUVs
C:0 T:4 16726 XUs and 17573 XVs -> 152 XUVs
C:0 T:5 79347 XUs and 59661 XVs -> 5182 XUVs
C:0 T:6 172512 XUs and 203593 XVs -> 18393 XUVs
C:0 T:7 61508 XUs and 59814 XVs -> 1367 XUVs
C:0 T:8 8931 XUs and 11931 XVs -> 144 XUVs
C:0 T:9 61673 XUs and 111572 XVs -> 7427 XUVs
C:0 T:10 59014 XUs and 40967 XVs -> 6409 XUVs
C:0 T:11 23 XUs and 26 XVs -> 9 XUVs
54601 XUVs total
15800 collection wire objects
48470 potential space points
Neighbour search...
5306448 tests to find 2471670 neighbours
Iterating with no regularization...
Begin: 9.59923e+07
0 8.17121e+07
1 8.06541e+07
2 8.05088e+07
3 8.04661e+07
Now with regularization...
Begin: 6.67833e+07
0 6.6753e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410148718
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410148718
fLifetime: 30000 [us]
27-Oct-2025 16:55:47 UTC Closed output file "reco_stage1.root"
27-Oct-2025 16:55:47 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 218.202 248.644 283.638 248.807 23.3411 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000688418 0.00315426 0.00494489 0.00333403 0.00136622 10
reco:ophit:OpHitFinder 0.215786 0.237856 0.256735 0.237376 0.01382 10
reco:opflash:OpFlashFinder 0.108515 0.167663 0.200663 0.170406 0.0228448 10
reco:opslicer:OpSlicer 0.423759 0.48638 0.53825 0.481997 0.0353219 10
reco:caldata:DataPrepModule 3.49468 3.58234 3.70532 3.57372 0.0579482 10
reco:wclsdatasp:WireCellToolkit 24.9092 25.3396 25.7892 25.3501 0.26399 10
reco:gaushit:GausHitFinder 0.751647 0.87084 1.00575 0.893042 0.0827089 10
reco:nhitsfilter:NumberOfHitsFilter 0.000427416 0.000652295 0.00124396 0.000498911 0.000292435 10
reco:reco3d:SpacePointSolver 9.05453 12.892 15.2476 13.8233 2.02842 10
reco:hitpdune:DisambigFromSpacePoints 1.04314 1.30394 1.66569 1.31631 0.199945 10
reco:pandora:StandardPandora 18.5313 24.9043 31.164 24.565 4.29297 10
reco:pandoraWriter:StandardPandora 0.299239 0.346524 0.388993 0.346026 0.0320208 10
reco:pandoraTrack:LArPandoraTrackCreation 2.30918 2.94969 3.82415 2.92225 0.423031 10
reco:pandoraShower:LArPandoraShowerCreation 2.40042 3.21216 4.18752 3.04307 0.619629 10
reco:pandoracalo:Calorimetry 1.425 1.77706 2.25731 1.75547 0.238568 10
reco:pandoracalonosce:Calorimetry 1.32143 1.63735 2.12328 1.60392 0.224734 10
reco:pandorapid:Chi2ParticleID 0.00343667 0.00404945 0.00515224 0.00399266 0.00043858 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0304127 0.0364493 0.0405955 0.0371716 0.00355162 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0034327 0.003857 0.00422461 0.00388217 0.00026199 10
reco:pandoraShowercalo:ShowerCalorimetry 2.72222 3.64124 4.70704 3.45234 0.688151 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.68609 3.56947 4.58737 3.40272 0.682648 10
reco:emtrkmichelid:EmTrackMichelId 112.503 126.278 139.378 128.049 9.64709 10
reco:crttag:SingleCRTMatchingProducer 0.00798087 0.0112118 0.0177388 0.0108044 0.00249137 10
reco:crtreco:TwoCRTMatchingProducer 0.0052488 0.00605728 0.00681053 0.00616243 0.000468224 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.586268 0.736828 0.818268 0.77865 0.0829241 10
reco:pandora2Track:LArPandoraTrackCreation 7.20542 10.2106 16.9709 9.42989 2.74995 10
reco:pandora2calo:Calorimetry 4.00368 5.38937 8.57639 5.06157 1.27485 10
reco:pandora2calonosce:Calorimetry 3.81952 5.0773 7.87653 4.78983 1.13675 10
reco:pandora2pid:Chi2ParticleID 0.00774466 0.0093722 0.0105202 0.00936608 0.000901257 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0397929 0.0468865 0.0529058 0.0472713 0.00458116 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00779685 0.00937054 0.0105034 0.00929774 0.00089434 10
reco:pandora2Shower:LArPandoraShowerCreation 2.61478 3.39417 4.30968 3.33767 0.564672 10
reco:pandora2Showercalo:ShowerCalorimetry 3.51563 4.29044 4.98304 4.28521 0.537302 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.16406 3.90056 4.71259 3.86347 0.520562 10
[art]:TriggerResults:TriggerResultInserter 3.6349e-05 4.93711e-05 0.000121309 4.2615e-05 2.41413e-05 10
end_path:out1:RootOutput 5.18e-06 1.06269e-05 1.4137e-05 1.04445e-05 2.34366e-06 10
end_path:out1:RootOutput(write) 1.94237 2.19434 2.55705 2.19035 0.204721 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5231.95 MB
Peak resident set size usage (VmHWM): 4422.25 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11014900
-rw-r--r-- 1 dunegli fnalgrid 2557210369 Oct 27 16:13 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2422734719 Oct 27 16:11 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2287252072 Oct 27 16:55 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2000845022 Oct 27 14:47 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1925021972 Oct 27 14:39 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 85567700 Oct 27 16:52 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243085 Oct 27 16:55 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 27 16:55 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 27 16:55 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 27 16:55 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 27 16:13 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 27 14:47 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 27 16:55 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 27 14:35 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 27 16:55 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 27 16:16 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 27 16:13 debugprod.log
