Jobsub ID 261654.0@dunegpschedd02.fnal.gov
| Jobsub ID | 261654.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11192 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 18:07:41 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 21:37:22 |
| From worker node | Hostname | dunegli-7890308-0-fnpc23033.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 18:08:30 |
| Input files | monte-carlo-011192-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12465s) |
| CPU time | 3h (11392s = 91%) |
| Max RSS bytes | 4261404672 (4063 MiB) |
| Outputting started | 2025-12-12 21:36:16 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11192/1/001/reco_stage1.root
|
| Finished | 2025-12-12 21:37:22 |
| Saved logs | justin-logs:261654.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
wDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94981 traces, 0 summary
Retagger: tagging trace set: gauss with 71510 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 71510 traces tagged "gauss"
FrameSaver: q=2.44654e+06 n=1251334 tag=gauss
wclsFrameSaver: saving 94981 traces tagged "wiener"
FrameSaver: q=2.58741e+06 n=1102116 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 31287 XUs and 47727 XVs -> 422 XUVs
C:0 T:1 76064 XUs and 98155 XVs -> 6567 XUVs
C:0 T:2 62983 XUs and 53500 XVs -> 2715 XUVs
C:0 T:3 31073 XUs and 24176 XVs -> 203 XUVs
C:0 T:4 8525 XUs and 12668 XVs -> 242 XUVs
C:0 T:5 31671 XUs and 37054 XVs -> 3812 XUVs
C:0 T:6 21980 XUs and 23283 XVs -> 1000 XUVs
C:0 T:7 10940 XUs and 11162 XVs -> 58 XUVs
C:0 T:8 5972 XUs and 5383 XVs -> 32 XUVs
C:0 T:9 26814 XUs and 35036 XVs -> 2287 XUVs
C:0 T:10 14925 XUs and 7425 XVs -> 1641 XUVs
C:0 T:11 70 XUs and 46 XVs -> 11 XUVs
18990 XUVs total
7975 collection wire objects
17435 potential space points
Neighbour search...
636875 tests to find 349280 neighbours
Iterating with no regularization...
Begin: 5.18256e+07
0 4.41752e+07
1 4.35986e+07
2 4.35244e+07
3 4.35043e+07
Now with regularization...
Begin: 3.61192e+07
0 3.61178e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411076739
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411076739
fLifetime: 30000 [us]
12-Dec-2025 21:36:14 UTC Closed output file "reco_stage1.root"
12-Dec-2025 21:36:14 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 230.744 353.988 420.003 387.615 57.1395 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00189845 0.00880933 0.0330813 0.00467693 0.00940998 10
reco:ophit:OpHitFinder 0.247982 0.346515 0.500373 0.336673 0.0814697 10
reco:opflash:OpFlashFinder 0.122355 0.217057 0.336013 0.214559 0.0602968 10
reco:opslicer:OpSlicer 0.449347 0.666563 0.991915 0.570912 0.196141 10
reco:caldata:DataPrepModule 5.17092 5.98215 7.20162 5.88541 0.689524 10
reco:wclsdatasp:WireCellToolkit 35.8353 41.2755 47.7538 41.1736 3.8291 10
reco:gaushit:GausHitFinder 0.665169 1.25681 1.6133 1.30724 0.296041 10
reco:nhitsfilter:NumberOfHitsFilter 0.000473636 0.00084308 0.00137084 0.000832513 0.000248032 10
reco:reco3d:SpacePointSolver 6.39501 14.3327 23.1117 14.3166 4.35978 10
reco:hitpdune:DisambigFromSpacePoints 0.984805 1.45911 1.77647 1.48743 0.22948 10
reco:pandora:StandardPandora 18.0081 33.8544 49.1095 32.366 9.54647 10
reco:pandoraWriter:StandardPandora 0.310801 0.485903 0.69174 0.458091 0.1319 10
reco:pandoraTrack:LArPandoraTrackCreation 2.68806 4.52878 5.92676 4.45983 0.910759 10
reco:pandoraShower:LArPandoraShowerCreation 1.99154 4.96765 8.16397 4.95293 1.74112 10
reco:pandoracalo:Calorimetry 1.38751 2.67547 3.87158 2.84794 0.678829 10
reco:pandoracalonosce:Calorimetry 1.44907 2.71223 4.83736 2.61224 0.976993 10
reco:pandorapid:Chi2ParticleID 0.0035735 0.00590593 0.0169536 0.00473895 0.00375103 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0355628 0.0523378 0.0953095 0.0411368 0.0220159 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00339389 0.00636948 0.0181294 0.00415725 0.00482333 10
reco:pandoraShowercalo:ShowerCalorimetry 2.64146 5.32457 7.9115 5.52289 1.71312 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.58779 5.21697 7.11704 5.74226 1.82503 10
reco:emtrkmichelid:EmTrackMichelId 125.641 177.68 212.317 186.516 25.3855 10
reco:crttag:SingleCRTMatchingProducer 0.00917975 0.0321541 0.0845553 0.0247528 0.0239024 10
reco:crtreco:TwoCRTMatchingProducer 0.0047433 0.019346 0.045992 0.0150486 0.0146966 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.59784 0.934911 1.28349 0.902009 0.185195 10
reco:pandora2Track:LArPandoraTrackCreation 6.19518 14.2525 18.4943 14.4799 3.52886 10
reco:pandora2calo:Calorimetry 3.67195 7.54691 11.2154 7.79253 2.30223 10
reco:pandora2calonosce:Calorimetry 2.9975 6.6986 9.88493 7.14554 1.83016 10
reco:pandora2pid:Chi2ParticleID 0.00837493 0.00982056 0.0113214 0.00978443 0.00103509 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0451696 0.0528839 0.077862 0.0500685 0.00959325 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0077328 0.0106203 0.0223422 0.00946301 0.00400644 10
reco:pandora2Shower:LArPandoraShowerCreation 2.90633 5.54735 6.98393 5.74983 1.04072 10
reco:pandora2Showercalo:ShowerCalorimetry 1.98453 6.51511 9.36706 6.93784 2.14417 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.33022 6.05344 9.18261 6.45332 1.93552 10
[art]:TriggerResults:TriggerResultInserter 5.0747e-05 0.000100978 0.000276148 8.51675e-05 6.15694e-05 10
end_path:out1:RootOutput 1.3476e-05 1.89103e-05 3.0027e-05 1.80245e-05 4.38783e-06 10
end_path:out1:RootOutput(write) 2.0266 3.03007 4.147 2.98284 0.636094 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5078.57 MB
Peak resident set size usage (VmHWM): 4261.4 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9958440
-rw-r--r-- 1 dunegli fnalgrid 2353981525 Dec 12 20:35 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2234338261 Dec 12 20:32 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2030382509 Dec 12 21:36 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1794718630 Dec 12 18:29 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1710466922 Dec 12 18:15 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72945420 Dec 12 21:33 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242587 Dec 12 21:36 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 21:36 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 21:36 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 21:36 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 20:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 18:29 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 21:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 18:08 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 21:36 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 20:41 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 20:35 debugprod.log
