Jobsub ID 260265.1@dunegpschedd02.fnal.gov
| Jobsub ID | 260265.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11139 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-10 13:59:25 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-10 20:49:00 |
| From worker node | Hostname | dunegli-8024613-0-fnpc23107.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-10 18:28:26 |
| Input files | monte-carlo-011139-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8418s) |
| CPU time | 2h (8324s = 98%) |
| Max RSS bytes | 4260130816 (4062 MiB) |
| Outputting started | 2025-12-10 20:48:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11139/1/001/reco_stage1.root
|
| Finished | 2025-12-10 20:49:00 |
| Saved logs | justin-logs:260265.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 134936 traces, 0 summary
Retagger: tagging trace set: gauss with 105253 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105253 traces tagged "gauss"
FrameSaver: q=3.60507e+06 n=1863621 tag=gauss
wclsFrameSaver: saving 134936 traces tagged "wiener"
FrameSaver: q=3.78442e+06 n=1641255 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 41758 XUs and 36020 XVs -> 371 XUVs
C:0 T:1 72147 XUs and 63783 XVs -> 4580 XUVs
C:0 T:2 88731 XUs and 115103 XVs -> 4988 XUVs
C:0 T:3 44889 XUs and 45148 XVs -> 399 XUVs
C:0 T:4 11531 XUs and 13166 XVs -> 194 XUVs
C:0 T:5 40094 XUs and 34987 XVs -> 3387 XUVs
C:0 T:6 183840 XUs and 186908 XVs -> 9184 XUVs
C:0 T:7 68817 XUs and 64074 XVs -> 781 XUVs
C:0 T:8 7031 XUs and 5436 XVs -> 65 XUVs
C:0 T:9 45628 XUs and 41659 XVs -> 2817 XUVs
C:0 T:10 28429 XUs and 14942 XVs -> 2881 XUVs
C:0 T:11 174 XUs and 94 XVs -> 24 XUVs
29671 XUVs total
12543 collection wire objects
26614 potential space points
Neighbour search...
1208974 tests to find 629478 neighbours
Iterating with no regularization...
Begin: 6.67135e+07
0 5.61574e+07
1 5.54681e+07
2 5.53772e+07
3 5.53535e+07
Now with regularization...
Begin: 4.49092e+07
0 4.48989e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411032552
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411032552
fLifetime: 30000 [us]
10-Dec-2025 20:48:43 UTC Closed output file "reco_stage1.root"
10-Dec-2025 20:48:43 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 208.257 251.542 302.34 246.843 32.159 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000735099 0.00329075 0.00473485 0.00380315 0.00135332 10
reco:ophit:OpHitFinder 0.179828 0.221819 0.257054 0.225476 0.0222955 10
reco:opflash:OpFlashFinder 0.103252 0.140792 0.162132 0.145124 0.0147112 10
reco:opslicer:OpSlicer 0.289932 0.420292 0.51383 0.433274 0.0594757 10
reco:caldata:DataPrepModule 3.19236 3.44456 3.70784 3.47312 0.174711 10
reco:wclsdatasp:WireCellToolkit 21.5316 23.9811 25.4331 24.1153 1.05192 10
reco:gaushit:GausHitFinder 0.722495 0.808888 0.94572 0.799749 0.0681032 10
reco:nhitsfilter:NumberOfHitsFilter 0.000246125 0.000464893 0.000840028 0.000426144 0.000153849 10
reco:reco3d:SpacePointSolver 7.71968 12.4488 19.4777 12.6016 3.98276 10
reco:hitpdune:DisambigFromSpacePoints 0.790198 1.10739 1.48336 1.06262 0.218747 10
reco:pandora:StandardPandora 21.4148 27.229 36.6901 25.2134 5.49472 10
reco:pandoraWriter:StandardPandora 0.304088 0.351708 0.410073 0.348167 0.036299 10
reco:pandoraTrack:LArPandoraTrackCreation 2.40036 3.49871 5.20399 2.99065 0.919102 10
reco:pandoraShower:LArPandoraShowerCreation 2.60686 4.25794 6.80908 4.12716 1.32921 10
reco:pandoracalo:Calorimetry 1.28359 2.00741 3.25828 1.94479 0.568522 10
reco:pandoracalonosce:Calorimetry 1.05213 1.86103 3.09614 1.84622 0.551132 10
reco:pandorapid:Chi2ParticleID 0.00296848 0.00360722 0.0050176 0.00331336 0.000597357 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0286596 0.0346086 0.0392441 0.0350949 0.00322709 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00286408 0.00352096 0.00414056 0.00354591 0.000439804 10
reco:pandoraShowercalo:ShowerCalorimetry 2.67877 4.39586 7.60748 4.26221 1.36634 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.58511 4.62668 7.48244 4.50638 1.54215 10
reco:emtrkmichelid:EmTrackMichelId 104.738 124.118 139.957 122.056 11.6813 10
reco:crttag:SingleCRTMatchingProducer 0.00795566 0.0100407 0.0127519 0.00985429 0.00125906 10
reco:crtreco:TwoCRTMatchingProducer 0.00393882 0.00589771 0.00747755 0.00598334 0.00101342 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.454267 0.584939 0.711719 0.571641 0.074943 10
reco:pandora2Track:LArPandoraTrackCreation 5.62522 10.4231 15.323 10.9393 3.18078 10
reco:pandora2calo:Calorimetry 3.05855 5.69943 11.3087 5.22854 2.41063 10
reco:pandora2calonosce:Calorimetry 2.89627 5.30583 9.70831 5.08129 1.97458 10
reco:pandora2pid:Chi2ParticleID 0.00689525 0.00838095 0.0100301 0.00815805 0.00105533 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0342225 0.0431974 0.0507385 0.0431017 0.0056987 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00665171 0.00815957 0.00972494 0.0080539 0.00103328 10
reco:pandora2Shower:LArPandoraShowerCreation 2.03033 3.82038 7.09961 3.67839 1.54356 10
reco:pandora2Showercalo:ShowerCalorimetry 2.63346 4.61543 7.52961 4.31526 1.51214 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.50488 3.84455 5.62436 3.80411 0.957854 10
[art]:TriggerResults:TriggerResultInserter 2.9645e-05 4.3865e-05 9.1129e-05 3.88145e-05 1.6669e-05 10
end_path:out1:RootOutput 5.258e-06 7.5234e-06 1.0656e-05 7.371e-06 1.29413e-06 10
end_path:out1:RootOutput(write) 1.60521 2.04289 2.54256 2.00061 0.286838 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5081.19 MB
Peak resident set size usage (VmHWM): 4260.13 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.02 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10488548
-rw-r--r-- 1 dunegli fnalgrid 2455143771 Dec 10 20:05 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2329224703 Dec 10 20:04 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2179141057 Dec 10 20:48 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1877802362 Dec 10 18:42 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1813858163 Dec 10 18:31 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 84492120 Dec 10 20:45 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242985 Dec 10 20:48 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 10 20:48 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 10 20:48 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 10 20:48 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 10 20:05 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 10 18:42 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 10 20:48 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 10 18:28 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 10 20:48 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 10 20:09 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 10 20:05 debugprod.log
