Jobsub ID 249740.0@dunegpschedd01.fnal.gov
| Jobsub ID | 249740.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10182 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 10:12:23 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 13:51:06 |
| From worker node | Hostname | dunegli-7593905-0-fnpc23020.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 11:56:22 |
| Input files | monte-carlo-010182-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6863s) |
| CPU time | 1h (6700s = 97%) |
| Max RSS bytes | 4011573248 (3825 MiB) |
| Outputting started | 2025-11-14 13:50:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10182/1/001/reco_stage1.root
|
| Finished | 2025-11-14 13:51:06 |
| Saved logs | justin-logs:249740.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
repare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 110605 traces, 0 summary
Retagger: tagging trace set: gauss with 87259 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 87259 traces tagged "gauss"
FrameSaver: q=2.85103e+06 n=1527610 tag=gauss
wclsFrameSaver: saving 110605 traces tagged "wiener"
FrameSaver: q=3.01413e+06 n=1356995 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 23198 XUs and 26671 XVs -> 160 XUVs
C:0 T:1 37278 XUs and 36546 XVs -> 2486 XUVs
C:0 T:2 62860 XUs and 96446 XVs -> 8272 XUVs
C:0 T:3 33110 XUs and 33756 XVs -> 170 XUVs
C:0 T:4 11685 XUs and 10367 XVs -> 76 XUVs
C:0 T:5 49188 XUs and 32397 XVs -> 3467 XUVs
C:0 T:6 107903 XUs and 91732 XVs -> 4230 XUVs
C:0 T:7 47652 XUs and 35990 XVs -> 317 XUVs
C:0 T:8 5690 XUs and 4774 XVs -> 18 XUVs
C:0 T:9 32690 XUs and 41784 XVs -> 2482 XUVs
C:0 T:10 39507 XUs and 21416 XVs -> 3448 XUVs
C:0 T:11 147 XUs and 119 XVs -> 18 XUVs
25144 XUVs total
9949 collection wire objects
23909 potential space points
Neighbour search...
3250315 tests to find 1346528 neighbours
Iterating with no regularization...
Begin: 6.42628e+07
0 4.80585e+07
1 4.6874e+07
2 4.67497e+07
3 4.67204e+07
Now with regularization...
Begin: 3.80109e+07
0 3.79769e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410507071
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410507071
fLifetime: 30000 [us]
14-Nov-2025 13:50:43 UTC Closed output file "reco_stage1.root"
14-Nov-2025 13:50:43 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 126.37 186.671 255.148 171.334 39.626 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000614506 0.0028007 0.00475732 0.00288224 0.00122965 10
reco:ophit:OpHitFinder 0.173395 0.192179 0.233238 0.181397 0.0201388 10
reco:opflash:OpFlashFinder 0.0805625 0.115194 0.157777 0.113438 0.0226659 10
reco:opslicer:OpSlicer 0.333246 0.417554 0.512281 0.403167 0.054366 10
reco:caldata:DataPrepModule 3.30162 3.50431 3.82248 3.49201 0.126324 10
reco:wclsdatasp:WireCellToolkit 22.5822 23.2931 23.876 23.2903 0.402301 10
reco:gaushit:GausHitFinder 0.47536 0.684073 0.878546 0.675827 0.123481 10
reco:nhitsfilter:NumberOfHitsFilter 0.000186947 0.000310417 0.000469228 0.000291527 7.84659e-05 10
reco:reco3d:SpacePointSolver 5.79268 8.93908 15.5306 7.41286 3.17812 10
reco:hitpdune:DisambigFromSpacePoints 0.443899 0.864254 1.38976 0.720913 0.301993 10
reco:pandora:StandardPandora 7.54191 15.8821 29.3453 13.1751 6.61373 10
reco:pandoraWriter:StandardPandora 0.167529 0.236607 0.336312 0.223743 0.05181 10
reco:pandoraTrack:LArPandoraTrackCreation 0.967948 1.63345 2.48144 1.46835 0.487823 10
reco:pandoraShower:LArPandoraShowerCreation 0.758009 1.87981 3.19496 1.73298 0.698687 10
reco:pandoracalo:Calorimetry 0.607559 1.00848 1.53469 0.913024 0.308779 10
reco:pandoracalonosce:Calorimetry 0.557975 0.927074 1.42823 0.836015 0.289079 10
reco:pandorapid:Chi2ParticleID 0.00246086 0.00306985 0.00447013 0.00282943 0.000586232 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0219379 0.0296212 0.0396074 0.0273813 0.00547064 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00237379 0.00281107 0.00342527 0.0027056 0.000364078 10
reco:pandoraShowercalo:ShowerCalorimetry 0.778903 2.04637 3.7855 1.6897 0.904683 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.753202 1.99893 3.72859 1.6531 0.892725 10
reco:emtrkmichelid:EmTrackMichelId 71.1899 102.511 134.185 95.6229 19.1164 10
reco:crttag:SingleCRTMatchingProducer 0.00483728 0.00739149 0.0170898 0.00628096 0.00332573 10
reco:crtreco:TwoCRTMatchingProducer 0.00314496 0.00453691 0.00647442 0.00416642 0.000943256 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.413453 0.558694 0.83631 0.505528 0.139881 10
reco:pandora2Track:LArPandoraTrackCreation 2.35368 5.37965 8.89818 4.88216 1.98103 10
reco:pandora2calo:Calorimetry 1.27645 2.89307 4.93149 2.47266 1.14577 10
reco:pandora2calonosce:Calorimetry 1.1906 2.75272 4.80069 2.32873 1.11549 10
reco:pandora2pid:Chi2ParticleID 0.00480777 0.00708948 0.0089958 0.00716649 0.00123023 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0238197 0.0433259 0.107624 0.0350834 0.022722 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00465562 0.00684823 0.0090733 0.00663381 0.00129602 10
reco:pandora2Shower:LArPandoraShowerCreation 0.935732 2.08662 3.41297 1.94081 0.727984 10
reco:pandora2Showercalo:ShowerCalorimetry 1.11809 2.54351 4.3706 2.16818 1.00519 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.03583 2.3754 4.05921 2.03244 0.934482 10
[art]:TriggerResults:TriggerResultInserter 2.7373e-05 3.75109e-05 9.8499e-05 3.0378e-05 2.04966e-05 10
end_path:out1:RootOutput 5.962e-06 8.8021e-06 1.4448e-05 8.4465e-06 2.50161e-06 10
end_path:out1:RootOutput(write) 1.19626 1.78274 2.37184 1.71471 0.346551 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4825.37 MB
Peak resident set size usage (VmHWM): 4011.57 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9467044
-rw-r--r-- 1 dunegli fnalgrid 2238916367 Nov 14 13:18 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2127467610 Nov 14 13:17 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1899563358 Nov 14 13:50 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1714761380 Nov 14 12:06 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1644604251 Nov 14 11:59 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 68322560 Nov 14 13:48 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242730 Nov 14 13:50 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 13:50 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 13:50 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 13:50 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 12:06 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:50 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 11:56 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 13:50 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:22 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:18 debugprod.log
