Jobsub ID 267774.1@dunegpschedd02.fnal.gov
| Jobsub ID | 267774.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11677 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-10 10:41:26 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce04 |
| Last heartbeat | 2026-01-10 14:20:49 |
| From worker node | Hostname | ccwcondor0004 |
| cpuinfo | AMD EPYC 9334 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-10 10:43:15 |
| Input files | monte-carlo-011677-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12951s) |
| CPU time | 3h (12623s = 97%) |
| Max RSS bytes | 5285842944 (5040 MiB) |
| Outputting started | 2026-01-10 14:19:07 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11677/1/001/reco_stage1.root
|
| Finished | 2026-01-10 14:20:49 |
| Saved logs | justin-logs:267774.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
veBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 211220 traces, 0 summary
Retagger: tagging trace set: gauss with 158192 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 158192 traces tagged "gauss"
FrameSaver: q=5.59254e+06 n=2776783 tag=gauss
wclsFrameSaver: saving 211220 traces tagged "wiener"
FrameSaver: q=5.95039e+06 n=2450179 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 52467 XUs and 51168 XVs -> 992 XUVs
C:0 T:1 133838 XUs and 125968 XVs -> 10768 XUVs
C:0 T:2 188960 XUs and 174382 XVs -> 23417 XUVs
C:0 T:3 65643 XUs and 58825 XVs -> 682 XUVs
C:0 T:4 22702 XUs and 18804 XVs -> 306 XUVs
C:0 T:5 120352 XUs and 91997 XVs -> 11028 XUVs
C:0 T:6 165076 XUs and 161704 XVs -> 6590 XUVs
C:0 T:7 64757 XUs and 63125 XVs -> 788 XUVs
C:0 T:8 14008 XUs and 17207 XVs -> 504 XUVs
C:0 T:9 178326 XUs and 208246 XVs -> 32175 XUVs
C:0 T:10 63771 XUs and 35383 XVs -> 4962 XUVs
C:0 T:11 287 XUs and 157 XVs -> 35 XUVs
92247 XUVs total
20098 collection wire objects
83869 potential space points
Neighbour search...
19144357 tests to find 7729638 neighbours
Iterating with no regularization...
Begin: 1.40588e+08
0 1.16189e+08
1 1.14448e+08
2 1.14224e+08
3 1.14159e+08
Now with regularization...
Begin: 9.81561e+07
0 9.8104e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411653903
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411653903
fLifetime: 30000 [us]
10-Jan-2026 15:19:04 CET Closed output file "reco_stage1.root"
10-Jan-2026 15:19:04 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 318.268 433.145 655.631 411.695 95.1564 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000996713 0.00435109 0.00968319 0.00413038 0.00242611 10
reco:ophit:OpHitFinder 0.286547 0.345868 0.41099 0.345422 0.0298094 10
reco:opflash:OpFlashFinder 0.196229 0.243814 0.312256 0.242145 0.0357837 10
reco:opslicer:OpSlicer 0.663699 0.756611 0.833277 0.773364 0.0672642 10
reco:caldata:DataPrepModule 4.97282 5.46076 5.78531 5.5824 0.298361 10
reco:wclsdatasp:WireCellToolkit 32.3541 34.9525 39.321 34.4078 2.25198 10
reco:gaushit:GausHitFinder 0.819555 1.43265 2.12415 1.51065 0.375837 10
reco:nhitsfilter:NumberOfHitsFilter 0.000259608 0.000542421 0.000739146 0.000530059 0.000124226 10
reco:reco3d:SpacePointSolver 11.661 22.8326 37.0238 20.4065 8.38656 10
reco:hitpdune:DisambigFromSpacePoints 1.40187 2.17503 3.36957 1.94879 0.592406 10
reco:pandora:StandardPandora 29.0719 44.7324 86.1532 36.6586 17.0464 10
reco:pandoraWriter:StandardPandora 0.403137 0.530861 0.799358 0.48477 0.126951 10
reco:pandoraTrack:LArPandoraTrackCreation 3.64304 6.08537 10.9868 5.44794 2.25685 10
reco:pandoraShower:LArPandoraShowerCreation 3.00787 6.56224 13.3493 5.68559 3.05022 10
reco:pandoracalo:Calorimetry 1.88876 3.50845 6.4289 3.16307 1.25979 10
reco:pandoracalonosce:Calorimetry 2.13764 3.43326 5.80275 3.1689 1.23615 10
reco:pandorapid:Chi2ParticleID 0.00443229 0.00655564 0.00848998 0.00678569 0.00126802 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0439533 0.0658194 0.0911778 0.0610064 0.015353 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00428965 0.00613904 0.00858158 0.00572689 0.0014741 10
reco:pandoraShowercalo:ShowerCalorimetry 3.96117 7.10101 12.8218 6.46439 2.61039 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.78565 6.8329 14.3289 6.46559 2.82357 10
reco:emtrkmichelid:EmTrackMichelId 171.597 222.329 296.554 218.154 35.5693 10
reco:crttag:SingleCRTMatchingProducer 0.010603 0.0195632 0.0339485 0.0185191 0.00611063 10
reco:crtreco:TwoCRTMatchingProducer 0.00872588 0.0119003 0.0172869 0.0111987 0.00228559 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.833756 1.0371 1.34719 1.04221 0.152394 10
reco:pandora2Track:LArPandoraTrackCreation 11.6866 20.015 41.9767 18.0337 8.2099 10
reco:pandora2calo:Calorimetry 5.44102 9.40346 19.4957 8.24978 3.74178 10
reco:pandora2calonosce:Calorimetry 5.20604 9.08416 18.1086 8.34926 3.52107 10
reco:pandora2pid:Chi2ParticleID 0.0120878 0.0161839 0.0258098 0.0147022 0.00387099 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0664299 0.0901259 0.133729 0.0880395 0.0187708 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0128143 0.0164192 0.0251624 0.0152476 0.003422 10
reco:pandora2Shower:LArPandoraShowerCreation 3.87794 6.58698 11.3948 5.90651 2.12867 10
reco:pandora2Showercalo:ShowerCalorimetry 4.62153 7.2756 11.2052 7.05117 1.83371 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.17894 6.67571 12.0229 6.46395 2.12542 10
[art]:TriggerResults:TriggerResultInserter 5.1426e-05 6.86147e-05 0.000151958 5.6905e-05 2.96613e-05 10
end_path:out1:RootOutput 5.979e-06 1.06598e-05 1.7196e-05 9.92e-06 2.84258e-06 10
end_path:out1:RootOutput(write) 2.63847 3.34484 4.74119 3.16716 0.636033 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5531.75 MB
Peak resident set size usage (VmHWM): 4700.17 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12102220
-rw-r--r-- 1 dune001 lbno 2773373673 Jan 10 14:04 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2630169509 Jan 10 14:02 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2519354065 Jan 10 15:19 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 2237934846 Jan 10 12:03 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 2142493127 Jan 10 11:50 g4_stage1.root
-rw-r--r-- 1 dune001 lbno 88732400 Jan 10 15:11 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 243088 Jan 10 15:19 jobscript.log
-rw-r--r-- 1 dune001 lbno 217088 Jan 10 15:19 mem.db
-rw-r--r-- 1 dune001 lbno 62376 Jan 10 15:19 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 36864 Jan 10 15:19 time.db
-rw-r--r-- 1 dune001 lbno 519 Jan 10 14:04 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 10 12:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 10 15:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno 52 Jan 10 11:43 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 7 Jan 10 15:19 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Jan 10 14:09 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Jan 10 14:04 debugprod.log
