Jobsub ID 271548.1@dunegpschedd01.fnal.gov
| Jobsub ID | 271548.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11508 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-04 09:48:54 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2026-01-04 15:18:13 |
| From worker node | Hostname | ccwcondor0636 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-04 10:17:52 |
| Input files | monte-carlo-011508-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17904s) |
| CPU time | 4h (17234s = 96%) |
| Max RSS bytes | 4325621760 (4125 MiB) |
| Outputting started | 2026-01-04 15:16:17 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11508/1/001/reco_stage1.root
|
| Finished | 2026-01-04 15:18:04 |
| Saved logs | justin-logs:271548.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
re: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144074 traces, 0 summary
Retagger: tagging trace set: gauss with 110857 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 110857 traces tagged "gauss"
FrameSaver: q=4.23269e+06 n=1997453 tag=gauss
wclsFrameSaver: saving 144074 traces tagged "wiener"
FrameSaver: q=4.49547e+06 n=1796389 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 48994 XUs and 59690 XVs -> 768 XUVs
C:0 T:1 84267 XUs and 94628 XVs -> 6542 XUVs
C:0 T:2 76168 XUs and 120089 XVs -> 2973 XUVs
C:0 T:3 40626 XUs and 54992 XVs -> 574 XUVs
C:0 T:4 17914 XUs and 23414 XVs -> 216 XUVs
C:0 T:5 79048 XUs and 86924 XVs -> 7375 XUVs
C:0 T:6 79334 XUs and 69122 XVs -> 3337 XUVs
C:0 T:7 34973 XUs and 29229 XVs -> 358 XUVs
C:0 T:8 7718 XUs and 10083 XVs -> 205 XUVs
C:0 T:9 70122 XUs and 118215 XVs -> 9196 XUVs
C:0 T:10 26828 XUs and 14786 XVs -> 2338 XUVs
C:0 T:11 371 XUs and 227 XVs -> 34 XUVs
33916 XUVs total
11652 collection wire objects
30967 potential space points
Neighbour search...
1963597 tests to find 901008 neighbours
Iterating with no regularization...
Begin: 1.0957e+08
0 9.18479e+07
1 9.04204e+07
2 9.02812e+07
3 9.0255e+07
Now with regularization...
Begin: 7.65212e+07
0 7.65187e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411532795
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411532795
fLifetime: 30000 [us]
04-Jan-2026 16:16:15 CET Closed output file "reco_stage1.root"
04-Jan-2026 16:16:15 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 531.67 663.49 798.562 682.04 78.2206 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00223047 0.0110984 0.0223389 0.0105271 0.00648519 10
reco:ophit:OpHitFinder 0.363916 0.414889 0.476613 0.408726 0.033371 10
reco:opflash:OpFlashFinder 0.197845 0.266154 0.350501 0.259715 0.0415468 10
reco:opslicer:OpSlicer 0.85587 0.992497 1.23474 0.95011 0.127454 10
reco:caldata:DataPrepModule 7.05143 7.47661 7.99817 7.55291 0.288989 10
reco:wclsdatasp:WireCellToolkit 45.2222 48.8366 56.8362 48.2741 2.89575 10
reco:gaushit:GausHitFinder 1.56256 1.96506 2.20524 2.02973 0.218303 10
reco:nhitsfilter:NumberOfHitsFilter 0.000690693 0.00117197 0.00220258 0.000970457 0.000518677 10
reco:reco3d:SpacePointSolver 24.9788 30.4613 40.5536 29.9469 5.14568 10
reco:hitpdune:DisambigFromSpacePoints 2.27252 2.97362 3.92743 2.85252 0.54655 10
reco:pandora:StandardPandora 46.0944 72.347 93.6138 76.8928 15.5618 10
reco:pandoraWriter:StandardPandora 0.630628 0.779246 1.00946 0.763431 0.133445 10
reco:pandoraTrack:LArPandoraTrackCreation 7.39309 12.0937 19.3448 11.4101 3.50367 10
reco:pandoraShower:LArPandoraShowerCreation 10.6078 16.5579 27.1551 16.0052 4.44688 10
reco:pandoracalo:Calorimetry 4.05789 7.89338 13.6587 7.35499 2.74346 10
reco:pandoracalonosce:Calorimetry 4.18483 7.42223 11.6464 6.81372 2.18324 10
reco:pandorapid:Chi2ParticleID 0.00755648 0.00935336 0.0116178 0.00919905 0.00118205 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.080214 0.0950634 0.103838 0.0955819 0.00727086 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00645051 0.0093456 0.0111775 0.00958259 0.00145948 10
reco:pandoraShowercalo:ShowerCalorimetry 12.8496 20.0145 31.2788 20.734 5.43965 10
reco:pandoraShowercalonosce:ShowerCalorimetry 12.5019 17.8652 26.3691 17.0275 4.19234 10
reco:emtrkmichelid:EmTrackMichelId 244.96 275.801 311.055 274.993 18.8694 10
reco:crttag:SingleCRTMatchingProducer 0.0265682 0.0402622 0.0735695 0.0381495 0.013145 10
reco:crtreco:TwoCRTMatchingProducer 0.0195747 0.0272931 0.036126 0.0255154 0.004729 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.01553 1.21529 1.68935 1.14049 0.187627 10
reco:pandora2Track:LArPandoraTrackCreation 26.4002 38.9706 49.6155 40.7759 7.97314 10
reco:pandora2calo:Calorimetry 14.4371 22.308 29.7057 22.5325 5.31851 10
reco:pandora2calonosce:Calorimetry 14.2806 21.6709 30.0218 20.7714 4.81209 10
reco:pandora2pid:Chi2ParticleID 0.0162735 0.0229446 0.0314426 0.0226973 0.00383199 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0779643 0.116777 0.146077 0.117763 0.0214143 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.01585 0.0218305 0.0299816 0.0225618 0.00434107 10
reco:pandora2Shower:LArPandoraShowerCreation 10.8885 13.5247 18.7258 12.5956 2.66098 10
reco:pandora2Showercalo:ShowerCalorimetry 13.3841 20.0324 28.2034 19.3849 4.51217 10
reco:pandora2Showercalonosce:ShowerCalorimetry 12.9838 16.9289 21.9746 16.8834 3.40131 10
[art]:TriggerResults:TriggerResultInserter 7.9949e-05 0.000124441 0.00026687 9.907e-05 5.34178e-05 10
end_path:out1:RootOutput 1.3736e-05 1.94082e-05 3.0517e-05 1.7628e-05 5.64507e-06 10
end_path:out1:RootOutput(write) 3.32736 4.03345 4.76228 3.95488 0.405306 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5161.53 MB
Peak resident set size usage (VmHWM): 4325.62 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.58 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11245156
-rw-r--r-- 1 dune001 lbno 2600068275 Jan 4 14:22 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2462308711 Jan 4 14:20 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2336991462 Jan 4 16:16 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 2062192202 Jan 4 11:46 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 1965779763 Jan 4 11:27 g4_stage1.root
-rw-r--r-- 1 dune001 lbno 87084600 Jan 4 16:08 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 242864 Jan 4 16:16 jobscript.log
-rw-r--r-- 1 dune001 lbno 217088 Jan 4 16:16 mem.db
-rw-r--r-- 1 dune001 lbno 62376 Jan 4 16:16 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 36864 Jan 4 16:16 time.db
-rw-r--r-- 1 dune001 lbno 519 Jan 4 14:22 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 4 11:46 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 4 16:16 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno 52 Jan 4 11:18 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 7 Jan 4 16:16 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Jan 4 14:33 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Jan 4 14:22 debugprod.log