Jobsub ID 257051.0@dunegpschedd01.fnal.gov
| Jobsub ID | 257051.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10662 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-25 08:34:06 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-25 12:55:28 |
| From worker node | Hostname | dunegli-7887275-0-fnpc18002.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-25 08:34:29 |
| Input files | monte-carlo-010662-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15631s) |
| CPU time | 4h (15601s = 99%) |
| Max RSS bytes | 4115529728 (3924 MiB) |
| Outputting started | 2025-11-25 12:55:01 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10662/1/001/reco_stage1.root
|
| Finished | 2025-11-25 12:55:28 |
| Saved logs | justin-logs:257051.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144028 traces, 0 summary
Retagger: tagging trace set: gauss with 109657 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109657 traces tagged "gauss"
FrameSaver: q=3.7899e+06 n=1932133 tag=gauss
wclsFrameSaver: saving 144028 traces tagged "wiener"
FrameSaver: q=4.01919e+06 n=1714393 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 23769 XUs and 30979 XVs -> 191 XUVs
C:0 T:1 50753 XUs and 55519 XVs -> 3147 XUVs
C:0 T:2 100107 XUs and 122364 XVs -> 3862 XUVs
C:0 T:3 52212 XUs and 53363 XVs -> 433 XUVs
C:0 T:4 13378 XUs and 12389 XVs -> 172 XUVs
C:0 T:5 48152 XUs and 33819 XVs -> 5000 XUVs
C:0 T:6 117231 XUs and 119631 XVs -> 9615 XUVs
C:0 T:7 44748 XUs and 45455 XVs -> 590 XUVs
C:0 T:8 9830 XUs and 8615 XVs -> 328 XUVs
C:0 T:9 71984 XUs and 70340 XVs -> 12170 XUVs
C:0 T:10 71666 XUs and 35347 XVs -> 5236 XUVs
C:0 T:11 985 XUs and 582 XVs -> 67 XUVs
40811 XUVs total
12525 collection wire objects
37116 potential space points
Neighbour search...
3257540 tests to find 1769966 neighbours
Iterating with no regularization...
Begin: 6.40885e+07
0 5.38206e+07
1 5.30718e+07
2 5.29553e+07
3 5.29207e+07
Now with regularization...
Begin: 4.27391e+07
0 4.26935e+07
1 4.26641e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410727071
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410727071
fLifetime: 30000 [us]
25-Nov-2025 12:54:57 UTC Closed output file "reco_stage1.root"
25-Nov-2025 12:54:57 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 460.127 610.426 767.43 586.407 98.1295 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00230382 0.00437761 0.00742027 0.00446154 0.00138628 10
reco:ophit:OpHitFinder 0.342366 0.40993 0.487501 0.402691 0.0457912 10
reco:opflash:OpFlashFinder 0.168108 0.234895 0.306813 0.252209 0.0430853 10
reco:opslicer:OpSlicer 0.926785 1.11417 1.38276 1.07829 0.147643 10
reco:caldata:DataPrepModule 8.51192 9.0025 9.51402 8.92879 0.369943 10
reco:wclsdatasp:WireCellToolkit 48.272 54.1699 57.3193 54.8791 2.43622 10
reco:gaushit:GausHitFinder 1.47308 1.94938 2.4636 1.8403 0.325232 10
reco:nhitsfilter:NumberOfHitsFilter 0.000679427 0.000883989 0.00109359 0.000846177 0.000119681 10
reco:reco3d:SpacePointSolver 12.2366 21.3636 45.1154 19.7514 8.9126 10
reco:hitpdune:DisambigFromSpacePoints 1.43171 2.47061 3.30961 2.58135 0.606636 10
reco:pandora:StandardPandora 28.9875 60.4043 104.093 55.6728 23.3865 10
reco:pandoraWriter:StandardPandora 0.543933 0.704686 0.876136 0.682721 0.0976606 10
reco:pandoraTrack:LArPandoraTrackCreation 5.15524 7.80965 9.74062 8.29933 1.57403 10
reco:pandoraShower:LArPandoraShowerCreation 4.01682 8.95256 11.5635 9.62007 2.49568 10
reco:pandoracalo:Calorimetry 2.7252 4.71844 5.99241 5.19429 1.05628 10
reco:pandoracalonosce:Calorimetry 2.40782 4.40966 5.92062 4.87643 1.17081 10
reco:pandorapid:Chi2ParticleID 0.00987545 0.0118977 0.0137879 0.0123921 0.00133116 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0741441 0.0981399 0.132954 0.0935614 0.0153996 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00871571 0.011094 0.0127717 0.0115652 0.00137773 10
reco:pandoraShowercalo:ShowerCalorimetry 3.38377 10.0763 13.7244 10.7949 3.37162 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.31006 9.571 12.4409 10.4843 3.1411 10
reco:emtrkmichelid:EmTrackMichelId 240.067 326.336 440.274 321.092 52.7066 10
reco:crttag:SingleCRTMatchingProducer 0.0179734 0.0227738 0.0286299 0.0218034 0.00353032 10
reco:crtreco:TwoCRTMatchingProducer 0.0143741 0.0194958 0.0296815 0.0181472 0.0040078 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.977762 1.31899 1.76536 1.2609 0.277021 10
reco:pandora2Track:LArPandoraTrackCreation 11.9527 24.1632 31.9909 26.8411 6.3118 10
reco:pandora2calo:Calorimetry 5.6382 13.0381 17.9837 14.0187 3.84511 10
reco:pandora2calonosce:Calorimetry 5.19679 12.7292 19.7461 13.2819 4.20707 10
reco:pandora2pid:Chi2ParticleID 0.0200743 0.0292784 0.0380065 0.0291786 0.00576199 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.082415 0.12316 0.150338 0.123223 0.0220398 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0198979 0.0287085 0.0375134 0.0283362 0.00555089 10
reco:pandora2Shower:LArPandoraShowerCreation 4.53966 9.3616 12.9919 9.76332 2.52913 10
reco:pandora2Showercalo:ShowerCalorimetry 5.16357 11.1428 14.5262 12.4256 3.09897 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.4373 9.93133 13.6581 10.3592 2.99813 10
[art]:TriggerResults:TriggerResultInserter 7.117e-05 0.00011575 0.000267497 0.000103088 5.29363e-05 10
end_path:out1:RootOutput 1.6134e-05 2.19654e-05 4.5188e-05 1.93115e-05 8.14926e-06 10
end_path:out1:RootOutput(write) 3.45881 4.50742 5.6007 4.45213 0.676863 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4928.94 MB
Peak resident set size usage (VmHWM): 4115.53 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.73 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9704416
-rw-r--r-- 1 dunegli fnalgrid 2286369638 Nov 25 11:09 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2171781491 Nov 25 11:06 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1950410620 Nov 25 12:54 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1763972861 Nov 25 08:54 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1694574330 Nov 25 08:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 69597240 Nov 25 12:45 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243006 Nov 25 12:55 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 12:54 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 12:54 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 12:54 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 11:09 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 08:54 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 12:54 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 25 08:34 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 12:55 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:17 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:09 debugprod.log
