Jobsub ID 301805.0@dunegpschedd01.fnal.gov
| Jobsub ID | 301805.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12453 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-27 21:01:50 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-28 00:52:03 |
| From worker node | Hostname | dunegli-8449993-0-fnpc17112.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-27 21:03:31 |
| Input files | monte-carlo-012453-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13697s) |
| CPU time | 3h (12820s = 93%) |
| Max RSS bytes | 4208173056 (4013 MiB) |
| Outputting started | 2026-01-28 00:51:49 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12453/1/001/reco_stage1.root
|
| Finished | 2026-01-28 00:52:03 |
| Saved logs | justin-logs:301805.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 119174 traces, 0 summary
Retagger: tagging trace set: gauss with 89995 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 89995 traces tagged "gauss"
FrameSaver: q=3.12081e+06 n=1600750 tag=gauss
wclsFrameSaver: saving 119174 traces tagged "wiener"
FrameSaver: q=3.32038e+06 n=1412579 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28902 XUs and 15274 XVs -> 223 XUVs
C:0 T:1 74573 XUs and 45223 XVs -> 5531 XUVs
C:0 T:2 101651 XUs and 103145 XVs -> 7503 XUVs
C:0 T:3 48759 XUs and 39418 XVs -> 395 XUVs
C:0 T:4 10415 XUs and 10022 XVs -> 56 XUVs
C:0 T:5 43504 XUs and 30681 XVs -> 3786 XUVs
C:0 T:6 128596 XUs and 100111 XVs -> 8125 XUVs
C:0 T:7 45870 XUs and 30714 XVs -> 363 XUVs
C:0 T:8 6828 XUs and 7473 XVs -> 141 XUVs
C:0 T:9 57737 XUs and 81916 XVs -> 7282 XUVs
C:0 T:10 51670 XUs and 56404 XVs -> 14856 XUVs
C:0 T:11 416 XUs and 403 XVs -> 24 XUVs
48285 XUVs total
11981 collection wire objects
45220 potential space points
Neighbour search...
7760934 tests to find 3591054 neighbours
Iterating with no regularization...
Begin: 7.94426e+07
0 5.75831e+07
1 5.58896e+07
2 5.55947e+07
3 5.5506e+07
4 5.54671e+07
Now with regularization...
Begin: 4.47347e+07
0 4.4607e+07
1 4.45457e+07
2 4.45021e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412004821
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412004821
fLifetime: 30000 [us]
28-Jan-2026 00:51:47 UTC Closed output file "reco_stage1.root"
28-Jan-2026 00:51:47 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 286.485 428.784 613.039 423.538 85.5349 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000892285 0.00338841 0.00552442 0.00351809 0.00140126 10
reco:ophit:OpHitFinder 0.214585 0.259142 0.287344 0.268429 0.0216067 10
reco:opflash:OpFlashFinder 0.134491 0.187472 0.224046 0.189648 0.0233945 10
reco:opslicer:OpSlicer 0.446046 0.626939 0.75377 0.649814 0.0935268 10
reco:caldata:DataPrepModule 5.27675 5.73587 6.26303 5.82902 0.279575 10
reco:wclsdatasp:WireCellToolkit 41.0639 46.6044 51.1962 47.3482 2.81949 10
reco:gaushit:GausHitFinder 1.0498 1.46651 2.0178 1.41161 0.264807 10
reco:nhitsfilter:NumberOfHitsFilter 0.000527675 0.000722546 0.000910382 0.000744252 9.5289e-05 10
reco:reco3d:SpacePointSolver 10.1422 17.2445 26.4607 17.0009 4.7472 10
reco:hitpdune:DisambigFromSpacePoints 1.35077 2.27585 3.88861 2.24196 0.678448 10
reco:pandora:StandardPandora 23.6405 39.7157 80.8924 34.1024 16.2868 10
reco:pandoraWriter:StandardPandora 0.370473 0.931129 2.84073 0.561442 0.85922 10
reco:pandoraTrack:LArPandoraTrackCreation 3.82504 8.4048 12.5542 9.13311 2.41303 10
reco:pandoraShower:LArPandoraShowerCreation 3.67564 9.37513 15.2025 9.69181 3.28944 10
reco:pandoracalo:Calorimetry 1.87794 3.60931 4.91405 3.78353 0.97191 10
reco:pandoracalonosce:Calorimetry 1.64096 3.21362 4.37577 3.394 0.850337 10
reco:pandorapid:Chi2ParticleID 0.00423896 0.00547903 0.00670894 0.00561107 0.000700278 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0507949 0.0681462 0.0862884 0.0682503 0.00989287 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00444659 0.00533063 0.00659442 0.0055529 0.000673644 10
reco:pandoraShowercalo:ShowerCalorimetry 3.66841 8.38168 13.3328 8.47394 2.74385 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.48982 8.01718 14.0377 8.22065 2.96133 10
reco:emtrkmichelid:EmTrackMichelId 140.182 188.086 245.575 186.332 29.3024 10
reco:crttag:SingleCRTMatchingProducer 0.0194648 0.0297196 0.0385971 0.0283799 0.00603202 10
reco:crtreco:TwoCRTMatchingProducer 0.0113053 0.0209124 0.0303586 0.0210073 0.00537702 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.08666 1.29474 1.60132 1.24743 0.172498 10
reco:pandora2Track:LArPandoraTrackCreation 12.6582 29.0066 53.9301 28.5645 11.5917 10
reco:pandora2calo:Calorimetry 5.3329 11.6512 21.2602 11.1248 4.18644 10
reco:pandora2calonosce:Calorimetry 5.02554 11.2796 18.3071 11.1861 3.65699 10
reco:pandora2pid:Chi2ParticleID 0.010757 0.0143225 0.0193139 0.0144581 0.00242474 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0682192 0.0865823 0.109552 0.0845812 0.0122339 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0111755 0.0141946 0.0179687 0.0140759 0.0021932 10
reco:pandora2Shower:LArPandoraShowerCreation 4.04153 8.33115 12.7265 8.21724 2.68573 10
reco:pandora2Showercalo:ShowerCalorimetry 4.63412 9.7655 15.4687 9.58329 3.10846 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.22707 8.55512 12.9843 8.43671 2.59483 10
[art]:TriggerResults:TriggerResultInserter 3.5356e-05 5.57173e-05 0.000114273 5.19815e-05 2.09854e-05 10
end_path:out1:RootOutput 7.018e-06 9.0759e-06 1.2985e-05 9.1915e-06 1.75508e-06 10
end_path:out1:RootOutput(write) 2.63489 4.34722 9.17441 3.26161 2.11792 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5023.32 MB
Peak resident set size usage (VmHWM): 4208.17 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.48 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10077168
-rw-r--r-- 1 dunegli fnalgrid 2370290836 Jan 27 23:30 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2252796167 Jan 27 23:25 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2079370837 Jan 28 00:51 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1802108478 Jan 27 21:21 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1733622913 Jan 27 21:08 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80193100 Jan 28 00:46 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243020 Jan 28 00:51 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 28 00:51 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 28 00:51 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 28 00:51 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 23:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 21:21 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 00:51 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 27 21:03 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 28 00:51 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 27 23:38 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 27 23:30 debugprod.log
