Jobsub ID 261922.0@dunegpschedd02.fnal.gov
| Jobsub ID | 261922.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11203 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-13 04:58:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-13 13:43:42 |
| From worker node | Hostname | dunegli-7890435-0-fnpc17109.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-13 04:58:52 |
| Input files | monte-carlo-011203-000001
|
| Jobscript | Exit code | 0 |
| Real time | 8h (31456s) |
| CPU time | 8h (30826s = 97%) |
| Max RSS bytes | 4186771456 (3992 MiB) |
| Outputting started | 2025-12-13 13:43:09 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11203/1/001/reco_stage1.root
|
| Finished | 2025-12-13 13:43:42 |
| Saved logs | justin-logs:261922.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 139375 traces, 0 summary
Retagger: tagging trace set: gauss with 101665 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 101665 traces tagged "gauss"
FrameSaver: q=3.71242e+06 n=1734616 tag=gauss
wclsFrameSaver: saving 139375 traces tagged "wiener"
FrameSaver: q=3.96395e+06 n=1520904 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28061 XUs and 29801 XVs -> 292 XUVs
C:0 T:1 43632 XUs and 48595 XVs -> 2969 XUVs
C:0 T:2 166943 XUs and 201683 XVs -> 10798 XUVs
C:0 T:3 72465 XUs and 80718 XVs -> 652 XUVs
C:0 T:4 8730 XUs and 14815 XVs -> 158 XUVs
C:0 T:5 50220 XUs and 99737 XVs -> 16444 XUVs
C:0 T:6 111180 XUs and 71945 XVs -> 5665 XUVs
C:0 T:7 29814 XUs and 25682 XVs -> 350 XUVs
C:0 T:8 6312 XUs and 5846 XVs -> 221 XUVs
C:0 T:9 35887 XUs and 42834 XVs -> 6251 XUVs
C:0 T:10 41039 XUs and 53421 XVs -> 7027 XUVs
C:0 T:11 56 XUs and 28 XVs -> 8 XUVs
50835 XUVs total
11585 collection wire objects
46749 potential space points
Neighbour search...
7189085 tests to find 3249034 neighbours
Iterating with no regularization...
Begin: 9.93531e+07
0 7.80491e+07
1 7.66071e+07
2 7.64234e+07
3 7.63707e+07
Now with regularization...
Begin: 6.46096e+07
0 6.45545e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411086105
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411086105
fLifetime: 30000 [us]
13-Dec-2025 13:43:03 UTC Closed output file "reco_stage1.root"
13-Dec-2025 13:43:03 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 725.163 1058.12 1588.32 1057.55 234.161 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00313624 0.0093419 0.0165504 0.00970241 0.00380967 10
reco:ophit:OpHitFinder 0.39996 0.486391 0.574451 0.49099 0.0487004 10
reco:opflash:OpFlashFinder 0.290982 0.377592 0.619374 0.32824 0.102064 10
reco:opslicer:OpSlicer 0.834619 1.09058 1.38488 1.09219 0.169644 10
reco:caldata:DataPrepModule 7.91252 10.5946 11.8101 10.9791 1.36481 10
reco:wclsdatasp:WireCellToolkit 77.2302 105.077 120.909 106.263 12.5092 10
reco:gaushit:GausHitFinder 1.612 2.65553 3.63782 2.75396 0.596297 10
reco:nhitsfilter:NumberOfHitsFilter 0.00136345 0.00252708 0.00362153 0.00258187 0.000673467 10
reco:reco3d:SpacePointSolver 17.5539 31.993 50.5472 29.1936 9.66378 10
reco:hitpdune:DisambigFromSpacePoints 2.22045 4.71902 7.78489 4.74275 1.73537 10
reco:pandora:StandardPandora 42.5952 109.356 327.839 88.2391 78.455 10
reco:pandoraWriter:StandardPandora 0.769759 1.13132 1.85145 1.09369 0.313417 10
reco:pandoraTrack:LArPandoraTrackCreation 19.6556 30.7218 40.8093 33.8493 7.24643 10
reco:pandoraShower:LArPandoraShowerCreation 18.5018 34.288 44.1368 37.92 7.83087 10
reco:pandoracalo:Calorimetry 8.15542 15.1967 22.9053 16.7586 4.55853 10
reco:pandoracalonosce:Calorimetry 7.68044 14.0696 22.211 13.2134 4.7571 10
reco:pandorapid:Chi2ParticleID 0.00698296 0.0126374 0.0193733 0.0117829 0.00443054 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0759497 0.106549 0.156193 0.103031 0.0253733 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00685282 0.0103905 0.0166023 0.00898329 0.00314179 10
reco:pandoraShowercalo:ShowerCalorimetry 15.2561 32.9155 49.0427 33.7707 10.144 10
reco:pandoraShowercalonosce:ShowerCalorimetry 14.4556 31.6925 46.3736 33.148 10.1229 10
reco:emtrkmichelid:EmTrackMichelId 218.192 322.773 435.251 313.811 68.6687 10
reco:crttag:SingleCRTMatchingProducer 0.0658819 0.106627 0.275194 0.0909865 0.0577703 10
reco:crtreco:TwoCRTMatchingProducer 0.0570335 0.0726564 0.090792 0.0728289 0.0108401 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.66347 2.72102 3.79128 2.61498 0.612898 10
reco:pandora2Track:LArPandoraTrackCreation 70.7384 104.446 138.032 104.659 19.2709 10
reco:pandora2calo:Calorimetry 31.3306 47.484 66.7025 45.8941 10.6149 10
reco:pandora2calonosce:Calorimetry 29.8083 43.6919 66.1667 40.1001 10.3248 10
reco:pandora2pid:Chi2ParticleID 0.0186165 0.0276456 0.0404104 0.0277649 0.00698548 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.102737 0.145557 0.181954 0.147431 0.0232364 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0178423 0.025684 0.0343399 0.0269663 0.00560375 10
reco:pandora2Shower:LArPandoraShowerCreation 22.7849 30.9526 45.9397 29.9013 5.8205 10
reco:pandora2Showercalo:ShowerCalorimetry 28.3068 40.5008 61.6284 39.715 10.5062 10
reco:pandora2Showercalonosce:ShowerCalorimetry 24.9434 33.6585 57.8842 30.8338 9.37728 10
[art]:TriggerResults:TriggerResultInserter 0.000100522 0.000176232 0.000469373 0.000157416 0.000103263 10
end_path:out1:RootOutput 1.6632e-05 2.81144e-05 6.2609e-05 2.4955e-05 1.28863e-05 10
end_path:out1:RootOutput(write) 3.35279 4.53362 5.72304 4.63398 0.760248 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5002.63 MB
Peak resident set size usage (VmHWM): 4186.77 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.45 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10392208
-rw-r--r-- 1 dunegli fnalgrid 2425381947 Dec 13 10:42 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2299382678 Dec 13 10:36 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2112480680 Dec 13 13:43 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1908541904 Dec 13 05:46 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1819879912 Dec 13 05:10 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75321860 Dec 13 13:32 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242924 Dec 13 13:43 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 13 13:43 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 13 13:43 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 13 13:43 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 10:42 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 05:46 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 13:43 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 13 04:58 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 13 13:43 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 11:03 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 10:42 debugprod.log
