Jobsub ID 264594.0@dunegpschedd02.fnal.gov
| Jobsub ID | 264594.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11363 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-27 16:54:55 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-27 18:59:57 |
| From worker node | Hostname | dunegli-8170748-0-fnpc23028.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-27 16:58:35 |
| Input files | monte-carlo-011363-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7271s) |
| CPU time | 1h (7186s = 98%) |
| Max RSS bytes | 4291633152 (4092 MiB) |
| Outputting started | 2025-12-27 18:59:47 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11363/1/001/reco_stage1.root
|
| Finished | 2025-12-27 18:59:57 |
| Saved logs | justin-logs:264594.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 112191 traces, 0 summary
Retagger: tagging trace set: gauss with 90701 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90701 traces tagged "gauss"
FrameSaver: q=3.21999e+06 n=1701646 tag=gauss
wclsFrameSaver: saving 112191 traces tagged "wiener"
FrameSaver: q=3.3971e+06 n=1546853 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 58206 XUs and 53378 XVs -> 906 XUVs
C:0 T:1 134401 XUs and 112445 XVs -> 8899 XUVs
C:0 T:2 113842 XUs and 62575 XVs -> 4674 XUVs
C:0 T:3 42408 XUs and 27114 XVs -> 163 XUVs
C:0 T:4 8884 XUs and 10276 XVs -> 135 XUVs
C:0 T:5 20504 XUs and 16373 XVs -> 1590 XUVs
C:0 T:6 56655 XUs and 65039 XVs -> 2072 XUVs
C:0 T:8 9999 XUs and 6151 XVs -> 147 XUVs
C:0 T:9 69490 XUs and 60784 XVs -> 4337 XUVs
C:0 T:10 33656 XUs and 25016 XVs -> 2487 XUVs
C:0 T:11 131 XUs and 115 XVs -> 7 XUVs
25417 XUVs total
10286 collection wire objects
22525 potential space points
Neighbour search...
864691 tests to find 464540 neighbours
Iterating with no regularization...
Begin: 7.20241e+07
0 5.73755e+07
1 5.64325e+07
2 5.62953e+07
3 5.6253e+07
Now with regularization...
Begin: 4.77339e+07
0 4.77131e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411377741
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411377741
fLifetime: 30000 [us]
27-Dec-2025 18:59:46 UTC Closed output file "reco_stage1.root"
27-Dec-2025 18:59:46 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 146.744 203.423 270.322 206.83 32.5731 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000682945 0.00282577 0.00461021 0.00285382 0.00126555 10
reco:ophit:OpHitFinder 0.194573 0.216057 0.23842 0.220335 0.0133285 10
reco:opflash:OpFlashFinder 0.120087 0.157146 0.176069 0.165335 0.0200151 10
reco:opslicer:OpSlicer 0.40914 0.450854 0.516168 0.446623 0.0326104 10
reco:caldata:DataPrepModule 3.30052 3.43196 3.64314 3.39621 0.0978419 10
reco:wclsdatasp:WireCellToolkit 21.2967 22.4839 23.5073 22.411 0.533243 10
reco:gaushit:GausHitFinder 0.458703 0.698621 0.934312 0.720426 0.121599 10
reco:nhitsfilter:NumberOfHitsFilter 0.000228306 0.000323732 0.000450121 0.000302719 6.88389e-05 10
reco:reco3d:SpacePointSolver 6.25423 8.69179 14.9656 8.33824 2.2962 10
reco:hitpdune:DisambigFromSpacePoints 0.565505 0.986116 1.46757 1.01486 0.224775 10
reco:pandora:StandardPandora 8.6621 20.0513 31.6377 19.7875 6.6064 10
reco:pandoraWriter:StandardPandora 0.181458 0.255022 0.328802 0.262877 0.0428027 10
reco:pandoraTrack:LArPandoraTrackCreation 1.40857 2.35963 3.53826 2.40589 0.561801 10
reco:pandoraShower:LArPandoraShowerCreation 1.17934 2.27894 3.90748 2.31063 0.705302 10
reco:pandoracalo:Calorimetry 0.775851 1.3959 2.03777 1.42878 0.340407 10
reco:pandoracalonosce:Calorimetry 0.712432 1.30062 1.85006 1.33406 0.325166 10
reco:pandorapid:Chi2ParticleID 0.00303414 0.00369926 0.00506359 0.00362264 0.000556725 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0244278 0.0309779 0.0399535 0.0300893 0.00391274 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00276666 0.00344808 0.00395801 0.00353614 0.000397466 10
reco:pandoraShowercalo:ShowerCalorimetry 1.2171 2.60802 4.54402 2.71475 0.88458 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.18217 2.53476 4.44081 2.6334 0.860847 10
reco:emtrkmichelid:EmTrackMichelId 82.0355 108.513 136.667 111.86 14.2483 10
reco:crttag:SingleCRTMatchingProducer 0.00594166 0.00960993 0.0146159 0.00926627 0.00258703 10
reco:crtreco:TwoCRTMatchingProducer 0.00357067 0.00477236 0.00598834 0.00478066 0.000716297 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.419471 0.548451 0.679812 0.549027 0.0769381 10
reco:pandora2Track:LArPandoraTrackCreation 3.59145 6.7526 11.0703 6.78314 1.91172 10
reco:pandora2calo:Calorimetry 1.82556 3.69817 5.90937 3.82972 1.07286 10
reco:pandora2calonosce:Calorimetry 1.74728 3.51886 5.49865 3.68718 0.995297 10
reco:pandora2pid:Chi2ParticleID 0.00626578 0.00824933 0.0109408 0.00854215 0.0013177 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0297369 0.0385057 0.0497244 0.0386075 0.00512488 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00597492 0.00799735 0.0101997 0.00849487 0.00118652 10
reco:pandora2Shower:LArPandoraShowerCreation 1.36938 2.44267 3.69546 2.41705 0.589095 10
reco:pandora2Showercalo:ShowerCalorimetry 1.61735 3.18109 4.8919 3.31305 0.859832 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.49363 2.89543 4.39067 2.96291 0.764105 10
[art]:TriggerResults:TriggerResultInserter 2.9857e-05 4.09612e-05 0.000100552 3.38995e-05 2.01476e-05 10
end_path:out1:RootOutput 4.148e-06 8.1258e-06 1.2955e-05 7.8305e-06 2.06035e-06 10
end_path:out1:RootOutput(write) 1.35334 1.80257 2.4748 1.78724 0.283667 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5109.28 MB
Peak resident set size usage (VmHWM): 4291.63 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10631332
-rw-r--r-- 1 dunegli fnalgrid 2476617497 Dec 27 18:24 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2348998180 Dec 27 18:23 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2156412574 Dec 27 18:59 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1951526567 Dec 27 17:09 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1878514812 Dec 27 17:02 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 73739070 Dec 27 18:57 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242807 Dec 27 18:59 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 27 18:59 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 27 18:59 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 27 18:59 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 27 18:24 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 27 17:09 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 27 18:59 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 27 16:58 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 27 18:59 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 27 18:28 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 27 18:24 debugprod.log
