Jobsub ID 261205.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261205.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11164 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-11 20:10:40 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 18:05:51 |
| From worker node | Hostname | dunegli-8047050-0-fnpc17109.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:35:30 |
| Input files | monte-carlo-011164-000001
|
| Jobscript | Exit code | 0 |
| Real time | 6h (23394s) |
| CPU time | 6h (23004s = 98%) |
| Max RSS bytes | 4459331584 (4252 MiB) |
| Outputting started | 2025-12-12 18:05:24 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11164/1/001/reco_stage1.root
|
| Finished | 2025-12-12 18:05:51 |
| Saved logs | justin-logs:261205.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 146150 traces, 0 summary
Retagger: tagging trace set: gauss with 110766 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 110766 traces tagged "gauss"
FrameSaver: q=3.93532e+06 n=1916266 tag=gauss
wclsFrameSaver: saving 146150 traces tagged "wiener"
FrameSaver: q=4.16404e+06 n=1691166 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22576 XUs and 28105 XVs -> 95 XUVs
C:0 T:1 31204 XUs and 32615 XVs -> 2636 XUVs
C:0 T:2 120443 XUs and 121711 XVs -> 4600 XUVs
C:0 T:3 63358 XUs and 52779 XVs -> 346 XUVs
C:0 T:4 12095 XUs and 16217 XVs -> 79 XUVs
C:0 T:5 46970 XUs and 47248 XVs -> 3885 XUVs
C:0 T:6 108709 XUs and 114522 XVs -> 8187 XUVs
C:0 T:7 46354 XUs and 46635 XVs -> 762 XUVs
C:0 T:8 9267 XUs and 8912 XVs -> 144 XUVs
C:0 T:9 52936 XUs and 60608 XVs -> 4117 XUVs
C:0 T:10 46390 XUs and 36550 XVs -> 7483 XUVs
C:0 T:11 468 XUs and 364 XVs -> 68 XUVs
32402 XUVs total
11335 collection wire objects
29712 potential space points
Neighbour search...
1730688 tests to find 970120 neighbours
Iterating with no regularization...
Begin: 8.00756e+07
0 7.06009e+07
1 6.99507e+07
2 6.98623e+07
3 6.98406e+07
Now with regularization...
Begin: 5.81079e+07
0 5.80921e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058653
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058653
fLifetime: 30000 [us]
12-Dec-2025 18:05:21 UTC Closed output file "reco_stage1.root"
12-Dec-2025 18:05:21 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 441.072 812.328 1151.86 835.754 225.512 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00282291 0.00756205 0.0135914 0.00785549 0.00291387 10
reco:ophit:OpHitFinder 0.34115 0.416865 0.524621 0.390001 0.0638788 10
reco:opflash:OpFlashFinder 0.254204 0.366911 0.52254 0.353996 0.0875457 10
reco:opslicer:OpSlicer 0.719764 0.996817 1.42666 0.94397 0.237398 10
reco:caldata:DataPrepModule 7.03547 8.02043 10.4388 7.4324 1.17609 10
reco:wclsdatasp:WireCellToolkit 62.0714 79.7999 115.123 72.7781 19.6312 10
reco:gaushit:GausHitFinder 1.41512 2.18139 3.54487 2.12402 0.594512 10
reco:nhitsfilter:NumberOfHitsFilter 0.000874959 0.00152199 0.00265682 0.00120733 0.000657552 10
reco:reco3d:SpacePointSolver 12.8498 31.3562 55.161 27.431 12.4548 10
reco:hitpdune:DisambigFromSpacePoints 1.91266 3.81487 5.45683 3.86762 1.04821 10
reco:pandora:StandardPandora 33.477 82.2091 190.519 68.9139 48.095 10
reco:pandoraWriter:StandardPandora 0.524883 0.96996 1.36185 1.00832 0.252923 10
reco:pandoraTrack:LArPandoraTrackCreation 10.2303 24.4699 44.6663 26.5205 10.2889 10
reco:pandoraShower:LArPandoraShowerCreation 10.0914 29.6205 48.1478 31.6172 11.7814 10
reco:pandoracalo:Calorimetry 3.97567 11.2724 17.3421 12.2851 4.37822 10
reco:pandoracalonosce:Calorimetry 4.15212 11.1399 17.0276 11.4815 4.11408 10
reco:pandorapid:Chi2ParticleID 0.0072965 0.0110545 0.0184091 0.0106667 0.00338736 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0726672 0.102096 0.138896 0.102961 0.0196336 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00648867 0.0101666 0.0137387 0.0102743 0.00231181 10
reco:pandoraShowercalo:ShowerCalorimetry 6.93515 26.8168 52.7461 27.1351 12.826 10
reco:pandoraShowercalonosce:ShowerCalorimetry 6.34608 25.3076 51.2245 24.9984 12.8807 10
reco:emtrkmichelid:EmTrackMichelId 195.127 277.416 335.093 288.634 41.8118 10
reco:crttag:SingleCRTMatchingProducer 0.0282172 0.0528955 0.0815572 0.0495821 0.0163201 10
reco:crtreco:TwoCRTMatchingProducer 0.0212934 0.0426985 0.0702601 0.0393286 0.0153538 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.27917 1.69246 2.15863 1.71584 0.255826 10
reco:pandora2Track:LArPandoraTrackCreation 29.8879 66.1421 117.36 65.6409 26.9405 10
reco:pandora2calo:Calorimetry 11.7318 28.888 54.3828 27.0834 12.7864 10
reco:pandora2calonosce:Calorimetry 10.5036 26.7762 51.5123 24.5983 12.57 10
reco:pandora2pid:Chi2ParticleID 0.0157561 0.0272114 0.0487302 0.0256477 0.00941672 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0853113 0.136579 0.211646 0.138569 0.0335389 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0154247 0.0230821 0.0447972 0.0222732 0.00823868 10
reco:pandora2Shower:LArPandoraShowerCreation 9.57122 20.6077 33.771 20.8076 8.45305 10
reco:pandora2Showercalo:ShowerCalorimetry 9.29357 24.6934 59.3335 21.0999 14.294 10
reco:pandora2Showercalonosce:ShowerCalorimetry 7.60403 22.4707 62.178 18.5132 15.1983 10
[art]:TriggerResults:TriggerResultInserter 9.4895e-05 0.000144609 0.000238702 0.000126058 4.40329e-05 10
end_path:out1:RootOutput 1.4279e-05 1.99341e-05 3.4782e-05 1.8802e-05 5.96762e-06 10
end_path:out1:RootOutput(write) 2.73338 4.10179 6.48152 3.72717 1.02864 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5299.48 MB
Peak resident set size usage (VmHWM): 4459.33 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.70 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11252008
-rw-r--r-- 1 dunegli fnalgrid 2607450473 Dec 12 15:46 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2472434943 Dec 12 15:43 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2325547360 Dec 12 18:05 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2061242910 Dec 12 12:08 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1972757913 Dec 12 11:42 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 81991820 Dec 12 17:56 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243083 Dec 12 18:05 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 18:05 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 18:05 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 18:05 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 15:46 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 12:08 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 18:05 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:35 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 18:05 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 16:02 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 15:46 debugprod.log
