Jobsub ID 264686.0@dunegpschedd02.fnal.gov
| Jobsub ID | 264686.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11379 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-28 15:22:07 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-12-28 17:36:54 |
| From worker node | Hostname | dunegli-49579-0-cmswn6018.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-28 15:23:37 |
| Input files | monte-carlo-011379-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7985s) |
| CPU time | 2h (7946s = 99%) |
| Max RSS bytes | 4257673216 (4060 MiB) |
| Outputting started | 2025-12-28 17:36:43 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11379/1/001/reco_stage1.root
|
| Finished | 2025-12-28 17:36:54 |
| Saved logs | justin-logs:264686.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
pAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 156707 traces, 0 summary
Retagger: tagging trace set: gauss with 119840 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119840 traces tagged "gauss"
FrameSaver: q=4.23458e+06 n=2156252 tag=gauss
wclsFrameSaver: saving 156707 traces tagged "wiener"
FrameSaver: q=4.47133e+06 n=1917683 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 88538 XUs and 81954 XVs -> 7232 XUVs
C:0 T:2 140750 XUs and 168992 XVs -> 6393 XUVs
C:0 T:3 59980 XUs and 69082 XVs -> 661 XUVs
C:0 T:4 15072 XUs and 17641 XVs -> 211 XUVs
C:0 T:5 61609 XUs and 61274 XVs -> 6296 XUVs
C:0 T:6 126480 XUs and 105276 XVs -> 6379 XUVs
C:0 T:7 45244 XUs and 44739 XVs -> 427 XUVs
C:0 T:8 11879 XUs and 9933 XVs -> 150 XUVs
C:0 T:9 85455 XUs and 96339 XVs -> 9194 XUVs
C:0 T:10 25953 XUs and 17962 XVs -> 4257 XUVs
C:0 T:11 22 XUs and 14 XVs -> 0 XUVs
41200 XUVs total
14936 collection wire objects
38072 potential space points
Neighbour search...
2692916 tests to find 1404234 neighbours
Iterating with no regularization...
Begin: 9.47063e+07
0 7.40339e+07
1 7.2773e+07
2 7.26193e+07
3 7.25775e+07
Now with regularization...
Begin: 5.95374e+07
0 5.95045e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411396621
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411396621
fLifetime: 30000 [us]
28-Dec-2025 17:36:42 UTC Closed output file "reco_stage1.root"
28-Dec-2025 17:36:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 162.059 234.722 279.561 237.734 35.875 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000518762 0.00271241 0.00460914 0.00279847 0.00129515 10
reco:ophit:OpHitFinder 0.201343 0.224273 0.243316 0.222432 0.0120038 10
reco:opflash:OpFlashFinder 0.135067 0.169609 0.209257 0.163991 0.0252448 10
reco:opslicer:OpSlicer 0.396892 0.454786 0.509903 0.454257 0.0308632 10
reco:caldata:DataPrepModule 3.05609 3.12209 3.27616 3.11946 0.0596775 10
reco:wclsdatasp:WireCellToolkit 19.7152 21.1058 21.6799 21.2274 0.514871 10
reco:gaushit:GausHitFinder 0.554812 0.730632 0.921876 0.732939 0.0993456 10
reco:nhitsfilter:NumberOfHitsFilter 0.000184372 0.000255817 0.000346248 0.000262526 4.20066e-05 10
reco:reco3d:SpacePointSolver 8.46524 13.5514 20.8866 13.4856 4.03374 10
reco:hitpdune:DisambigFromSpacePoints 0.585155 1.12213 1.50828 1.15469 0.267772 10
reco:pandora:StandardPandora 13.6377 23.3153 31.4352 24.0343 5.77066 10
reco:pandoraWriter:StandardPandora 0.18409 0.264934 0.319821 0.268979 0.0423849 10
reco:pandoraTrack:LArPandoraTrackCreation 1.41535 2.37837 3.13268 2.40858 0.504719 10
reco:pandoraShower:LArPandoraShowerCreation 1.56848 2.928 4.4152 2.89106 0.806155 10
reco:pandoracalo:Calorimetry 0.789795 1.42152 1.80109 1.45625 0.29406 10
reco:pandoracalonosce:Calorimetry 0.726249 1.32749 1.68763 1.35314 0.280357 10
reco:pandorapid:Chi2ParticleID 0.00259067 0.00324029 0.00398055 0.00319339 0.00037469 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.023246 0.0320706 0.0354851 0.0334994 0.00384225 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00246303 0.00303468 0.00339871 0.00301 0.000290077 10
reco:pandoraShowercalo:ShowerCalorimetry 1.50093 3.28269 4.72575 3.33948 0.908164 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.45334 3.21323 4.63817 3.26663 0.893047 10
reco:emtrkmichelid:EmTrackMichelId 90.9757 125.875 144.406 128.98 16.0287 10
reco:crttag:SingleCRTMatchingProducer 0.00442154 0.0078448 0.0101125 0.00810823 0.00146552 10
reco:crtreco:TwoCRTMatchingProducer 0.00334908 0.0049856 0.00570543 0.00510094 0.000656871 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.423636 0.583254 0.645352 0.601246 0.0635262 10
reco:pandora2Track:LArPandoraTrackCreation 4.31992 8.2339 11.61 8.18622 2.08233 10
reco:pandora2calo:Calorimetry 2.18225 4.46669 6.15848 4.46678 1.11321 10
reco:pandora2calonosce:Calorimetry 2.11151 4.29369 5.94883 4.30349 1.07593 10
reco:pandora2pid:Chi2ParticleID 0.00597955 0.00769894 0.00960139 0.00754784 0.00104798 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0294795 0.0394585 0.0447285 0.0417387 0.00530966 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00588459 0.00756352 0.00952093 0.00746867 0.0010338 10
reco:pandora2Shower:LArPandoraShowerCreation 1.73093 3.03292 4.21264 2.97762 0.712497 10
reco:pandora2Showercalo:ShowerCalorimetry 1.90904 3.89242 5.23457 3.93943 0.936056 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.7476 3.58649 4.81324 3.67437 0.86024 10
[art]:TriggerResults:TriggerResultInserter 2.2605e-05 3.27991e-05 7.4303e-05 2.8994e-05 1.40541e-05 10
end_path:out1:RootOutput 5.939e-06 7.5176e-06 1.0817e-05 7.2415e-06 1.19137e-06 10
end_path:out1:RootOutput(write) 1.41416 1.96861 2.26859 1.9884 0.276641 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5081.15 MB
Peak resident set size usage (VmHWM): 4257.67 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.93 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11049936
-rw-r--r-- 1 dunegli fnalgrid 2563964008 Dec 28 16:56 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2424554460 Dec 28 16:55 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2307835335 Dec 28 17:36 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2003767691 Dec 28 15:34 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1925892247 Dec 28 15:26 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 88307250 Dec 28 17:33 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242893 Dec 28 17:36 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 28 17:36 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 28 17:36 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 28 17:36 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 16:56 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 15:34 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 17:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 28 15:23 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 28 17:36 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 17:00 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:56 debugprod.log
