Jobsub ID 264684.1@dunegpschedd02.fnal.gov
| Jobsub ID | 264684.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11377 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-28 15:22:06 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-12-28 17:31:26 |
| From worker node | Hostname | dunegli-49579-0-cmswn6018.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-28 15:23:51 |
| Input files | monte-carlo-011377-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7643s) |
| CPU time | 2h (7600s = 99%) |
| Max RSS bytes | 4475011072 (4267 MiB) |
| Outputting started | 2025-12-28 17:31:15 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11377/1/001/reco_stage1.root
|
| Finished | 2025-12-28 17:31:26 |
| Saved logs | justin-logs:264684.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 137292 traces, 0 summary
Retagger: tagging trace set: gauss with 105643 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105643 traces tagged "gauss"
FrameSaver: q=3.59995e+06 n=1823344 tag=gauss
wclsFrameSaver: saving 137292 traces tagged "wiener"
FrameSaver: q=3.83263e+06 n=1618539 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 29064 XUs and 20839 XVs -> 265 XUVs
C:0 T:1 54279 XUs and 42491 XVs -> 3603 XUVs
C:0 T:2 125802 XUs and 168463 XVs -> 6634 XUVs
C:0 T:3 60675 XUs and 70638 XVs -> 920 XUVs
C:0 T:4 9819 XUs and 8743 XVs -> 105 XUVs
C:0 T:5 38781 XUs and 31191 XVs -> 4227 XUVs
C:0 T:6 129539 XUs and 139994 XVs -> 9078 XUVs
C:0 T:7 49381 XUs and 53271 XVs -> 792 XUVs
C:0 T:8 9318 XUs and 8856 XVs -> 113 XUVs
C:0 T:9 63151 XUs and 80981 XVs -> 5397 XUVs
C:0 T:10 28028 XUs and 12434 XVs -> 3080 XUVs
C:0 T:11 665 XUs and 420 XVs -> 53 XUVs
34267 XUVs total
12115 collection wire objects
31006 potential space points
Neighbour search...
1820112 tests to find 960466 neighbours
Iterating with no regularization...
Begin: 6.3783e+07
0 5.32605e+07
1 5.2333e+07
2 5.22004e+07
3 5.21639e+07
Now with regularization...
Begin: 4.14897e+07
0 4.14694e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411396644
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411396644
fLifetime: 30000 [us]
28-Dec-2025 17:31:14 UTC Closed output file "reco_stage1.root"
28-Dec-2025 17:31:14 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 168.367 218.886 328.905 212.485 45.0296 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000625976 0.00264149 0.00429541 0.00277364 0.00111929 10
reco:ophit:OpHitFinder 0.171268 0.214047 0.262183 0.213746 0.0227999 10
reco:opflash:OpFlashFinder 0.107569 0.156109 0.18318 0.157601 0.0216345 10
reco:opslicer:OpSlicer 0.309857 0.426829 0.562926 0.411758 0.0695785 10
reco:caldata:DataPrepModule 2.99842 3.11179 3.3586 3.09337 0.095718 10
reco:wclsdatasp:WireCellToolkit 20.1264 21.2018 21.9659 21.2887 0.545424 10
reco:gaushit:GausHitFinder 0.569057 0.708453 1.04226 0.675411 0.126207 10
reco:nhitsfilter:NumberOfHitsFilter 0.000198212 0.000264743 0.000518582 0.000243206 8.85211e-05 10
reco:reco3d:SpacePointSolver 5.43362 10.2454 18.625 9.81584 3.53942 10
reco:hitpdune:DisambigFromSpacePoints 0.646027 0.978587 1.90089 0.902776 0.347997 10
reco:pandora:StandardPandora 11.0053 22.2729 52.2072 20.2018 11.0637 10
reco:pandoraWriter:StandardPandora 0.193794 0.252802 0.38814 0.239007 0.0554861 10
reco:pandoraTrack:LArPandoraTrackCreation 1.62144 2.29168 3.2409 2.31954 0.517196 10
reco:pandoraShower:LArPandoraShowerCreation 1.58052 2.52051 4.09371 2.43612 0.750329 10
reco:pandoracalo:Calorimetry 1.00376 1.39002 1.83341 1.42957 0.271855 10
reco:pandoracalonosce:Calorimetry 0.938098 1.29844 1.70404 1.33849 0.25725 10
reco:pandorapid:Chi2ParticleID 0.00271473 0.00330028 0.0049794 0.00319579 0.000644255 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0230745 0.0303158 0.0403364 0.0304611 0.00473441 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00254433 0.00300207 0.00359378 0.00300702 0.000362411 10
reco:pandoraShowercalo:ShowerCalorimetry 1.7223 2.8285 4.44585 2.7525 0.812431 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.67753 2.76869 4.33092 2.69363 0.792942 10
reco:emtrkmichelid:EmTrackMichelId 95.6102 118.903 168.226 115.513 20.2704 10
reco:crttag:SingleCRTMatchingProducer 0.00555446 0.00787372 0.0138271 0.00761261 0.00219307 10
reco:crtreco:TwoCRTMatchingProducer 0.0040554 0.00489768 0.00674596 0.00473078 0.000739101 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.394889 0.543199 0.802162 0.518853 0.113809 10
reco:pandora2Track:LArPandoraTrackCreation 4.64791 7.36676 11.865 7.12625 2.13443 10
reco:pandora2calo:Calorimetry 2.64537 4.04943 5.98645 4.02612 1.02765 10
reco:pandora2calonosce:Calorimetry 2.50449 3.88344 5.73739 3.85978 0.987687 10
reco:pandora2pid:Chi2ParticleID 0.00569401 0.0072467 0.00918715 0.00726888 0.0010785 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0296676 0.0375358 0.0509834 0.0376161 0.00615702 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00544059 0.00707177 0.00907513 0.00713479 0.00107097 10
reco:pandora2Shower:LArPandoraShowerCreation 1.85587 2.72347 4.03353 2.70214 0.683708 10
reco:pandora2Showercalo:ShowerCalorimetry 2.272 3.50289 5.05683 3.52321 0.859061 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.0849 3.23623 4.66778 3.276 0.796564 10
[art]:TriggerResults:TriggerResultInserter 2.7542e-05 3.89735e-05 0.000100634 3.29455e-05 2.07345e-05 10
end_path:out1:RootOutput 8.192e-06 8.9987e-06 1.3441e-05 8.338e-06 1.54507e-06 10
end_path:out1:RootOutput(write) 1.48388 1.8387 2.54652 1.81217 0.302969 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5292.97 MB
Peak resident set size usage (VmHWM): 4475.01 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.92 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11150656
-rw-r--r-- 1 dunegli fnalgrid 2580603161 Dec 28 16:53 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2445867678 Dec 28 16:52 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2300624845 Dec 28 17:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2050191754 Dec 28 15:35 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1956938680 Dec 28 15:26 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 83418960 Dec 28 17:28 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242610 Dec 28 17:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 28 17:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 28 17:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 28 17:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 16:53 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 15:35 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 17:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 28 15:23 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 28 17:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:58 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:53 debugprod.log
