Jobsub ID 265519.0@dunegpschedd02.fnal.gov
| Jobsub ID | 265519.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11469 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-02 09:24:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-02 12:01:05 |
| From worker node | Hostname | dunegli-8219947-0-fnpc23031.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-02 09:50:54 |
| Input files | monte-carlo-011469-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7798s) |
| CPU time | 2h (7726s = 99%) |
| Max RSS bytes | 4281192448 (4082 MiB) |
| Outputting started | 2026-01-02 12:00:53 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11469/1/001/reco_stage1.root
|
| Finished | 2026-01-02 12:01:05 |
| Saved logs | justin-logs:265519.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
pService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 125687 traces, 0 summary
Retagger: tagging trace set: gauss with 98510 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98510 traces tagged "gauss"
FrameSaver: q=3.49736e+06 n=1758339 tag=gauss
wclsFrameSaver: saving 125687 traces tagged "wiener"
FrameSaver: q=3.6787e+06 n=1568797 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 29105 XUs and 30041 XVs -> 288 XUVs
C:0 T:1 59087 XUs and 55365 XVs -> 4022 XUVs
C:0 T:2 104503 XUs and 119991 XVs -> 5121 XUVs
C:0 T:3 51280 XUs and 48570 XVs -> 339 XUVs
C:0 T:4 9060 XUs and 13393 XVs -> 66 XUVs
C:0 T:5 29044 XUs and 29504 XVs -> 2451 XUVs
C:0 T:6 94507 XUs and 105394 XVs -> 4598 XUVs
C:0 T:7 40553 XUs and 44715 XVs -> 312 XUVs
C:0 T:8 4793 XUs and 4034 XVs -> 54 XUVs
C:0 T:9 24032 XUs and 27983 XVs -> 1608 XUVs
C:0 T:10 48076 XUs and 40139 XVs -> 4662 XUVs
C:0 T:11 494 XUs and 397 XVs -> 49 XUVs
23570 XUVs total
10491 collection wire objects
21699 potential space points
Neighbour search...
677845 tests to find 373488 neighbours
Iterating with no regularization...
Begin: 6.88108e+07
0 5.9582e+07
1 5.88837e+07
2 5.87872e+07
3 5.87607e+07
Now with regularization...
Begin: 4.83409e+07
0 4.83324e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411492000
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411492000
fLifetime: 30000 [us]
02-Jan-2026 12:00:52 UTC Closed output file "reco_stage1.root"
02-Jan-2026 12:00:52 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 188.301 229.311 263.547 234.359 25.1292 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000661346 0.00262872 0.00366606 0.00298962 0.00101655 10
reco:ophit:OpHitFinder 0.163326 0.211223 0.233526 0.215217 0.0176269 10
reco:opflash:OpFlashFinder 0.0901765 0.142345 0.172611 0.146318 0.020543 10
reco:opslicer:OpSlicer 0.342354 0.477079 0.555904 0.487715 0.057261 10
reco:caldata:DataPrepModule 3.42468 3.47782 3.63901 3.46003 0.0599652 10
reco:wclsdatasp:WireCellToolkit 22.1219 23.4339 24.5888 23.6269 0.722911 10
reco:gaushit:GausHitFinder 0.648041 0.82054 0.952917 0.839479 0.102025 10
reco:nhitsfilter:NumberOfHitsFilter 0.000242314 0.000333033 0.000401168 0.000334916 4.86478e-05 10
reco:reco3d:SpacePointSolver 6.33999 10.9483 15.9894 10.8261 2.92858 10
reco:hitpdune:DisambigFromSpacePoints 0.819967 1.20491 1.48542 1.27222 0.211442 10
reco:pandora:StandardPandora 15.6987 24.3092 29.7749 25.0051 4.45645 10
reco:pandoraWriter:StandardPandora 0.218721 0.283108 0.331141 0.291952 0.0348439 10
reco:pandoraTrack:LArPandoraTrackCreation 1.63172 2.36289 2.97953 2.317 0.426494 10
reco:pandoraShower:LArPandoraShowerCreation 2.14885 2.92649 3.72627 2.95344 0.50066 10
reco:pandoracalo:Calorimetry 1.01678 1.42843 1.74456 1.4441 0.209649 10
reco:pandoracalonosce:Calorimetry 0.934541 1.3225 1.61252 1.34586 0.194776 10
reco:pandorapid:Chi2ParticleID 0.00286559 0.00355587 0.00476579 0.00343366 0.000506516 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0276965 0.0335728 0.0379143 0.0351952 0.00356431 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00279354 0.00325765 0.00387635 0.003221 0.000329611 10
reco:pandoraShowercalo:ShowerCalorimetry 2.54022 3.34719 4.2265 3.35943 0.560649 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.48557 3.28799 4.13514 3.41646 0.555184 10
reco:emtrkmichelid:EmTrackMichelId 96.8182 118.372 132.642 121.128 11.6584 10
reco:crttag:SingleCRTMatchingProducer 0.00648509 0.00883811 0.0106815 0.00915679 0.00122464 10
reco:crtreco:TwoCRTMatchingProducer 0.0040873 0.00527923 0.00603568 0.00548405 0.000611892 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.491068 0.664133 0.828234 0.714254 0.10394 10
reco:pandora2Track:LArPandoraTrackCreation 6.30458 8.41397 11.7589 8.27977 1.64966 10
reco:pandora2calo:Calorimetry 3.56398 4.61934 5.90288 4.58434 0.77955 10
reco:pandora2calonosce:Calorimetry 3.40945 4.37232 5.53881 4.39045 0.7224 10
reco:pandora2pid:Chi2ParticleID 0.00739537 0.00877596 0.0102166 0.00888698 0.000770467 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0356793 0.0433272 0.0502285 0.0443793 0.00461552 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00705799 0.00861445 0.0100623 0.00855061 0.00083535 10
reco:pandora2Shower:LArPandoraShowerCreation 2.38718 3.00794 3.81444 3.00345 0.464955 10
reco:pandora2Showercalo:ShowerCalorimetry 3.19753 4.00322 5.03355 3.93086 0.631053 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.90695 3.66432 4.63575 3.52531 0.593719 10
[art]:TriggerResults:TriggerResultInserter 3.0258e-05 4.04513e-05 9.8228e-05 3.3258e-05 1.93743e-05 10
end_path:out1:RootOutput 7.635e-06 9.1757e-06 1.3867e-05 8.6715e-06 1.65725e-06 10
end_path:out1:RootOutput(write) 1.58325 2.0235 2.33677 2.08782 0.244485 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5094.23 MB
Peak resident set size usage (VmHWM): 4281.19 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10640936
-rw-r--r-- 1 dunegli fnalgrid 2479705546 Jan 2 11:21 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2354413877 Jan 2 11:20 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2192154304 Jan 2 12:00 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1927732149 Jan 2 10:02 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1860238210 Jan 2 09:54 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 81388140 Jan 2 11:58 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243893 Jan 2 12:00 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 2 12:00 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 2 12:00 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 2 12:00 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 11:21 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 10:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 12:00 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 2 09:50 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 2 12:00 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 2 11:25 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 2 11:21 debugprod.log
