Jobsub ID 302523.1@dunegpschedd01.fnal.gov
| Jobsub ID | 302523.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12604 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-30 21:51:34 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-30 23:40:46 |
| From worker node | Hostname | dunegli-8333731-0-fnpc23050.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-30 21:52:41 |
| Input files | monte-carlo-012604-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6473s) |
| CPU time | 1h (6407s = 98%) |
| Max RSS bytes | 4032454656 (3845 MiB) |
| Outputting started | 2026-01-30 23:40:35 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12604/1/001/reco_stage1.root
|
| Finished | 2026-01-30 23:40:46 |
| Saved logs | justin-logs:302523.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ol adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 151054 traces, 0 summary
Retagger: tagging trace set: gauss with 116334 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 116334 traces tagged "gauss"
FrameSaver: q=4.16888e+06 n=2066974 tag=gauss
wclsFrameSaver: saving 151054 traces tagged "wiener"
FrameSaver: q=4.40232e+06 n=1841676 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39694 XUs and 36834 XVs -> 794 XUVs
C:0 T:1 90627 XUs and 84202 XVs -> 6304 XUVs
C:0 T:2 32881 XUs and 30081 XVs -> 2320 XUVs
C:0 T:3 15470 XUs and 13642 XVs -> 75 XUVs
C:0 T:4 11238 XUs and 12316 XVs -> 78 XUVs
C:0 T:5 41607 XUs and 36651 XVs -> 3109 XUVs
C:0 T:6 142792 XUs and 156305 XVs -> 6287 XUVs
C:0 T:7 61146 XUs and 60236 XVs -> 615 XUVs
C:0 T:8 10596 XUs and 13524 XVs -> 143 XUVs
C:0 T:9 63684 XUs and 95158 XVs -> 6871 XUVs
C:0 T:10 63532 XUs and 48360 XVs -> 6007 XUVs
C:0 T:11 677 XUs and 511 XVs -> 61 XUVs
32664 XUVs total
12534 collection wire objects
29736 potential space points
Neighbour search...
1167178 tests to find 644752 neighbours
Iterating with no regularization...
Begin: 9.24175e+07
0 7.8001e+07
1 7.68959e+07
2 7.6754e+07
3 7.67173e+07
Now with regularization...
Begin: 6.36363e+07
0 6.36381e+07
Warning: metric increased
run: 1 ; subrun: 0 ; event: 10
evttime: 412065891
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412065891
fLifetime: 30000 [us]
30-Jan-2026 23:40:34 UTC Closed output file "reco_stage1.root"
30-Jan-2026 23:40:34 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 107.218 176.968 250.906 167.989 43.0386 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000583004 0.00253721 0.00395512 0.00287488 0.00105969 10
reco:ophit:OpHitFinder 0.147167 0.186034 0.257753 0.1759 0.031639 10
reco:opflash:OpFlashFinder 0.0693724 0.11203 0.185038 0.10212 0.0343 10
reco:opslicer:OpSlicer 0.252245 0.405443 0.594541 0.383631 0.102597 10
reco:caldata:DataPrepModule 3.21405 3.35946 3.6457 3.32911 0.117514 10
reco:wclsdatasp:WireCellToolkit 21.1284 21.94 22.9636 21.9133 0.593827 10
reco:gaushit:GausHitFinder 0.380661 0.655798 0.875222 0.636518 0.141125 10
reco:nhitsfilter:NumberOfHitsFilter 0.000176116 0.000279393 0.000443258 0.000262622 6.9238e-05 10
reco:reco3d:SpacePointSolver 3.86963 7.24601 12.9182 6.08009 2.9002 10
reco:hitpdune:DisambigFromSpacePoints 0.344698 0.809147 1.34297 0.704779 0.303237 10
reco:pandora:StandardPandora 4.4501 15.0998 27.8436 14.477 6.54183 10
reco:pandoraWriter:StandardPandora 0.126174 0.215578 0.313847 0.203326 0.0521632 10
reco:pandoraTrack:LArPandoraTrackCreation 0.923778 1.60436 2.59145 1.40177 0.518256 10
reco:pandoraShower:LArPandoraShowerCreation 0.567851 1.90398 3.50279 1.76963 0.917505 10
reco:pandoracalo:Calorimetry 0.537276 0.974802 1.55056 0.879042 0.325375 10
reco:pandoracalonosce:Calorimetry 0.491031 0.894476 1.44702 0.799505 0.305512 10
reco:pandorapid:Chi2ParticleID 0.00232264 0.00296738 0.00449479 0.00275292 0.00062052 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0181376 0.0282261 0.0366228 0.0267622 0.00570003 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00220546 0.00268535 0.00335214 0.00261054 0.00033059 10
reco:pandoraShowercalo:ShowerCalorimetry 0.601483 2.15762 4.07003 1.96727 1.11 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.593354 2.10369 3.95524 1.90464 1.09008 10
reco:emtrkmichelid:EmTrackMichelId 60.9688 96.5911 128.572 93.3206 20.1165 10
reco:crttag:SingleCRTMatchingProducer 0.00499765 0.00809932 0.0136615 0.00797023 0.00272815 10
reco:crtreco:TwoCRTMatchingProducer 0.00272113 0.00412217 0.00569616 0.00376333 0.000985746 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.359089 0.497528 0.632748 0.473766 0.0813753 10
reco:pandora2Track:LArPandoraTrackCreation 2.02215 5.45162 9.4667 4.89948 2.40631 10
reco:pandora2calo:Calorimetry 1.08673 2.9708 5.15691 2.64251 1.35471 10
reco:pandora2calonosce:Calorimetry 1.03388 2.83997 4.93255 2.51014 1.30529 10
reco:pandora2pid:Chi2ParticleID 0.00438461 0.00707288 0.00975099 0.00679431 0.00159689 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0199405 0.0341771 0.0471839 0.0330523 0.00782739 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00425331 0.00687678 0.00942809 0.00663258 0.00154953 10
reco:pandora2Shower:LArPandoraShowerCreation 0.828615 2.0749 3.52523 1.84616 0.872165 10
reco:pandora2Showercalo:ShowerCalorimetry 0.979768 2.65118 4.65668 2.32112 1.22315 10
reco:pandora2Showercalonosce:ShowerCalorimetry 0.924644 2.46358 4.33976 2.17268 1.13705 10
[art]:TriggerResults:TriggerResultInserter 2.8284e-05 4.03693e-05 0.000100262 3.2552e-05 2.03548e-05 10
end_path:out1:RootOutput 5.671e-06 8.8241e-06 1.3306e-05 8.8375e-06 2.08559e-06 10
end_path:out1:RootOutput(write) 1.01111 1.61573 2.27023 1.5524 0.367989 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4845.73 MB
Peak resident set size usage (VmHWM): 4032.45 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9332404
-rw-r--r-- 1 dunegli fnalgrid 2226126567 Jan 30 23:10 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2115096790 Jan 30 23:08 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1879267362 Jan 30 23:40 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1675489497 Jan 30 22:02 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1592955871 Jan 30 21:55 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 66823920 Jan 30 23:37 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242651 Jan 30 23:40 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 30 23:40 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 30 23:40 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 30 23:40 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 23:10 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 22:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 23:40 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 30 21:52 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 30 23:40 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 30 23:13 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 30 23:10 debugprod.log
