Jobsub ID 265338.1@dunegpschedd02.fnal.gov
| Jobsub ID | 265338.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11451 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-31 23:20:29 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 01:13:31 |
| From worker node | Hostname | dunegli-8050361-0-fnpc22018.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-31 23:21:07 |
| Input files | monte-carlo-011451-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6732s) |
| CPU time | 1h (6645s = 98%) |
| Max RSS bytes | 3870715904 (3691 MiB) |
| Outputting started | 2026-01-01 01:13:20 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11451/1/001/reco_stage1.root
|
| Finished | 2026-01-01 01:13:31 |
| Saved logs | justin-logs:265338.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
vice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 122210 traces, 0 summary
Retagger: tagging trace set: gauss with 96969 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 96969 traces tagged "gauss"
FrameSaver: q=3.44648e+06 n=1803480 tag=gauss
wclsFrameSaver: saving 122210 traces tagged "wiener"
FrameSaver: q=3.61615e+06 n=1626632 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 29565 XUs and 21715 XVs -> 853 XUVs
C:0 T:1 56552 XUs and 44220 XVs -> 8897 XUVs
C:0 T:2 35962 XUs and 48549 XVs -> 1356 XUVs
C:0 T:3 23325 XUs and 23628 XVs -> 118 XUVs
C:0 T:4 18244 XUs and 14637 XVs -> 128 XUVs
C:0 T:5 70860 XUs and 50130 XVs -> 4270 XUVs
C:0 T:6 44597 XUs and 55191 XVs -> 1717 XUVs
C:0 T:7 21798 XUs and 26525 XVs -> 149 XUVs
C:0 T:8 12575 XUs and 11743 XVs -> 175 XUVs
C:0 T:9 92906 XUs and 102286 XVs -> 7218 XUVs
C:0 T:10 43698 XUs and 31631 XVs -> 4173 XUVs
C:0 T:11 88 XUs and 71 XVs -> 14 XUVs
29068 XUVs total
10826 collection wire objects
26621 potential space points
Neighbour search...
2341475 tests to find 1188708 neighbours
Iterating with no regularization...
Begin: 7.22227e+07
0 6.40286e+07
1 6.34394e+07
2 6.33529e+07
3 6.33323e+07
Now with regularization...
Begin: 5.36668e+07
0 5.36438e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411463623
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411463623
fLifetime: 30000 [us]
01-Jan-2026 01:13:19 UTC Closed output file "reco_stage1.root"
01-Jan-2026 01:13:19 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 149.697 192.869 242.524 193.782 28.2526 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000611686 0.00251708 0.00388609 0.00267321 0.000998442 10
reco:ophit:OpHitFinder 0.167565 0.189932 0.229708 0.183373 0.0181675 10
reco:opflash:OpFlashFinder 0.092526 0.111549 0.139964 0.108427 0.0178726 10
reco:opslicer:OpSlicer 0.337128 0.412283 0.513479 0.411519 0.0483549 10
reco:caldata:DataPrepModule 3.32026 3.4381 3.68852 3.42255 0.0982876 10
reco:wclsdatasp:WireCellToolkit 22.0452 23.0122 24.4314 22.9806 0.750692 10
reco:gaushit:GausHitFinder 0.607624 0.736683 0.851023 0.779965 0.0899355 10
reco:nhitsfilter:NumberOfHitsFilter 0.000251485 0.000328846 0.000499764 0.000312336 6.62438e-05 10
reco:reco3d:SpacePointSolver 4.26009 7.88828 13.6212 8.3636 2.63269 10
reco:hitpdune:DisambigFromSpacePoints 0.580056 0.938812 1.20266 0.993035 0.202942 10
reco:pandora:StandardPandora 11.5651 18.4291 26.4097 18.0335 4.76248 10
reco:pandoraWriter:StandardPandora 0.205969 0.247453 0.30144 0.25039 0.0322291 10
reco:pandoraTrack:LArPandoraTrackCreation 1.01808 1.64309 2.16764 1.58269 0.33403 10
reco:pandoraShower:LArPandoraShowerCreation 1.19527 1.98521 2.57872 2.06792 0.47908 10
reco:pandoracalo:Calorimetry 0.612222 1.03164 1.38759 1.01915 0.220444 10
reco:pandoracalonosce:Calorimetry 0.543055 0.9433 1.32626 0.924243 0.220065 10
reco:pandorapid:Chi2ParticleID 0.00250357 0.00299654 0.00380331 0.00278934 0.000436505 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0231818 0.0308329 0.0374912 0.0309275 0.004236 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00237345 0.00283154 0.0043571 0.00263809 0.000553718 10
reco:pandoraShowercalo:ShowerCalorimetry 1.22596 2.29752 3.29954 2.44405 0.673837 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.1718 2.22703 3.10802 2.37717 0.649923 10
reco:emtrkmichelid:EmTrackMichelId 82.1043 105.403 129.652 105.905 14.0231 10
reco:crttag:SingleCRTMatchingProducer 0.00493313 0.0073914 0.00989239 0.00707928 0.00137681 10
reco:crtreco:TwoCRTMatchingProducer 0.00314614 0.00454913 0.00553705 0.0045764 0.000727077 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.399206 0.541263 0.669975 0.537247 0.090486 10
reco:pandora2Track:LArPandoraTrackCreation 3.29139 5.68565 7.62222 5.77471 1.39818 10
reco:pandora2calo:Calorimetry 1.69495 3.14508 4.26009 3.28991 0.825918 10
reco:pandora2calonosce:Calorimetry 1.60089 3.00402 4.08379 3.13982 0.800778 10
reco:pandora2pid:Chi2ParticleID 0.00585791 0.00713863 0.00871131 0.00703301 0.000869908 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0305728 0.038228 0.044544 0.0390621 0.0044545 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00563089 0.00705757 0.00894037 0.0069676 0.000913588 10
reco:pandora2Shower:LArPandoraShowerCreation 1.26492 2.17953 2.94625 2.17741 0.502544 10
reco:pandora2Showercalo:ShowerCalorimetry 1.4936 2.8141 3.80067 2.90304 0.742133 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.34241 2.63439 3.60938 2.69502 0.697314 10
[art]:TriggerResults:TriggerResultInserter 3.0368e-05 4.33178e-05 0.000106491 3.48055e-05 2.15419e-05 10
end_path:out1:RootOutput 7.213e-06 8.2084e-06 1.2394e-05 7.7395e-06 1.4203e-06 10
end_path:out1:RootOutput(write) 1.27732 1.77219 2.20074 1.75117 0.263622 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4682.38 MB
Peak resident set size usage (VmHWM): 3870.72 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9164040
-rw-r--r-- 1 dunegli fnalgrid 2192935960 Jan 1 00:40 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2081871114 Jan 1 00:38 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1866467374 Jan 1 01:13 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1613760602 Dec 31 23:30 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1556268767 Dec 31 23:24 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 71854770 Jan 1 01:10 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242894 Jan 1 01:13 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 01:13 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 01:13 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 01:13 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 00:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 31 23:30 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 01:13 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 31 23:21 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 01:13 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 00:43 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 00:40 debugprod.log
