Jobsub ID 294535.1@dunegpschedd02.fnal.gov
| Jobsub ID | 294535.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12363 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-24 11:01:35 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-24 13:13:48 |
| From worker node | Hostname | dunegli-8418124-0-fnpc23041.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-24 11:02:24 |
| Input files | monte-carlo-012363-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7872s) |
| CPU time | 2h (7794s = 99%) |
| Max RSS bytes | 4346961920 (4145 MiB) |
| Outputting started | 2026-01-24 13:13:36 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12363/1/001/reco_stage1.root
|
| Finished | 2026-01-24 13:13:48 |
| Saved logs | justin-logs:294535.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
are: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 161157 traces, 0 summary
Retagger: tagging trace set: gauss with 122520 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 122520 traces tagged "gauss"
FrameSaver: q=4.35564e+06 n=2175125 tag=gauss
wclsFrameSaver: saving 161157 traces tagged "wiener"
FrameSaver: q=4.59997e+06 n=1922632 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 60858 XUs and 45747 XVs -> 1143 XUVs
C:0 T:1 144159 XUs and 136550 XVs -> 13989 XUVs
C:0 T:2 55981 XUs and 53033 XVs -> 2626 XUVs
C:0 T:3 29979 XUs and 25975 XVs -> 265 XUVs
C:0 T:4 12501 XUs and 12124 XVs -> 123 XUVs
C:0 T:5 41146 XUs and 33692 XVs -> 3455 XUVs
C:0 T:6 127081 XUs and 170699 XVs -> 8010 XUVs
C:0 T:7 48930 XUs and 50429 XVs -> 409 XUVs
C:0 T:8 13300 XUs and 10345 XVs -> 159 XUVs
C:0 T:9 83841 XUs and 84881 XVs -> 5406 XUVs
C:0 T:10 58215 XUs and 60068 XVs -> 6035 XUVs
C:0 T:11 333 XUs and 309 XVs -> 29 XUVs
41649 XUVs total
14354 collection wire objects
36713 potential space points
Neighbour search...
2387085 tests to find 1263668 neighbours
Iterating with no regularization...
Begin: 1.00891e+08
0 7.83032e+07
1 7.69969e+07
2 7.67984e+07
3 7.67352e+07
Now with regularization...
Begin: 6.36424e+07
0 6.3622e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411936129
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411936129
fLifetime: 30000 [us]
24-Jan-2026 13:13:35 UTC Closed output file "reco_stage1.root"
24-Jan-2026 13:13:35 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 146.06 221.348 272.089 235.518 42.4958 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000787048 0.00306789 0.00514219 0.00303572 0.00137796 10
reco:ophit:OpHitFinder 0.194608 0.217576 0.23395 0.221605 0.0127456 10
reco:opflash:OpFlashFinder 0.130716 0.154912 0.184805 0.150116 0.0173804 10
reco:opslicer:OpSlicer 0.364352 0.45233 0.481346 0.464583 0.0347254 10
reco:caldata:DataPrepModule 3.41866 3.56356 3.80218 3.55768 0.0998689 10
reco:wclsdatasp:WireCellToolkit 24.2672 25.4087 26.3782 25.4231 0.611963 10
reco:gaushit:GausHitFinder 0.597369 0.794933 0.976125 0.812554 0.117362 10
reco:nhitsfilter:NumberOfHitsFilter 0.000313292 0.000579554 0.000822014 0.000553597 0.000170434 10
reco:reco3d:SpacePointSolver 4.92733 11.5982 23.1305 11.2732 4.65982 10
reco:hitpdune:DisambigFromSpacePoints 0.566411 1.07987 1.51483 1.14274 0.304342 10
reco:pandora:StandardPandora 11.7993 22.3252 31.5256 24.1123 6.99949 10
reco:pandoraWriter:StandardPandora 0.21757 0.325156 0.405234 0.346503 0.0654266 10
reco:pandoraTrack:LArPandoraTrackCreation 1.08779 2.48851 3.1411 2.77392 0.686064 10
reco:pandoraShower:LArPandoraShowerCreation 1.0347 2.49683 3.81143 2.63121 0.857867 10
reco:pandoracalo:Calorimetry 0.679634 1.53229 1.92928 1.72316 0.432343 10
reco:pandoracalonosce:Calorimetry 0.590574 1.37872 1.75744 1.55483 0.400318 10
reco:pandorapid:Chi2ParticleID 0.00258551 0.00381812 0.00523409 0.00382538 0.000666059 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0244378 0.0348121 0.0455229 0.0347973 0.00625121 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00267434 0.00384374 0.00449103 0.00391795 0.000535743 10
reco:pandoraShowercalo:ShowerCalorimetry 1.0819 2.85395 4.43413 3.03641 1.06971 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.04206 2.7799 4.40009 2.96961 1.05056 10
reco:emtrkmichelid:EmTrackMichelId 81.1529 113.864 137.072 118.179 18.8389 10
reco:crttag:SingleCRTMatchingProducer 0.00527589 0.0106896 0.0139116 0.0118627 0.00272531 10
reco:crtreco:TwoCRTMatchingProducer 0.00353897 0.00559886 0.00815857 0.00568001 0.00120551 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.393509 0.617316 0.855427 0.591464 0.128588 10
reco:pandora2Track:LArPandoraTrackCreation 3.19981 7.75743 11.632 8.17871 2.66573 10
reco:pandora2calo:Calorimetry 1.67994 4.16708 5.976 4.44004 1.45314 10
reco:pandora2calonosce:Calorimetry 1.56451 3.92519 5.66794 4.15498 1.37759 10
reco:pandora2pid:Chi2ParticleID 0.00567531 0.00817776 0.00984967 0.00865413 0.00135345 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0276355 0.0428945 0.0530207 0.0437837 0.0086248 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00575306 0.00845106 0.0102745 0.00886419 0.00146443 10
reco:pandora2Shower:LArPandoraShowerCreation 1.23428 2.70696 3.81135 2.88643 0.842829 10
reco:pandora2Showercalo:ShowerCalorimetry 1.43467 3.489 4.91848 3.82882 1.16259 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.33535 3.13484 4.45179 3.384 1.01799 10
[art]:TriggerResults:TriggerResultInserter 3.1129e-05 5.20843e-05 0.000112713 4.7054e-05 2.11654e-05 10
end_path:out1:RootOutput 6.532e-06 1.02594e-05 1.4608e-05 9.863e-06 2.03031e-06 10
end_path:out1:RootOutput(write) 1.36988 1.98887 2.39888 2.03218 0.35887 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5163.68 MB
Peak resident set size usage (VmHWM): 4346.96 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10710088
-rw-r--r-- 1 dunegli fnalgrid 2482500811 Jan 24 12:35 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2356103797 Jan 24 12:34 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2175839877 Jan 24 13:13 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1976179272 Jan 24 11:14 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1899409307 Jan 24 11:05 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 76484670 Jan 24 13:10 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242979 Jan 24 13:13 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 24 13:13 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 24 13:13 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 24 13:13 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 24 12:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 24 11:14 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 24 13:13 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 24 11:02 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 24 13:13 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 24 12:39 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 24 12:35 debugprod.log
