justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 237051.1@dunegpschedd01.fnal.gov

Jobsub ID237051.1@dunegpschedd01.fnal.gov
Workflow ID9229
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-21 06:52:49
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-10-21 10:53:01
From worker nodeHostnameheplnc147.pp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-21 06:53:26
Input filesmonte-carlo-009229-000001
JobscriptExit code0
Real time3h (14287s)
CPU time3h (13749s = 96%)
Max RSS bytes4513710080 (4304 MiB)
Outputting started2025-10-21 10:51:33
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09229/1/001/reco_stage1.root
Finished2025-10-21 10:53:01
Saved logsjustin-logs:237051.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ot 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 151915 traces, 0 summary
Retagger: tagging trace set: gauss with 120524 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 120524 traces tagged "gauss"
FrameSaver: q=4.30172e+06 n=2224805 tag=gauss
wclsFrameSaver: saving 151915 traces tagged "wiener"
FrameSaver: q=4.55829e+06 n=2001079 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39431 XUs and 41918 XVs -> 431 XUVs
C:0 T:1 86479 XUs and 87988 XVs -> 4974 XUVs
C:0 T:2 111568 XUs and 139768 XVs -> 5509 XUVs
C:0 T:3 55157 XUs and 56339 XVs -> 410 XUVs
C:0 T:4 14392 XUs and 16750 XVs -> 147 XUVs
C:0 T:5 59358 XUs and 56750 XVs -> 4743 XUVs
C:0 T:6 204283 XUs and 254322 XVs -> 15500 XUVs
C:0 T:7 57512 XUs and 75233 XVs -> 1120 XUVs
C:0 T:8 8874 XUs and 11027 XVs -> 99 XUVs
C:0 T:9 49181 XUs and 75068 XVs -> 4388 XUVs
C:0 T:10 31033 XUs and 17524 XVs -> 2205 XUVs
C:0 T:11 140 XUs and 102 XVs -> 14 XUVs
39540 XUVs total
14539 collection wire objects
34723 potential space points
Neighbour search...
2389227 tests to find 802452 neighbours
Iterating with no regularization...
Begin: 1.22683e+08
0 8.69307e+07
1 8.39043e+07
2 8.33986e+07
3 8.32576e+07
4 8.32008e+07
Now with regularization...
Begin: 6.81498e+07
0 6.79698e+07
1 6.78866e+07
2 6.78373e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410021496
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410021496
fLifetime: 30000 [us]
21-Oct-2025 11:51:31 BST  Closed output file "reco_stage1.root"
21-Oct-2025 11:51:31 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          416.667       499.05        606.889       490.828       59.2557        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00153482    0.00412718    0.00568823    0.00447198     0.0012813       10     
reco:ophit:OpHitFinder                             0.267388      0.336804      0.423585      0.330328      0.0526069       10     
reco:opflash:OpFlashFinder                         0.165406      0.210022       0.26898      0.203576      0.0318857       10     
reco:opslicer:OpSlicer                             0.705963      0.819379       1.20381      0.749168      0.154897        10     
reco:caldata:DataPrepModule                         4.75778       5.97628       7.33532       5.84452       0.91222        10     
reco:wclsdatasp:WireCellToolkit                     37.858        41.1582       50.2254       40.1878       3.44004        10     
reco:gaushit:GausHitFinder                          1.13636       1.5577        2.05603       1.52091      0.267881        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000713887   0.00109044    0.00152169    0.00109372    0.000233529      10     
reco:reco3d:SpacePointSolver                        10.8823       19.1214       30.1902       18.7014       4.87599        10     
reco:hitpdune:DisambigFromSpacePoints               1.32605       2.09372       2.80869       2.18021      0.458646        10     
reco:pandora:StandardPandora                        32.2824       56.5391       110.619       45.0395       25.0928        10     
reco:pandoraWriter:StandardPandora                 0.500495      0.594275      0.715252      0.592089      0.0796945       10     
reco:pandoraTrack:LArPandoraTrackCreation           4.78391       8.0993        11.5377       7.46918       2.05825        10     
reco:pandoraShower:LArPandoraShowerCreation         6.11933       8.71669       11.939        8.40899       2.07092        10     
reco:pandoracalo:Calorimetry                        2.72354       3.93719       5.52955       4.2198       0.861719        10     
reco:pandoracalonosce:Calorimetry                   2.63735       3.63216       5.12775       3.49921       0.7811         10     
reco:pandorapid:Chi2ParticleID                    0.00525798    0.00657085     0.0094979    0.00608666    0.00120623       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0507701     0.0585334     0.0649123     0.0593037    0.00506613       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00530309    0.00626901    0.00775926    0.00608043    0.000707159      10     
reco:pandoraShowercalo:ShowerCalorimetry            4.80552       8.50103       12.3132       8.48301       2.12366        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       5.31975       8.08062       10.5848       7.67409       1.84397        10     
reco:emtrkmichelid:EmTrackMichelId                  207.202       248.543       289.349       248.042       23.5408        10     
reco:crttag:SingleCRTMatchingProducer              0.012775      0.0254248     0.0360492     0.0251124    0.00763677       10     
reco:crtreco:TwoCRTMatchingProducer               0.00928428     0.0186654     0.0309552     0.0181529    0.00700787       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.817709       1.05622       1.38354       1.05601      0.185247        10     
reco:pandora2Track:LArPandoraTrackCreation          15.9269       25.8594       38.8243       26.0137       7.17246        10     
reco:pandora2calo:Calorimetry                       5.40702       12.604        16.0148       14.145        3.44564        10     
reco:pandora2calonosce:Calorimetry                  5.28235       12.0307       17.6942       12.6689       3.64971        10     
reco:pandora2pid:Chi2ParticleID                    0.0140928     0.0178045     0.0256556     0.0160527    0.00388464       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0632136     0.0821147     0.121339      0.0789211     0.0162809       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.013305      0.0168153     0.0233332     0.0157065    0.00298318       10     
reco:pandora2Shower:LArPandoraShowerCreation        5.64656       8.84322       10.8645       9.09991       1.52866        10     
reco:pandora2Showercalo:ShowerCalorimetry           6.14384       9.27638       13.5361       9.23498       2.45244        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.96891       7.36728       10.3156       6.98924       1.65917        10     
[art]:TriggerResults:TriggerResultInserter        4.8402e-05    6.80406e-05   0.000183877   5.47935e-05   3.88378e-05      10     
end_path:out1:RootOutput                           9.538e-06    1.11018e-05   1.8394e-05    1.02445e-05   2.50743e-06      10     
end_path:out1:RootOutput(write)                     2.91754       3.64668       4.71142       3.46246      0.642906        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5333.24 MB
  Peak resident set size usage (VmHWM): 4513.71 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.26 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.74 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11201660
-rw-r--r-- 1 pltdune04 pltdune 2604856665 Oct 21 10:25 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2473997166 Oct 21 10:22 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2330468020 Oct 21 11:51 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2039085962 Oct 21 08:16 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1936552177 Oct 21 08:01 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   84908910 Oct 21 11:44 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243031 Oct 21 11:51 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Oct 21 11:51 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Oct 21 11:51 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Oct 21 11:51 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 21 10:25 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 21 08:16 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 21 11:51 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Oct 21 07:53 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Oct 21 11:51 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 21 10:34 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 21 10:25 debugprod.log
justIN time: 2025-11-03 18:41:12 UTC       justIN version: 01.05.01