justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262447.0@dunegpschedd02.fnal.gov

Jobsub ID262447.0@dunegpschedd02.fnal.gov
Workflow ID11217
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-14 09:55:43
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-12-14 14:09:57
From worker nodeHostnameheplnc153.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-14 09:56:43
Input filesmonte-carlo-011217-000001
JobscriptExit code0
Real time4h (14961s)
CPU time3h (14269s = 95%)
Max RSS bytes4371070976 (4168 MiB)
Outputting started2025-12-14 14:06:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11217/1/001/reco_stage1.root
Finished2025-12-14 14:09:57
Saved logsjustin-logs:262447.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

dsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128801 traces, 0 summary
Retagger: tagging trace set: gauss with 101174 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 101174 traces tagged "gauss"
FrameSaver: q=3.39051e+06 n=1863156 tag=gauss
wclsFrameSaver: saving 128801 traces tagged "wiener"
FrameSaver: q=3.58063e+06 n=1677684 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39006 XUs and 31030 XVs -> 566 XUVs
C:0 T:1 81801 XUs and 76034 XVs -> 9752 XUVs
C:0 T:2 128432 XUs and 124971 XVs -> 8309 XUVs
C:0 T:3 59450 XUs and 53249 XVs -> 439 XUVs
C:0 T:4 10283 XUs and 11445 XVs -> 63 XUVs
C:0 T:5 46872 XUs and 34791 XVs -> 3850 XUVs
C:0 T:6 62017 XUs and 71127 XVs -> 2114 XUVs
C:0 T:7 26728 XUs and 31185 XVs -> 90 XUVs
C:0 T:8 11218 XUs and 13305 XVs -> 237 XUVs
C:0 T:9 74388 XUs and 98850 XVs -> 6767 XUVs
C:0 T:10 32915 XUs and 18792 XVs -> 2412 XUVs
C:0 T:11 398 XUs and 261 XVs -> 40 XUVs
34639 XUVs total
11412 collection wire objects
32251 potential space points
Neighbour search...
3046469 tests to find 1533900 neighbours
Iterating with no regularization...
Begin: 6.46314e+07
0 5.40946e+07
1 5.34064e+07
2 5.33172e+07
3 5.32929e+07
Now with regularization...
Begin: 4.5177e+07
0 4.51519e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411110241
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411110241
fLifetime: 30000 [us]
14-Dec-2025 14:06:02 GMT  Closed output file "reco_stage1.root"
14-Dec-2025 14:06:02 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          297.082       454.218       626.949       466.592       94.2121        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00125423    0.00403236    0.00737181     0.0040876    0.00168882       10     
reco:ophit:OpHitFinder                             0.315673      0.379288      0.471078      0.368346      0.0477909       10     
reco:opflash:OpFlashFinder                         0.170938      0.226351      0.291058      0.215619      0.0377471       10     
reco:opslicer:OpSlicer                             0.672497      0.887151       1.15169      0.873576      0.133212        10     
reco:caldata:DataPrepModule                         6.19204       7.18992       7.89324       7.30201      0.583338        10     
reco:wclsdatasp:WireCellToolkit                     35.7547       41.0783        44.48        41.7531       2.52224        10     
reco:gaushit:GausHitFinder                         0.819904       1.62802       2.17108       1.73839      0.422989        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000393607   0.000861232   0.00259106    0.000779845   0.000614423      10     
reco:reco3d:SpacePointSolver                        7.71726       22.8894       31.9979       23.5051       6.74762        10     
reco:hitpdune:DisambigFromSpacePoints               1.43309       2.41392       3.8586        2.28781      0.859746        10     
reco:pandora:StandardPandora                        23.0267       44.7835       83.0745       37.932        18.3091        10     
reco:pandoraWriter:StandardPandora                 0.296866      0.655213      0.927653       0.69356      0.160512        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.31951       6.02648       9.15501       6.34678       1.86505        10     
reco:pandoraShower:LArPandoraShowerCreation         1.85275       6.16459       11.304        6.32314       2.41456        10     
reco:pandoracalo:Calorimetry                        1.26947       3.31157       4.94951       3.66534       1.07533        10     
reco:pandoracalonosce:Calorimetry                   1.21946       3.04544       4.64814       3.2566       0.969527        10     
reco:pandorapid:Chi2ParticleID                    0.00549849    0.00891393     0.0128721    0.00884942     0.0020671       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0603454     0.0843615     0.137394      0.0827952     0.022341        10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00450787    0.00775169     0.0101043    0.00781579    0.00160642       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.70699       6.09928       9.38905       6.24671       1.76479        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.3603        5.75762       8.91994       5.76118       1.73838        10     
reco:emtrkmichelid:EmTrackMichelId                  173.19        242.979       323.662       249.254       44.8745        10     
reco:crttag:SingleCRTMatchingProducer             0.00985776     0.0220045     0.0302813     0.0230316    0.00691703       10     
reco:crtreco:TwoCRTMatchingProducer                0.0069726     0.0130137     0.0181989     0.0125406     0.0036238       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.622097       1.15556       1.67909       1.07569      0.304173        10     
reco:pandora2Track:LArPandoraTrackCreation          7.86323       18.2989       32.9669       17.706        7.00516        10     
reco:pandora2calo:Calorimetry                       3.89594       8.38277       11.9436       8.44273       2.69368        10     
reco:pandora2calonosce:Calorimetry                  3.68157       7.88817       12.2825       7.91169       2.94053        10     
reco:pandora2pid:Chi2ParticleID                    0.010954      0.0190124     0.0279543     0.0185627    0.00536583       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0630614     0.0978359     0.143078      0.0995107     0.0247887       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.011329      0.0187893     0.0265659     0.0187982    0.00488278       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.05745       5.72653       7.34478       5.88154       1.46668        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.45437       6.73695       10.1323       6.23096       2.00215        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.10363       6.40021       9.66708       6.40471       2.0775         10     
[art]:TriggerResults:TriggerResultInserter        5.2288e-05    9.82389e-05   0.000234129   8.3336e-05    4.99176e-05      10     
end_path:out1:RootOutput                           7.394e-06    1.31026e-05   2.0368e-05    1.2213e-05    3.78207e-06      10     
end_path:out1:RootOutput(write)                     2.57541       3.68634       5.02308       3.62021      0.791298        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5242.58 MB
  Peak resident set size usage (VmHWM): 4371.07 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.32 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.52 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.19 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10809608
-rw-r--r-- 1 pltdune04 pltdune 2501674676 Dec 14 12:48 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2373658301 Dec 14 12:45 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2210933735 Dec 14 14:06 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1992232977 Dec 14 10:21 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1909618372 Dec 14 10:05 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   80237870 Dec 14 13:59 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243724 Dec 14 14:06 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Dec 14 14:06 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Dec 14 14:06 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Dec 14 14:06 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 14 12:48 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 14 10:21 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 14 14:06 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Dec 14 09:56 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Dec 14 14:06 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 14 12:56 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 14 12:48 debugprod.log
justIN time: 2025-12-18 20:21:59 UTC       justIN version: 01.05.03