justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232832.0@dunegpschedd02.fnal.gov

Jobsub ID232832.0@dunegpschedd02.fnal.gov
Workflow ID9332
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-25 07:27:02
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-10-25 11:54:29
From worker nodeHostnameheplnc164.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-25 07:28:45
Input filesmonte-carlo-009332-000001
JobscriptExit code0
Real time4h (15842s)
CPU time4h (15190s = 95%)
Max RSS bytes4385136640 (4181 MiB)
Outputting started2025-10-25 11:52:48
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09332/1/001/reco_stage1.root
Finished2025-10-25 11:54:29
Saved logsjustin-logs:232832.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

adChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 118829 traces, 0 summary
Retagger: tagging trace set: gauss with 91959 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91959 traces tagged "gauss"
FrameSaver: q=3.17716e+06 n=1691088 tag=gauss
wclsFrameSaver: saving 118829 traces tagged "wiener"
FrameSaver: q=3.37393e+06 n=1522719 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 26593 XUs and 24413 XVs -> 285 XUVs
C:0 T:1 40908 XUs and 34582 XVs -> 4885 XUVs
C:0 T:2 98967 XUs and 71563 XVs -> 5849 XUVs
C:0 T:3 45478 XUs and 29523 XVs -> 277 XUVs
C:0 T:4 11514 XUs and 10380 XVs -> 88 XUVs
C:0 T:5 50097 XUs and 30061 XVs -> 5956 XUVs
C:0 T:6 82130 XUs and 80048 XVs -> 2758 XUVs
C:0 T:7 39964 XUs and 36327 XVs -> 262 XUVs
C:0 T:8 11880 XUs and 11016 XVs -> 150 XUVs
C:0 T:9 87861 XUs and 95465 XVs -> 6398 XUVs
C:0 T:10 51855 XUs and 52096 XVs -> 8818 XUVs
C:0 T:11 466 XUs and 397 XVs -> 76 XUVs
35802 XUVs total
10773 collection wire objects
33676 potential space points
Neighbour search...
3614802 tests to find 1896520 neighbours
Iterating with no regularization...
Begin: 5.67933e+07
0 4.88055e+07
1 4.82953e+07
2 4.82144e+07
3 4.81875e+07
Now with regularization...
Begin: 3.98938e+07
0 3.9848e+07
1 3.98167e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410102338
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410102338
fLifetime: 30000 [us]
25-Oct-2025 12:52:46 BST  Closed output file "reco_stage1.root"
25-Oct-2025 12:52:46 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          333.593       506.183       664.85        484.88        99.0422        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00156071     0.0052542     0.0114256    0.00525695    0.00296989       10     
reco:ophit:OpHitFinder                             0.290927      0.403828      0.509147      0.407662      0.058129        10     
reco:opflash:OpFlashFinder                         0.189455      0.234143      0.297653      0.228449      0.0340016       10     
reco:opslicer:OpSlicer                             0.822236       1.00527       1.28943      0.996269       0.11315        10     
reco:caldata:DataPrepModule                         7.33233       7.76572       8.17173       7.7209       0.232633        10     
reco:wclsdatasp:WireCellToolkit                     38.0031       42.9792       47.7822       42.9128       2.77586        10     
reco:gaushit:GausHitFinder                          1.4438        1.84899       2.19154       1.84237      0.213431        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000559202   0.000826631   0.00147229    0.00075512    0.000255661      10     
reco:reco3d:SpacePointSolver                        13.8192       28.396        39.2356       29.3575       8.19403        10     
reco:hitpdune:DisambigFromSpacePoints               1.43969       2.46603       3.6343        2.45216      0.661724        10     
reco:pandora:StandardPandora                        25.6791       71.3688       170.628       54.4946       42.2759        10     
reco:pandoraWriter:StandardPandora                 0.417721      0.639657      0.953505      0.669047      0.159775        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.61973       6.30571       9.89867       5.66739       2.01763        10     
reco:pandoraShower:LArPandoraShowerCreation         2.83697       6.44189       10.5026       5.85578       2.30211        10     
reco:pandoracalo:Calorimetry                        2.10418       3.57243       5.28181       3.40719       0.93427        10     
reco:pandoracalonosce:Calorimetry                   1.8346        3.18584       4.57593       3.13556      0.802299        10     
reco:pandorapid:Chi2ParticleID                    0.00510032    0.00828182     0.0111761     0.0085089    0.00168925       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0466263     0.0816192     0.0997051     0.0868207     0.0156036       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00527365    0.00797382     0.0107479    0.00816995    0.00171968       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.76823       6.89248       10.7464       6.45495       2.28242        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.71574       6.78875       11.0036       6.48151       2.20188        10     
reco:emtrkmichelid:EmTrackMichelId                  188.382       243.975       297.139       242.82        26.5847        10     
reco:crttag:SingleCRTMatchingProducer              0.0128965     0.0244182     0.0444266     0.0227453    0.00829073       10     
reco:crtreco:TwoCRTMatchingProducer               0.00795797     0.0155505     0.0369671     0.0133996    0.00757096       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.945056       1.12058       1.37835       1.07874      0.129944        10     
reco:pandora2Track:LArPandoraTrackCreation          9.27495       20.2286       28.8883       19.6813       6.01933        10     
reco:pandora2calo:Calorimetry                       4.53229       11.4833       18.4315       11.8466       4.15499        10     
reco:pandora2calonosce:Calorimetry                  4.12013       10.9929       19.0568       10.0782       4.23923        10     
reco:pandora2pid:Chi2ParticleID                     0.01572      0.0234766     0.0305735     0.0225856    0.00465859       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0789414     0.114527      0.140932       0.11421      0.0163367       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0161788     0.0227494     0.0293102     0.0223141    0.00411636       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.32875       7.45663       11.7111       6.83169       2.46053        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.70466       8.7838        16.4457       8.61851        3.213         10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.30031       7.43747       12.4784       7.36255       2.58559        10     
[art]:TriggerResults:TriggerResultInserter        5.5985e-05    9.00123e-05   0.000185859   7.8292e-05    3.49669e-05      10     
end_path:out1:RootOutput                           9.718e-06    1.39914e-05   1.9617e-05    1.3726e-05    2.67754e-06      10     
end_path:out1:RootOutput(write)                     2.56977       3.95191       5.31311       4.16032      0.780266        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5231.62 MB
  Peak resident set size usage (VmHWM): 4385.14 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.36 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.92 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.21 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11044100
-rw-r--r-- 1 pltdune04 pltdune 2565063976 Oct 25 11:25 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2436246851 Oct 25 11:22 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2281939809 Oct 25 12:52 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2011633102 Oct 25 08:52 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1931522673 Oct 25 08:36 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   82133610 Oct 25 12:47 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243279 Oct 25 12:52 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Oct 25 12:52 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Oct 25 12:52 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Oct 25 12:52 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 25 11:25 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 25 08:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 25 12:52 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Oct 25 08:28 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Oct 25 12:52 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 25 11:33 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 25 11:25 debugprod.log
justIN time: 2025-11-03 18:41:12 UTC       justIN version: 01.05.01