justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 238483.0@dunegpschedd01.fnal.gov

Jobsub ID238483.0@dunegpschedd01.fnal.gov
Workflow ID9337
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-25 14:37:25
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-10-25 18:35:30
From worker nodeHostnameheplnc164.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-25 14:38:27
Input filesmonte-carlo-009337-000001
JobscriptExit code0
Real time3h (14124s)
CPU time3h (13552s = 95%)
Max RSS bytes4253446144 (4056 MiB)
Outputting started2025-10-25 18:33:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09337/1/001/reco_stage1.root
Finished2025-10-25 18:35:30
Saved logsjustin-logs:238483.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

aleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 131354 traces, 0 summary
Retagger: tagging trace set: gauss with 100165 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100165 traces tagged "gauss"
FrameSaver: q=3.50502e+06 n=1825891 tag=gauss
wclsFrameSaver: saving 131354 traces tagged "wiener"
FrameSaver: q=3.716e+06 n=1626445 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 20586 XUs and 14507 XVs -> 97 XUVs
C:0 T:1 41114 XUs and 27589 XVs -> 3474 XUVs
C:0 T:2 85986 XUs and 57166 XVs -> 6404 XUVs
C:0 T:3 31228 XUs and 21692 XVs -> 152 XUVs
C:0 T:4 9973 XUs and 8325 XVs -> 64 XUVs
C:0 T:5 39025 XUs and 27435 XVs -> 3566 XUVs
C:0 T:6 236281 XUs and 173261 XVs -> 28780 XUVs
C:0 T:7 46909 XUs and 51121 XVs -> 878 XUVs
C:0 T:8 9345 XUs and 11961 XVs -> 126 XUVs
C:0 T:9 66560 XUs and 98892 XVs -> 5798 XUVs
C:0 T:10 163056 XUs and 92084 XVs -> 19503 XUVs
C:0 T:11 503 XUs and 309 XVs -> 37 XUVs
68879 XUVs total
13265 collection wire objects
64112 potential space points
Neighbour search...
15945810 tests to find 6440022 neighbours
Iterating with no regularization...
Begin: 6.58756e+07
0 5.34682e+07
1 5.26355e+07
2 5.24995e+07
3 5.24591e+07
Now with regularization...
Begin: 4.28704e+07
0 4.28004e+07
1 4.27597e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410108545
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410108545
fLifetime: 30000 [us]
25-Oct-2025 19:33:49 BST  Closed output file "reco_stage1.root"
25-Oct-2025 19:33:49 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          317.439       454.628       642.271       452.044       86.1087        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00162536    0.00456287    0.00853356    0.00426116    0.00204311       10     
reco:ophit:OpHitFinder                             0.303705      0.380162      0.438848      0.395078      0.0480548       10     
reco:opflash:OpFlashFinder                         0.160476       0.21565      0.256211      0.216132      0.0274037       10     
reco:opslicer:OpSlicer                             0.680925      0.858847       1.0199       0.861647      0.103723        10     
reco:caldata:DataPrepModule                         5.72589       7.0438        8.02405       7.13814      0.775415        10     
reco:wclsdatasp:WireCellToolkit                     39.0821       40.8401       43.8977       40.2744       1.59261        10     
reco:gaushit:GausHitFinder                         0.858408       1.67621       2.65717       1.68608      0.466463        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000578187   0.000728475    0.0010367    0.00068605    0.000129037      10     
reco:reco3d:SpacePointSolver                        11.7495       23.5355       42.9668       25.0887       8.60407        10     
reco:hitpdune:DisambigFromSpacePoints               1.39467       2.38993       3.97288       2.25728      0.770292        10     
reco:pandora:StandardPandora                        24.4271       50.6131       104.304       46.6489       23.1162        10     
reco:pandoraWriter:StandardPandora                 0.393967      0.604741      0.936878       0.55377      0.172814        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.52593       5.16842       8.05897       5.08966       1.4596         10     
reco:pandoraShower:LArPandoraShowerCreation         2.58994       5.76582       9.53809       5.0761        2.25062        10     
reco:pandoracalo:Calorimetry                        1.75519       3.33942       4.94436       3.36244      0.899294        10     
reco:pandoracalonosce:Calorimetry                   1.69955       2.89646       4.13442       2.9076       0.762448        10     
reco:pandorapid:Chi2ParticleID                    0.00521952    0.00831623     0.0103032    0.00846665    0.00137708       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0416487     0.0764758     0.0975226     0.0814761     0.0172656       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00511681    0.00816969     0.0105375    0.00869843    0.00166992       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.54264       6.54736       10.0032       6.85559       2.43081        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.42272       6.33867       9.21304       6.49131       2.30935        10     
reco:emtrkmichelid:EmTrackMichelId                  181.921       234.959       294.514       242.333       31.4245        10     
reco:crttag:SingleCRTMatchingProducer              0.0130467     0.0196262     0.0249382     0.0201221    0.00359168       10     
reco:crtreco:TwoCRTMatchingProducer               0.00820371     0.011335      0.0217282     0.0103848    0.00364058       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.864553       0.97976       1.17808      0.930541      0.111487        10     
reco:pandora2Track:LArPandoraTrackCreation          9.24598       17.369        26.8675       17.2636       5.30769        10     
reco:pandora2calo:Calorimetry                       4.33397       9.11156       14.4736       9.16102       2.62061        10     
reco:pandora2calonosce:Calorimetry                  4.14539       8.79466       12.8411       9.32875       2.3734         10     
reco:pandora2pid:Chi2ParticleID                    0.0170472     0.0222548     0.0305362     0.022625     0.00350716       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0819412     0.109645      0.146916      0.111941      0.0170933       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0166488     0.0217252     0.0294311     0.0217363    0.00354272       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.48334       6.50403       10.7737       6.41732       2.11737        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.96012       7.85715       13.4353       7.52583       2.54658        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.12834       6.78196       10.7222       6.67438       2.22656        10     
[art]:TriggerResults:TriggerResultInserter        5.5685e-05    8.6094e-05    0.000206098   7.59175e-05   4.07926e-05      10     
end_path:out1:RootOutput                          1.1883e-05    1.51433e-05   2.4085e-05    1.4272e-05    3.27156e-06      10     
end_path:out1:RootOutput(write)                     2.24681       3.61239       4.78158       3.76424      0.747007        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5117.48 MB
  Peak resident set size usage (VmHWM): 4253.45 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.33 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.36 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10510316
-rw-r--r-- 1 pltdune04 pltdune 2467127517 Oct 25 18:15 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2343294145 Oct 25 18:13 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2167661845 Oct 25 19:33 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1890548279 Oct 25 15:59 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1814630217 Oct 25 15:46 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   78672460 Oct 25 19:28 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     242693 Oct 25 19:33 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Oct 25 19:33 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Oct 25 19:33 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Oct 25 19:33 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 25 18:15 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 25 15:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 25 19:33 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Oct 25 15:38 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Oct 25 19:33 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 25 18:21 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 25 18:15 debugprod.log
justIN time: 2025-11-03 18:40:24 UTC       justIN version: 01.05.01