justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 268097.0@dunegpschedd01.fnal.gov

Jobsub ID268097.0@dunegpschedd01.fnal.gov
Workflow ID11210
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-13 17:10:51
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-12-13 20:20:10
From worker nodeHostnameheplnc171.pp.rl.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 17:11:29
Input filesmonte-carlo-011210-000001
JobscriptExit code0
Real time3h (11242s)
CPU time3h (10920s = 97%)
Max RSS bytes4052668416 (3864 MiB)
Outputting started2025-12-13 20:18:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11210/1/001/reco_stage1.root
Finished2025-12-13 20:20:10
Saved logsjustin-logs:268097.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ng tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 134014 traces, 0 summary
Retagger: tagging trace set: gauss with 100475 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100475 traces tagged "gauss"
FrameSaver: q=3.48433e+06 n=1747759 tag=gauss
wclsFrameSaver: saving 134014 traces tagged "wiener"
FrameSaver: q=3.72199e+06 n=1537578 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 49353 XUs and 36683 XVs -> 1311 XUVs
C:0 T:1 125925 XUs and 99937 XVs -> 9929 XUVs
C:0 T:2 94046 XUs and 118591 XVs -> 4791 XUVs
C:0 T:3 43956 XUs and 50941 XVs -> 205 XUVs
C:0 T:4 14958 XUs and 16511 XVs -> 247 XUVs
C:0 T:5 80904 XUs and 107254 XVs -> 11571 XUVs
C:0 T:6 71238 XUs and 79460 XVs -> 4054 XUVs
C:0 T:7 31065 XUs and 30033 XVs -> 204 XUVs
C:0 T:8 5327 XUs and 6318 XVs -> 57 XUVs
C:0 T:9 40934 XUs and 63604 XVs -> 7551 XUVs
C:0 T:10 26367 XUs and 55145 XVs -> 4696 XUVs
C:0 T:11 460 XUs and 340 XVs -> 41 XUVs
44657 XUVs total
12935 collection wire objects
40845 potential space points
Neighbour search...
4523773 tests to find 2291170 neighbours
Iterating with no regularization...
Begin: 7.03845e+07
0 5.34754e+07
1 5.24089e+07
2 5.22241e+07
3 5.21596e+07
4 5.21271e+07
Now with regularization...
Begin: 4.1029e+07
0 4.09143e+07
1 4.08293e+07
2 4.0769e+07
3 4.07246e+07
4 4.06933e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411096405
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411096405
fLifetime: 30000 [us]
13-Dec-2025 20:18:50 GMT  Closed output file "reco_stage1.root"
13-Dec-2025 20:18:50 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          231.954       327.394       383.535       349.974       58.3949        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00144801    0.00389542    0.00637612    0.00411159    0.00152503       10     
reco:ophit:OpHitFinder                             0.240764      0.310186      0.353987      0.322433      0.0324103       10     
reco:opflash:OpFlashFinder                         0.135381      0.179233       0.23022      0.180132      0.0286796       10     
reco:opslicer:OpSlicer                             0.489468      0.687287      0.831249      0.704535      0.0991608       10     
reco:caldata:DataPrepModule                         4.67496       5.57089       6.63571       5.67989      0.590938        10     
reco:wclsdatasp:WireCellToolkit                     30.3854       33.3354       35.482        33.1495       1.52765        10     
reco:gaushit:GausHitFinder                         0.655976       1.19472       1.43745       1.30033      0.260706        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000233163   0.000537066   0.000764871   0.000542773   0.000155229      10     
reco:reco3d:SpacePointSolver                        5.5498        13.418        18.1872       15.4808       4.28115        10     
reco:hitpdune:DisambigFromSpacePoints              0.632891       1.44204       1.98037       1.62942      0.473105        10     
reco:pandora:StandardPandora                        16.2416       29.6226       42.8165       31.0078       9.08547        10     
reco:pandoraWriter:StandardPandora                 0.361845      0.470914      0.619935      0.459781      0.0787365       10     
reco:pandoraTrack:LArPandoraTrackCreation           2.40993       4.2099        8.22602       3.74381       1.58599        10     
reco:pandoraShower:LArPandoraShowerCreation         1.81364       3.83029       6.32099       3.88043       1.35952        10     
reco:pandoracalo:Calorimetry                        1.14721       2.19803       3.09967       2.25575      0.659587        10     
reco:pandoracalonosce:Calorimetry                   1.18176       2.03496       2.91643       2.07052      0.618403        10     
reco:pandorapid:Chi2ParticleID                    0.00429738     0.006435      0.0081206    0.00658596    0.00115138       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0355297     0.0607742     0.0766966     0.0637432     0.012859        10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00425515     0.0060093    0.00727604    0.00616284    0.000903435      10     
reco:pandoraShowercalo:ShowerCalorimetry            1.82239       3.89372       6.00789       4.38658       1.41479        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.80826       3.70739       5.58489       4.13467       1.29106        10     
reco:emtrkmichelid:EmTrackMichelId                  139.346       182.783        213.7        189.583       28.7033        10     
reco:crttag:SingleCRTMatchingProducer              0.0107928     0.017196      0.0238831     0.0166298    0.00441662       10     
reco:crtreco:TwoCRTMatchingProducer               0.00424027    0.00875645     0.0170508    0.00775078     0.0034492       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.474137       0.84565       1.11217      0.884335      0.189444        10     
reco:pandora2Track:LArPandoraTrackCreation          4.38392       11.0981       17.8136       10.5959       3.89897        10     
reco:pandora2calo:Calorimetry                       2.14994       5.45996       9.94744       5.30971       2.19092        10     
reco:pandora2calonosce:Calorimetry                  2.0868        5.39139       7.54081       6.16234        1.771         10     
reco:pandora2pid:Chi2ParticleID                   0.00675434     0.0131827     0.0168684     0.014156     0.00324605       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0346092     0.067549      0.0854985     0.0712684     0.0161689       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00641618     0.0128296     0.0170246     0.013875     0.00304227       10     
reco:pandora2Shower:LArPandoraShowerCreation        2.21052       3.76958       5.02993       3.80248       0.92626        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.07298       4.66945       6.65097       4.63612       1.4632         10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.10956       4.34565       6.05917       4.30598       1.28672        10     
[art]:TriggerResults:TriggerResultInserter        4.6341e-05    6.97321e-05   0.000161663   5.75205e-05   3.3072e-05       10     
end_path:out1:RootOutput                           9.67e-06     1.2037e-05     1.891e-05    1.1305e-05    2.60949e-06      10     
end_path:out1:RootOutput(write)                     1.67026       2.58373       3.21809       2.56768      0.446307        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4935.95 MB
  Peak resident set size usage (VmHWM): 4052.67 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.29 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.40 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.15 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9980532
-rw-r--r-- 1 pltdune04 pltdune 2366243131 Dec 13 19:22 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2246890101 Dec 13 19:20 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2040898766 Dec 13 20:18 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1792638217 Dec 13 17:30 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1700218944 Dec 13 17:18 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   72558880 Dec 13 20:14 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     242946 Dec 13 20:18 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Dec 13 20:18 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Dec 13 20:18 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Dec 13 20:18 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 13 19:22 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 13 17:30 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 13 20:18 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Dec 13 17:11 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Dec 13 20:18 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 13 19:26 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 13 19:22 debugprod.log
justIN time: 2025-12-18 20:21:58 UTC       justIN version: 01.05.03