justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 20185.1@dunegpschedd01.fnal.gov

Jobsub ID20185.1@dunegpschedd01.fnal.gov
Workflow ID208
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-08-01 11:28:02
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-08-01 16:29:14
From worker nodeHostnameheplnc135.pp.rl.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-01 11:29:34
Input filesmonte-carlo-000208-000001
JobscriptExit code0
Real time4h (17905s)
CPU time4h (16974s = 94%)
Max RSS bytes3993219072 (3808 MiB)
Outputting started2025-08-01 16:28:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00208/1/001/reco_stage1.root
Finished2025-08-01 16:29:14
Saved logsjustin-logs:20185.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

repare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 100924 traces, 0 summary
Retagger: tagging trace set: gauss with 75803 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75803 traces tagged "gauss"
FrameSaver: q=2.57768e+06 n=1338760 tag=gauss
wclsFrameSaver: saving 100924 traces tagged "wiener"
FrameSaver: q=2.72163e+06 n=1175226 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25330 XUs and 26052 XVs -> 127 XUVs
C:0 T:1 48707 XUs and 49006 XVs -> 4122 XUVs
C:0 T:2 40622 XUs and 54063 XVs -> 1760 XUVs
C:0 T:3 22631 XUs and 24382 XVs -> 84 XUVs
C:0 T:4 7905 XUs and 10377 XVs -> 69 XUVs
C:0 T:5 33455 XUs and 48398 XVs -> 4374 XUVs
C:0 T:6 44647 XUs and 43121 XVs -> 2015 XUVs
C:0 T:7 19351 XUs and 16800 XVs -> 138 XUVs
C:0 T:8 7505 XUs and 10468 XVs -> 94 XUVs
C:0 T:9 49522 XUs and 76988 XVs -> 4813 XUVs
C:0 T:10 38500 XUs and 32814 XVs -> 6587 XUVs
C:0 T:11 86 XUs and 53 XVs -> 10 XUVs
24193 XUVs total
9322 collection wire objects
22760 potential space points
Neighbour search...
1248470 tests to find 685964 neighbours
Iterating with no regularization...
Begin: 5.34078e+07
0 4.56183e+07
1 4.5108e+07
2 4.50332e+07
3 4.501e+07
Now with regularization...
Begin: 3.73887e+07
0 3.73735e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 408381210
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408381210
fLifetime: 30000 [us]
01-Aug-2025 17:27:57 BST  Closed output file "reco_stage1.root"
01-Aug-2025 17:27:57 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          404.05        587.057       942.007       484.665       192.285        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00147321    0.00348769    0.00571335    0.00335487    0.00129246       10     
reco:ophit:OpHitFinder                             0.266239      0.435391      0.578843      0.429273      0.102284        10     
reco:opflash:OpFlashFinder                         0.150657      0.237374      0.320908      0.235141      0.0584276       10     
reco:opslicer:OpSlicer                             0.662406       1.03662       1.49083      0.918417      0.266968        10     
reco:caldata:DataPrepModule                         6.58419       9.74562       14.4131       9.69325       2.51894        10     
reco:wclsdatasp:WireCellToolkit                     52.792        64.627        86.9789       62.4457       8.84413        10     
reco:gaushit:GausHitFinder                          1.08247       2.07845       4.24936       1.89051       0.95466        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000533272   0.000778624   0.00116252    0.000720576   0.000186107      10     
reco:reco3d:SpacePointSolver                        7.48274       19.3215       38.1215       16.2808       9.90678        10     
reco:hitpdune:DisambigFromSpacePoints               1.42812       3.38531       6.30355       2.75834       1.59968        10     
reco:pandora:StandardPandora                        28.166        64.2752       179.695       46.436        44.6986        10     
reco:pandoraWriter:StandardPandora                 0.392164      0.733963       1.01984      0.680194      0.202085        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.25999       8.25841       16.0253       6.6177        3.76746        10     
reco:pandoraShower:LArPandoraShowerCreation         2.82283       8.45132       18.5087       6.39405       5.0287         10     
reco:pandoracalo:Calorimetry                         1.881        3.81542       7.15899       3.11711       1.64145        10     
reco:pandoracalonosce:Calorimetry                   1.86084       3.58272       6.59029       2.85292       1.62488        10     
reco:pandorapid:Chi2ParticleID                    0.00611195     0.0091043     0.0131246    0.00849119    0.00222263       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0558306     0.0984261     0.140933      0.0945095     0.0246763       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00472552    0.00888854     0.0125833     0.0082712    0.00221285       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.35314       7.81154       17.5681       5.17868       4.90513        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.68048       7.32188       16.7141       5.1415        4.67575        10     
reco:emtrkmichelid:EmTrackMichelId                  231.45        303.268       433.867       266.636        68.37         10     
reco:crttag:SingleCRTMatchingProducer              0.0164411     0.0288044     0.0439246     0.0276167    0.00779474       10     
reco:crtreco:TwoCRTMatchingProducer               0.00993864     0.0200113     0.0317329     0.0189766    0.00650319       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.04472       1.60722       2.55149       1.42028      0.463172        10     
reco:pandora2Track:LArPandoraTrackCreation          12.5845       26.7849       59.5552       19.3833       15.0668        10     
reco:pandora2calo:Calorimetry                       4.15028       10.4374       22.5557       7.81544       6.03045        10     
reco:pandora2calonosce:Calorimetry                  3.47778       9.82698       21.1777       7.23975       5.85698        10     
reco:pandora2pid:Chi2ParticleID                    0.0103152     0.0224003     0.0369142     0.0198293    0.00889793       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0691594      0.12434      0.189508      0.103643      0.0446639       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0104918     0.0220546     0.0353317     0.0193559     0.0086235       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.3669        8.10608       18.8254       6.25164       4.53295        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.40506       9.10065       22.5742       6.55313       5.84506        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.11332       8.17616       19.9367       5.89551       5.09444        10     
[art]:TriggerResults:TriggerResultInserter        6.8919e-05    0.000105174   0.000162324   0.000106111   2.78599e-05      10     
end_path:out1:RootOutput                           8.52e-06     1.12074e-05   1.5305e-05    1.08755e-05   2.00739e-06      10     
end_path:out1:RootOutput(write)                     2.38242       4.14908       6.97964       3.66014       1.28436        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4811.69 MB
  Peak resident set size usage (VmHWM): 3993.22 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.37 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   6.11 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.32 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9256520
-rw-r--r-- 1 pltdune04 pltdune 2201524700 Aug  1 15:46 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2092809793 Aug  1 15:43 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1860468632 Aug  1 17:27 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1651530642 Aug  1 12:59 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1603137485 Aug  1 12:36 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   68598550 Aug  1 17:22 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     242709 Aug  1 17:27 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Aug  1 17:27 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Aug  1 17:27 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Aug  1 17:27 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Aug  1 15:46 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Aug  1 12:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Aug  1 17:27 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Aug  1 12:29 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Aug  1 17:27 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Aug  1 15:54 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Aug  1 15:46 debugprod.log
justIN time: 2025-08-04 19:41:56 UTC       justIN version: 01.04.00