justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232833.0@dunegpschedd02.fnal.gov

Jobsub ID232833.0@dunegpschedd02.fnal.gov
Workflow ID9333
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-25 07:27:03
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-25 11:54:04
From worker nodeHostnamewn039.hep
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-25 07:29:07
Input filesmonte-carlo-009333-000001
JobscriptExit code0
Real time4h (15802s)
CPU time4h (15243s = 96%)
Max RSS bytes4543680512 (4333 MiB)
Outputting started2025-10-25 11:52:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09333/1/001/reco_stage1.root
Finished2025-10-25 11:54:04
Saved logsjustin-logs:232833.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 142720 traces, 0 summary
Retagger: tagging trace set: gauss with 106266 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 106266 traces tagged "gauss"
FrameSaver: q=3.63234e+06 n=1844232 tag=gauss
wclsFrameSaver: saving 142720 traces tagged "wiener"
FrameSaver: q=3.87678e+06 n=1619235 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 45124 XUs and 38095 XVs -> 718 XUVs
C:0 T:1 89495 XUs and 86907 XVs -> 7109 XUVs
C:0 T:2 98264 XUs and 144033 XVs -> 12539 XUVs
C:0 T:3 36819 XUs and 41091 XVs -> 640 XUVs
C:0 T:4 15012 XUs and 14402 XVs -> 424 XUVs
C:0 T:5 89294 XUs and 87433 XVs -> 18312 XUVs
C:0 T:6 123638 XUs and 151604 XVs -> 11683 XUVs
C:0 T:7 42431 XUs and 44936 XVs -> 822 XUVs
C:0 T:8 4680 XUs and 5958 XVs -> 48 XUVs
C:0 T:9 35862 XUs and 52192 XVs -> 4137 XUVs
C:0 T:10 120472 XUs and 93515 XVs -> 24406 XUVs
C:0 T:11 1592 XUs and 967 XVs -> 145 XUVs
80983 XUVs total
12931 collection wire objects
75178 potential space points
Neighbour search...
18962794 tests to find 7836966 neighbours
Iterating with no regularization...
Begin: 6.88015e+07
0 5.60542e+07
1 5.51942e+07
2 5.5052e+07
3 5.50046e+07
Now with regularization...
Begin: 4.45577e+07
0 4.44633e+07
1 4.43855e+07
2 4.4323e+07
3 4.42729e+07
4 4.42311e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410102327
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410102327
fLifetime: 30000 [us]
25-Oct-2025 12:52:28 BST  Closed output file "reco_stage1.root"
25-Oct-2025 12:52:28 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          260.211       507.242       673.595       517.273       106.815        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00115969    0.00378855    0.00691676    0.00386013    0.00164941       10     
reco:ophit:OpHitFinder                             0.252679      0.342979      0.437423      0.340769      0.055774        10     
reco:opflash:OpFlashFinder                         0.139963      0.204493       0.26737      0.207644      0.0373576       10     
reco:opslicer:OpSlicer                             0.685322      0.932869       1.34049      0.925663      0.195705        10     
reco:caldata:DataPrepModule                         4.88688       6.01401       6.91705       6.05288      0.665233        10     
reco:wclsdatasp:WireCellToolkit                     33.4848       40.8702       44.7215       41.0348       3.49665        10     
reco:gaushit:GausHitFinder                         0.728659       1.57646       2.22176       1.60239      0.369561        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000686877   0.00111562    0.00376403    0.000834642   0.000891204      10     
reco:reco3d:SpacePointSolver                        11.0468       18.741        29.043        16.8632       5.71965        10     
reco:hitpdune:DisambigFromSpacePoints               1.12411       2.28394       3.39133       2.25221       0.6444         10     
reco:pandora:StandardPandora                        18.8818       46.0583       68.6055       46.5728       13.808         10     
reco:pandoraWriter:StandardPandora                 0.462191      0.916779       1.11428      0.986347       0.17804        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.57543       6.52537       8.48317       6.7899        1.57285        10     
reco:pandoraShower:LArPandoraShowerCreation         1.57141       7.71948       12.0747       7.44795       2.86344        10     
reco:pandoracalo:Calorimetry                        1.41815       3.4094        4.59632       3.48354      0.872062        10     
reco:pandoracalonosce:Calorimetry                   1.20034       3.17819       4.26481       3.26306      0.825646        10     
reco:pandorapid:Chi2ParticleID                    0.00582479    0.00819912     0.0101613    0.00832296    0.00125853       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0588671     0.0816072     0.105205      0.0845389     0.0141876       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00498305    0.00737756    0.00959087    0.00758413    0.00137325       10     
reco:pandoraShowercalo:ShowerCalorimetry            1.59606       7.62399       11.607        7.79922       2.62334        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.51309       7.1648        11.2372       6.99415       2.50977        10     
reco:emtrkmichelid:EmTrackMichelId                   152.8        285.247       369.395       285.083       56.0806        10     
reco:crttag:SingleCRTMatchingProducer              0.0145277     0.0209574     0.0276547     0.0207381    0.00371681       10     
reco:crtreco:TwoCRTMatchingProducer                0.0081964     0.0140751     0.018794      0.0141342    0.00275094       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.773743       1.06415       1.44717       1.00399      0.209949        10     
reco:pandora2Track:LArPandoraTrackCreation          4.88531       21.5683       32.0227       21.9469       7.31664        10     
reco:pandora2calo:Calorimetry                       2.19457       9.95243       14.4815       10.5409       3.21703        10     
reco:pandora2calonosce:Calorimetry                  2.00999       9.08632       13.7719       9.35872       3.08685        10     
reco:pandora2pid:Chi2ParticleID                   0.00934505     0.020042      0.0257226     0.0215185    0.00494857       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0493775     0.0991453     0.143052      0.102898      0.0281977       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00966378     0.0188648     0.0244786     0.0202943    0.00466338       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.70699       7.14631       11.0826       7.78175       2.5194         10     
reco:pandora2Showercalo:ShowerCalorimetry           1.88548       7.5834        10.7525       7.66443       2.54503        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.77186       6.86321       9.93941       7.08614       2.21109        10     
[art]:TriggerResults:TriggerResultInserter        4.3041e-05    7.01482e-05   0.00015912    6.31185e-05   3.16538e-05      10     
end_path:out1:RootOutput                           9.207e-06    1.22611e-05   1.4657e-05    1.24335e-05   1.72557e-06      10     
end_path:out1:RootOutput(write)                     2.46502       4.72336       6.56047       4.69887       1.06624        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5369.1 MB
  Peak resident set size usage (VmHWM): 4543.68 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.26 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.76 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11358344
-rw-r--r--. 1 dune004 dune 2618837289 Oct 25 11:25 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2487824397 Oct 25 11:21 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2336443000 Oct 25 12:52 reco_stage1.root
-rw-r--r--. 1 dune004 dune 2095856063 Oct 25 08:56 g4_stage2.root
-rw-r--r--. 1 dune004 dune 2009416714 Oct 25 08:38 g4_stage1.root
-rw-r--r--. 1 dune004 dune   81950790 Oct 25 12:46 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     242821 Oct 25 12:52 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 25 12:52 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 25 12:52 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 25 12:52 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 25 11:25 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 25 08:56 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 25 12:52 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 25 08:29 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 25 12:52 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 25 11:32 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 25 11:25 debugprod.log
justIN time: 2025-11-03 18:41:06 UTC       justIN version: 01.05.01