justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 235486.0@dunegpschedd02.fnal.gov

Jobsub ID235486.0@dunegpschedd02.fnal.gov
Workflow ID9488
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-30 18:27:59
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-30 23:09:08
From worker nodeHostnamewn041.hep
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-30 18:29:37
Input filesmonte-carlo-009488-000001
JobscriptExit code0
Real time4h (16680s)
CPU time4h (16057s = 96%)
Max RSS bytes4389670912 (4186 MiB)
Outputting started2025-10-30 23:07:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09488/1/001/reco_stage1.root
Finished2025-10-30 23:09:08
Saved logsjustin-logs:235486.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

eKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 156063 traces, 0 summary
Retagger: tagging trace set: gauss with 118243 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 118243 traces tagged "gauss"
FrameSaver: q=4.08199e+06 n=2072928 tag=gauss
wclsFrameSaver: saving 156063 traces tagged "wiener"
FrameSaver: q=4.31656e+06 n=1831005 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 23734 XUs and 29591 XVs -> 190 XUVs
C:0 T:1 51780 XUs and 50453 XVs -> 3610 XUVs
C:0 T:2 93408 XUs and 157183 XVs -> 10346 XUVs
C:0 T:3 48184 XUs and 60632 XVs -> 348 XUVs
C:0 T:4 11638 XUs and 10694 XVs -> 136 XUVs
C:0 T:5 100742 XUs and 33067 XVs -> 7516 XUVs
C:0 T:6 107974 XUs and 99235 XVs -> 5690 XUVs
C:0 T:7 47228 XUs and 38277 XVs -> 335 XUVs
C:0 T:8 14796 XUs and 14102 XVs -> 242 XUVs
C:0 T:9 103712 XUs and 118301 XVs -> 7927 XUVs
C:0 T:10 58377 XUs and 36432 XVs -> 5585 XUVs
C:0 T:11 380 XUs and 358 XVs -> 37 XUVs
41962 XUVs total
13963 collection wire objects
38734 potential space points
Neighbour search...
3839984 tests to find 1902692 neighbours
Iterating with no regularization...
Begin: 7.89867e+07
0 6.5703e+07
1 6.46536e+07
2 6.45056e+07
3 6.44652e+07
Now with regularization...
Begin: 5.24792e+07
0 5.24361e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410212010
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410212010
fLifetime: 30000 [us]
30-Oct-2025 23:07:35 GMT  Closed output file "reco_stage1.root"
30-Oct-2025 23:07:35 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          336.531       556.846       735.056       559.073       111.402        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00133343     0.0134991     0.0938626    0.00563386     0.0268461       10     
reco:ophit:OpHitFinder                             0.284415      0.374382      0.461684      0.356177      0.0553597       10     
reco:opflash:OpFlashFinder                          0.16065      0.218454      0.276475      0.217215      0.0366536       10     
reco:opslicer:OpSlicer                             0.725304       1.00136       1.30894      0.951326      0.187112        10     
reco:caldata:DataPrepModule                         4.8375        6.64187       7.1673        6.80648      0.638097        10     
reco:wclsdatasp:WireCellToolkit                     37.8015       43.6067       46.8801       44.6706       2.94446        10     
reco:gaushit:GausHitFinder                          1.17732       1.63868       2.28643       1.64611      0.315316        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000592355   0.000867504   0.00113621    0.000872119   0.00016508       10     
reco:reco3d:SpacePointSolver                        9.23193       23.9821       36.2375       25.3891       7.63732        10     
reco:hitpdune:DisambigFromSpacePoints               1.21775       2.62889       3.68236       2.61448      0.725284        10     
reco:pandora:StandardPandora                        24.8058       51.9754       89.0793       49.108        19.9933        10     
reco:pandoraWriter:StandardPandora                 0.444362      0.808797       1.04151      0.839559      0.178949        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.02026       6.96661       10.4785       6.78396       2.20767        10     
reco:pandoraShower:LArPandoraShowerCreation         2.2091        7.91221       13.2118       8.41535       3.10273        10     
reco:pandoracalo:Calorimetry                        1.60086       3.66613       5.00221       3.6044        1.02292        10     
reco:pandoracalonosce:Calorimetry                   1.40725       3.26871       4.90287       3.22708       1.02311        10     
reco:pandorapid:Chi2ParticleID                    0.00579221    0.00851759     0.0105845    0.00877783     0.0015066       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0523361     0.0985879      0.18245      0.090129      0.0345524       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00551826    0.00809434     0.0101772    0.00814416    0.00137741       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.1255        7.50262       12.0404       8.12452       2.7607         10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.06038       7.22381       11.5174       8.02965       2.66539        10     
reco:emtrkmichelid:EmTrackMichelId                  208.05        315.965       393.864       320.092       52.0817        10     
reco:crttag:SingleCRTMatchingProducer              0.0125952     0.0230471     0.0368101     0.0230656    0.00615419       10     
reco:crtreco:TwoCRTMatchingProducer               0.00788584     0.0140939     0.0198779     0.013788     0.00323694       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.843413       1.18681       1.48755       1.17593      0.201683        10     
reco:pandora2Track:LArPandoraTrackCreation          7.8091        22.5289       34.3091       24.467        7.63284        10     
reco:pandora2calo:Calorimetry                       3.52886       9.94665       15.5227       10.3296       3.66246        10     
reco:pandora2calonosce:Calorimetry                  3.28803       9.05994       14.299        9.77736       3.2334         10     
reco:pandora2pid:Chi2ParticleID                    0.0114824     0.0212324     0.028289      0.0221335    0.00486116       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0519119     0.111029      0.149551      0.115794      0.0249814       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0108822     0.0232125     0.0467013     0.0217875    0.00909652       10     
reco:pandora2Shower:LArPandoraShowerCreation        2.83755       7.95734       12.0444       8.46311       2.73315        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.02505       8.26677       12.8335       8.64508       2.94384        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.75887       7.44197       11.3809       7.65825       2.48224        10     
[art]:TriggerResults:TriggerResultInserter        6.1686e-05    8.67463e-05   0.00017478    7.72855e-05   3.18169e-05      10     
end_path:out1:RootOutput                           1.077e-05    1.60524e-05   2.4236e-05    1.5529e-05    3.29484e-06      10     
end_path:out1:RootOutput(write)                     2.74002       4.58469       6.01759       4.55732      0.906328        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5215.2 MB
  Peak resident set size usage (VmHWM): 4389.67 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.28 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.10 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.16 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10914020
-rw-r--r--. 1 dune004 dune 2532648784 Oct 30 21:31 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2400960954 Oct 30 21:28 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2261654403 Oct 30 23:07 reco_stage1.root
-rw-r--r--. 1 dune004 dune 1986116262 Oct 30 18:56 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1909784180 Oct 30 18:38 g4_stage1.root
-rw-r--r--. 1 dune004 dune   84174440 Oct 30 23:00 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     243013 Oct 30 23:07 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 30 23:07 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 30 23:07 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 30 23:07 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 30 21:31 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 30 18:56 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 30 23:07 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 30 18:29 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 30 23:07 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 30 21:40 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 30 21:31 debugprod.log
justIN time: 2025-11-03 18:41:07 UTC       justIN version: 01.05.01