justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241094.1@dunegpschedd01.fnal.gov

Jobsub ID241094.1@dunegpschedd01.fnal.gov
Workflow ID9485
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-30 18:27:58
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-30 23:42:20
From worker nodeHostnamewn016.hep
cpuinfoIntel(R) Core(TM) i7-5960X CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-30 18:29:46
Input filesmonte-carlo-009485-000001
JobscriptExit code0
Real time4h (16547s)
CPU time4h (16195s = 97%)
Max RSS bytes4502982656 (4294 MiB)
Outputting started2025-10-30 23:05:34
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09485/1/001/reco_stage1.root
Finished2025-10-30 23:42:20
Saved logsjustin-logs:241094.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117648 traces, 0 summary
Retagger: tagging trace set: gauss with 92932 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 92932 traces tagged "gauss"
FrameSaver: q=3.12501e+06 n=1656376 tag=gauss
wclsFrameSaver: saving 117648 traces tagged "wiener"
FrameSaver: q=3.28987e+06 n=1476692 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30612 XUs and 37366 XVs -> 6930 XUVs
C:0 T:1 32874 XUs and 31838 XVs -> 2082 XUVs
C:0 T:2 96026 XUs and 113093 XVs -> 4626 XUVs
C:0 T:3 49000 XUs and 48180 XVs -> 324 XUVs
C:0 T:4 12196 XUs and 9718 XVs -> 83 XUVs
C:0 T:5 55025 XUs and 28894 XVs -> 4422 XUVs
C:0 T:6 79276 XUs and 100656 XVs -> 5939 XUVs
C:0 T:7 28790 XUs and 37814 XVs -> 259 XUVs
C:0 T:8 9585 XUs and 8593 XVs -> 88 XUVs
C:0 T:9 65119 XUs and 64838 XVs -> 4467 XUVs
C:0 T:10 29773 XUs and 17772 XVs -> 4399 XUVs
C:0 T:11 115 XUs and 57 XVs -> 12 XUVs
33631 XUVs total
10262 collection wire objects
31348 potential space points
Neighbour search...
4384490 tests to find 1976934 neighbours
Iterating with no regularization...
Begin: 6.56859e+07
0 5.61826e+07
1 5.56079e+07
2 5.55299e+07
3 5.55059e+07
Now with regularization...
Begin: 4.65459e+07
0 4.65229e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410212044
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410212044
fLifetime: 30000 [us]
30-Oct-2025 23:05:33 GMT  Closed output file "reco_stage1.root"
30-Oct-2025 23:05:33 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          280.892       619.91        763.862       655.131       139.474        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000972848   0.00286414    0.00462248     0.0027478    0.00108043       10     
reco:ophit:OpHitFinder                             0.205973      0.389311      0.471955      0.392679      0.0674266       10     
reco:opflash:OpFlashFinder                         0.137015      0.229139      0.305713      0.219505      0.0438184       10     
reco:opslicer:OpSlicer                             0.539727       1.08754       1.59525       1.12655      0.254015        10     
reco:caldata:DataPrepModule                         4.68721       7.68428       8.36769       8.04359       1.01944        10     
reco:wclsdatasp:WireCellToolkit                     31.9028       54.8731       70.2098       55.2108       10.7931        10     
reco:gaushit:GausHitFinder                          1.19959       2.10961       2.74288       2.09738      0.410262        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000408527   0.00075454    0.000863255   0.000768031   0.000125153      10     
reco:reco3d:SpacePointSolver                        10.2871       27.3658       73.3298       22.2798       16.9512        10     
reco:hitpdune:DisambigFromSpacePoints               1.8108        4.10383       5.48861       4.18995       1.00275        10     
reco:pandora:StandardPandora                        22.808        72.5758       167.755       67.3551       36.1167        10     
reco:pandoraWriter:StandardPandora                 0.307498      0.648551      0.797281      0.665638      0.124477        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.2913        8.01098       9.64093       8.49681       1.70053        10     
reco:pandoraShower:LArPandoraShowerCreation         3.12416       8.07755       11.9836       8.10371       2.3364         10     
reco:pandoracalo:Calorimetry                        1.74527       4.02052       4.79036       4.1469        0.81529        10     
reco:pandoracalonosce:Calorimetry                   1.73608       3.68795       4.34579       3.80769      0.708167        10     
reco:pandorapid:Chi2ParticleID                    0.00494897    0.00988663     0.0126522    0.00998412    0.00184732       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0717474     0.100837       0.1217       0.101665      0.0136953       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00498194    0.00949726     0.0123814    0.00963132    0.00181236       10     
reco:pandoraShowercalo:ShowerCalorimetry             3.388        8.04325       11.8928       8.01711       2.19312        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.20351       7.88184       11.707        7.87753       2.19429        10     
reco:emtrkmichelid:EmTrackMichelId                  150.878       328.072       406.408       347.163       72.8966        10     
reco:crttag:SingleCRTMatchingProducer              0.0109802     0.0204931     0.0277933     0.021139     0.00491015       10     
reco:crtreco:TwoCRTMatchingProducer               0.00800608     0.0155247     0.0214626     0.0160617     0.0038942       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.62368       2.04109       2.49174       2.01194      0.269211        10     
reco:pandora2Track:LArPandoraTrackCreation          12.5373       25.5729       38.6091       26.1806       7.39122        10     
reco:pandora2calo:Calorimetry                       5.08983       11.0661       17.0826       11.4992       3.26768        10     
reco:pandora2calonosce:Calorimetry                  4.87211       10.5072       16.3541       10.9579       3.11424        10     
reco:pandora2pid:Chi2ParticleID                    0.0123677     0.0236868     0.0325927     0.0251498    0.00614326       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0715834     0.124143      0.164927      0.130762      0.0273211       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0124362     0.0237186     0.0327543     0.0251114    0.00628166       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.18314       8.67606       12.756        8.94001       2.37542        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.57454       9.70762       14.9104       9.96143       2.77918        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.30437       9.04981       13.8788       9.3175        2.56068        10     
[art]:TriggerResults:TriggerResultInserter        2.4345e-05    4.56912e-05   0.000118092   4.06185e-05   2.5012e-05       10     
end_path:out1:RootOutput                           4.161e-06    6.0776e-06    1.0848e-05    5.9655e-06    1.73524e-06      10     
end_path:out1:RootOutput(write)                     2.19343       3.99482       5.28195        4.099       0.912107        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5311.61 MB
  Peak resident set size usage (VmHWM): 4502.98 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.05 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.27 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11151036
-rw-r--r--. 1 dune004 dune 2578202617 Oct 30 21:19 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2443781427 Oct 30 21:15 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2294961333 Oct 30 23:05 reco_stage1.root
-rw-r--r--. 1 dune004 dune 2053015750 Oct 30 19:00 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1965956413 Oct 30 18:40 g4_stage1.root
-rw-r--r--. 1 dune004 dune   82064090 Oct 30 23:02 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     243125 Oct 30 23:05 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 30 23:05 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 30 23:05 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 30 23:05 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 30 21:19 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 30 19:00 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 30 23:05 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 30 18:29 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 30 23:05 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 30 21:28 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 30 21:19 debugprod.log
justIN time: 2025-12-19 05:16:39 UTC       justIN version: 01.05.03