justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279847.1@dunegpschedd01.fnal.gov

Jobsub ID279847.1@dunegpschedd01.fnal.gov
Workflow ID12001
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-17 15:54:35
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2026-01-17 22:37:50
From worker nodeHostnamet2wn155.physics.ox.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5115 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-17 15:56:42
Input filesmonte-carlo-012001-000001
JobscriptExit code0
Real time6h (23939s)
CPU time6h (23321s = 97%)
Max RSS bytes5108613120 (4871 MiB)
Outputting started2026-01-17 22:35:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12001/1/001/reco_stage1.root
Finished2026-01-17 22:37:50
Saved logsjustin-logs:279847.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 133538 traces, 0 summary
Retagger: tagging trace set: gauss with 102947 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102947 traces tagged "gauss"
FrameSaver: q=3.77041e+06 n=1853221 tag=gauss
wclsFrameSaver: saving 133538 traces tagged "wiener"
FrameSaver: q=3.99018e+06 n=1651464 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 45626 XUs and 44270 XVs -> 570 XUVs
C:0 T:1 103743 XUs and 98432 XVs -> 7361 XUVs
C:0 T:2 98891 XUs and 108374 XVs -> 4330 XUVs
C:0 T:3 52741 XUs and 48508 XVs -> 415 XUVs
C:0 T:4 8771 XUs and 8883 XVs -> 133 XUVs
C:0 T:5 26782 XUs and 33411 XVs -> 4441 XUVs
C:0 T:6 108074 XUs and 95451 XVs -> 3616 XUVs
C:0 T:7 42104 XUs and 37002 XVs -> 246 XUVs
C:0 T:8 11730 XUs and 9109 XVs -> 249 XUVs
C:0 T:9 114376 XUs and 87251 XVs -> 12846 XUVs
C:0 T:10 39425 XUs and 43716 XVs -> 3981 XUVs
C:0 T:11 176 XUs and 129 XVs -> 8 XUVs
38196 XUVs total
12129 collection wire objects
34857 potential space points
Neighbour search...
4408495 tests to find 1945856 neighbours
Iterating with no regularization...
Begin: 1.10376e+08
0 8.78435e+07
1 8.61901e+07
2 8.60348e+07
3 8.60021e+07
Now with regularization...
Begin: 7.28425e+07
0 7.27971e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411799386
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411799386
fLifetime: 30000 [us]
17-Jan-2026 22:35:39 GMT  Closed output file "reco_stage1.root"
17-Jan-2026 22:35:39 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          654.424       825.574       1153.02       820.669       149.409        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00160447    0.00478928    0.00800708    0.00441084    0.00216733       10     
reco:ophit:OpHitFinder                             0.369276      0.495806      0.570903      0.506913      0.0576505       10     
reco:opflash:OpFlashFinder                         0.277849      0.348079      0.447169      0.339382      0.0587086       10     
reco:opslicer:OpSlicer                             0.947069       1.17938       1.50871       1.14299      0.166212        10     
reco:caldata:DataPrepModule                         7.20363       9.62661       13.014        9.57815       1.88768        10     
reco:wclsdatasp:WireCellToolkit                     51.4692       69.0903       85.654        72.413        9.90362        10     
reco:gaushit:GausHitFinder                          1.45121       2.39828       2.90179       2.44851      0.389084        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000904733   0.000973684   0.00112482    0.000958326   6.08794e-05      10     
reco:reco3d:SpacePointSolver                        14.4868       29.2429       39.1009       31.9153       8.29118        10     
reco:hitpdune:DisambigFromSpacePoints               2.62397       5.22634       8.78178       5.01355       1.56937        10     
reco:pandora:StandardPandora                        45.073        78.0308       126.96        75.653        22.2046        10     
reco:pandoraWriter:StandardPandora                 0.557239       0.94091       1.23317      0.952976      0.158533        10     
reco:pandoraTrack:LArPandoraTrackCreation           9.1973        15.7436       19.0822       16.635        2.79288        10     
reco:pandoraShower:LArPandoraShowerCreation         10.4135       16.6739       25.2884       16.8587       3.80949        10     
reco:pandoracalo:Calorimetry                        4.23095       7.3447        10.678        7.59901       1.6567         10     
reco:pandoracalonosce:Calorimetry                   3.71552       7.02606       10.2838       7.16551       1.63308        10     
reco:pandorapid:Chi2ParticleID                    0.00768997     0.011671      0.0152135     0.0120742    0.00216696       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0744475     0.116873      0.152764      0.120759      0.0220595       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00640745     0.0106224     0.0136597     0.0109351    0.00202098       10     
reco:pandoraShowercalo:ShowerCalorimetry            9.0546        16.7098       27.1375       16.5707       4.62112        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       9.32605       15.8217       26.197        15.1737       4.24915        10     
reco:emtrkmichelid:EmTrackMichelId                  288.588       392.303       517.147       398.105       65.3888        10     
reco:crttag:SingleCRTMatchingProducer              0.0393221     0.0436895     0.0555282     0.0424228    0.00478178       10     
reco:crtreco:TwoCRTMatchingProducer                0.0235676     0.0342815     0.0581706     0.0328544    0.00895368       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.56763       2.23738       4.21436       2.09878      0.726743        10     
reco:pandora2Track:LArPandoraTrackCreation          38.9377       53.6903       96.5032       50.5043        15.84         10     
reco:pandora2calo:Calorimetry                       15.1338       23.0579       41.9738       21.486        7.10241        10     
reco:pandora2calonosce:Calorimetry                  14.0631       21.5327       38.4712       20.7051       6.5474         10     
reco:pandora2pid:Chi2ParticleID                    0.0200045     0.0281607     0.0385727     0.0288646    0.00491145       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.110461      0.148848      0.199762      0.152715      0.025384        10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0187909     0.0270065     0.0365974     0.0274581    0.00477055       10     
reco:pandora2Shower:LArPandoraShowerCreation        11.2417       16.0546       25.1695       15.514        4.16287        10     
reco:pandora2Showercalo:ShowerCalorimetry           10.8369       18.6754       32.834        17.486        5.96499        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      10.0935       16.5306       29.3255       15.0842       5.52216        10     
[art]:TriggerResults:TriggerResultInserter        7.0076e-05    0.000103684   0.000171013   0.000104559   2.60229e-05      10     
end_path:out1:RootOutput                             1e-05      1.55751e-05   3.3463e-05     1.326e-05    6.8899e-06       10     
end_path:out1:RootOutput(write)                     3.16491       4.95465       7.05193       5.01815       1.00644        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5667.68 MB
  Peak resident set size usage (VmHWM): 4853.74 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.36 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   6.11 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.33 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11962568
-rw-r--r-- 1 dune020 dune 2747979433 Jan 17 20:14 detsim_stage2.root
-rw-r--r-- 1 dune020 dune 2611298906 Jan 17 20:08 detsim_stage1.root
-rw-r--r-- 1 dune020 dune 2488086759 Jan 17 22:35 reco_stage1.root
-rw-r--r-- 1 dune020 dune 2194746016 Jan 17 16:34 g4_stage2.root
-rw-r--r-- 1 dune020 dune 2118588687 Jan 17 16:09 g4_stage1.root
-rw-r--r-- 1 dune020 dune   88347180 Jan 17 22:24 Pandora_Events.pndr
-rw-r--r-- 1 dune020 dune     243353 Jan 17 22:35 jobscript.log
-rw-r--r-- 1 dune020 dune     217088 Jan 17 22:35 mem.db
-rw-r--r-- 1 dune020 dune      62376 Jan 17 22:35 Pandora_Geometry.xml
-rw-r--r-- 1 dune020 dune      36864 Jan 17 22:35 time.db
-rw-r--r-- 1 dune020 dune        519 Jan 17 20:14 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Jan 17 16:34 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Jan 17 22:35 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune020 dune         52 Jan 17 15:56 all-input-dids.txt
-rw-r--r-- 1 dune020 dune          7 Jan 17 22:35 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune          0 Jan 17 20:24 ProtoDUNE.log
-rw-r--r-- 1 dune020 dune          0 Jan 17 20:14 debugprod.log
justIN time: 2026-02-05 22:02:09 UTC       justIN version: 01.06.00