justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232084.0@dunegpschedd01.fnal.gov

Jobsub ID232084.0@dunegpschedd01.fnal.gov
Workflow ID8779
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-09 13:42:48
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2025-10-09 16:21:10
From worker nodeHostnamet2wn176.physics.ox.ac.uk
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-09 13:43:36
Input filesmonte-carlo-008779-000001
JobscriptExit code0
Real time2h (9358s)
CPU time2h (9061s = 96%)
Max RSS bytes4764024832 (4543 MiB)
Outputting started2025-10-09 16:19:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/08779/1/001/reco_stage1.root
Finished2025-10-09 16:21:10
Saved logsjustin-logs:232084.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

nning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 153069 traces, 0 summary
Retagger: tagging trace set: gauss with 118713 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 118713 traces tagged "gauss"
FrameSaver: q=3.99664e+06 n=2082570 tag=gauss
wclsFrameSaver: saving 153069 traces tagged "wiener"
FrameSaver: q=4.20034e+06 n=1833998 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35203 XUs and 31068 XVs -> 379 XUVs
C:0 T:1 68321 XUs and 64825 XVs -> 5050 XUVs
C:0 T:2 92554 XUs and 114236 XVs -> 4458 XUVs
C:0 T:3 46704 XUs and 50534 XVs -> 207 XUVs
C:0 T:4 15286 XUs and 12223 XVs -> 129 XUVs
C:0 T:5 64609 XUs and 44701 XVs -> 7140 XUVs
C:0 T:6 119648 XUs and 128426 XVs -> 4425 XUVs
C:0 T:7 49004 XUs and 51678 XVs -> 391 XUVs
C:0 T:8 9731 XUs and 10709 XVs -> 197 XUVs
C:0 T:9 111966 XUs and 115074 XVs -> 18798 XUVs
C:0 T:10 40227 XUs and 22657 XVs -> 4507 XUVs
C:0 T:11 391 XUs and 267 XVs -> 36 XUVs
45717 XUVs total
14100 collection wire objects
42626 potential space points
Neighbour search...
5534194 tests to find 2414534 neighbours
Iterating with no regularization...
Begin: 7.5551e+07
0 6.62859e+07
1 6.56031e+07
2 6.55113e+07
3 6.5486e+07
Now with regularization...
Begin: 5.36425e+07
0 5.36079e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 409785940
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409785940
fLifetime: 30000 [us]
09-Oct-2025 17:19:33 BST  Closed output file "reco_stage1.root"
09-Oct-2025 17:19:33 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          266.12        347.947       440.258       322.138       51.0519        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000993796    0.0038497     0.0052697    0.00429836    0.00143423       10     
reco:ophit:OpHitFinder                             0.254691      0.289613      0.340735       0.28924      0.0229069       10     
reco:opflash:OpFlashFinder                         0.127474      0.166592      0.189881      0.169686      0.0181641       10     
reco:opslicer:OpSlicer                             0.566036      0.677628      0.872413      0.668329      0.0955373       10     
reco:caldata:DataPrepModule                         3.76889       4.55478       5.15141       4.68027      0.440037        10     
reco:wclsdatasp:WireCellToolkit                     23.6464       27.4364       30.2577        27.9         2.2237         10     
reco:gaushit:GausHitFinder                         0.894126       1.20156       1.6249        1.15842      0.224093        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000261186   0.000370832   0.000614261   0.000342814   0.000109773      10     
reco:reco3d:SpacePointSolver                        10.6938       19.2983       28.5411       20.2841       5.01606        10     
reco:hitpdune:DisambigFromSpacePoints               1.01815       1.81516       2.86448       1.84192      0.604865        10     
reco:pandora:StandardPandora                        30.3858       40.6885       69.3696       37.706        11.1693        10     
reco:pandoraWriter:StandardPandora                  0.39694       0.55254      0.727878      0.553643      0.084084        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.72342       5.79907       8.4217        5.88534       1.49386        10     
reco:pandoraShower:LArPandoraShowerCreation         3.3878        6.11625       10.9644       5.36766       2.48252        10     
reco:pandoracalo:Calorimetry                        1.85908       2.73476       3.91043       2.80236      0.680062        10     
reco:pandoracalonosce:Calorimetry                   1.53725       2.87174       3.82271       2.80135      0.828043        10     
reco:pandorapid:Chi2ParticleID                    0.00334922    0.00580274     0.007762     0.00582408    0.00118834       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0313924     0.0600738     0.0755469     0.0632401     0.0134016       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00334096    0.00546869    0.00741841    0.00541524    0.00101937       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.78992       6.10363       9.12861       5.30353       1.7087         10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.52185       5.90232       9.13731       5.62409       1.63122        10     
reco:emtrkmichelid:EmTrackMichelId                  134.365       165.254       195.76        161.624       19.1377        10     
reco:crttag:SingleCRTMatchingProducer              0.0130913     0.0182619     0.0232061     0.0189969    0.00339905       10     
reco:crtreco:TwoCRTMatchingProducer                0.0078054     0.012071      0.0182935     0.010447     0.00328891       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.552108      0.657653      0.839911      0.633104      0.0822751       10     
reco:pandora2Track:LArPandoraTrackCreation          11.2574       19.2644       29.1699       16.1704       5.67133        10     
reco:pandora2calo:Calorimetry                       4.24823       7.95238       13.3325       6.92628       2.50897        10     
reco:pandora2calonosce:Calorimetry                  4.55156       7.57368       10.7131       7.46425       1.76137        10     
reco:pandora2pid:Chi2ParticleID                   0.00888965     0.0139437     0.0182913     0.0143347     0.0024894       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0416834     0.0777833     0.111804      0.0770499     0.0192635       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00872724     0.0131961     0.0182478     0.0137964    0.00280606       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.45484       5.56466       7.73207       5.5907        1.33836        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.70888       6.23381       7.78116       6.18145      0.982821        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.09966       5.84323       8.69878       5.46616       1.39052        10     
[art]:TriggerResults:TriggerResultInserter           4e-05      6.45488e-05   0.000154314   4.86235e-05   3.22783e-05      10     
end_path:out1:RootOutput                           7.651e-06    1.04798e-05   1.6916e-05    9.9605e-06    2.50831e-06      10     
end_path:out1:RootOutput(write)                     2.51316       3.00134       3.56033       2.95484      0.312043        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5628.61 MB
  Peak resident set size usage (VmHWM): 4764.02 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.87 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11659500
-rw-r--r-- 1 dune020 dune 2690356554 Oct  9 16:19 detsim_stage2.root
-rw-r--r-- 1 dune020 dune 2552805642 Oct  9 16:17 detsim_stage1.root
-rw-r--r-- 1 dune020 dune 2435318233 Oct  9 17:19 reco_stage1.root
-rw-r--r-- 1 dune020 dune 2122604903 Oct  9 15:00 g4_stage2.root
-rw-r--r-- 1 dune020 dune 2048056257 Oct  9 14:49 g4_stage1.root
-rw-r--r-- 1 dune020 dune   89551020 Oct  9 17:15 Pandora_Events.pndr
-rw-r--r-- 1 dune020 dune     243151 Oct  9 17:19 jobscript.log
-rw-r--r-- 1 dune020 dune     217088 Oct  9 17:19 mem.db
-rw-r--r-- 1 dune020 dune      62376 Oct  9 17:19 Pandora_Geometry.xml
-rw-r--r-- 1 dune020 dune      36864 Oct  9 17:19 time.db
-rw-r--r-- 1 dune020 dune        519 Oct  9 16:19 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Oct  9 15:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Oct  9 17:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune020 dune         52 Oct  9 14:43 all-input-dids.txt
-rw-r--r-- 1 dune020 dune          7 Oct  9 17:19 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune          0 Oct  9 16:24 ProtoDUNE.log
-rw-r--r-- 1 dune020 dune          0 Oct  9 16:19 debugprod.log
justIN time: 2025-11-04 01:31:04 UTC       justIN version: 01.05.01