Jobsub ID 232084.0@dunegpschedd01.fnal.gov
| Jobsub ID | 232084.0@dunegpschedd01.fnal.gov | 
| Workflow ID | 8779 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-09 13:42:48 | 
| Site | UK_Oxford | 
| Entry | DUNE_UK_SGrid_Oxford_arc01 | 
| Last heartbeat | 2025-10-09 16:21:10 | 
| From worker node | Hostname | t2wn176.physics.ox.ac.uk | 
| cpuinfo | AMD EPYC 9655 96-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 257400 (71 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-09 13:43:36 | 
| Input files | monte-carlo-008779-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 2h (9358s) | 
| CPU time | 2h (9061s = 96%) | 
| Max RSS bytes | 4764024832 (4543 MiB) | 
| Outputting started | 2025-10-09 16:19:35 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/08779/1/001/reco_stage1.root
  | 
| Finished | 2025-10-09 16:21:10 | 
| Saved logs | justin-logs:232084.0-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
nning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 153069 traces, 0 summary
Retagger: tagging trace set: gauss with 118713 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 118713 traces tagged "gauss"
FrameSaver: q=3.99664e+06 n=2082570 tag=gauss
wclsFrameSaver: saving 153069 traces tagged "wiener"
FrameSaver: q=4.20034e+06 n=1833998 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35203 XUs and 31068 XVs -> 379 XUVs
C:0 T:1 68321 XUs and 64825 XVs -> 5050 XUVs
C:0 T:2 92554 XUs and 114236 XVs -> 4458 XUVs
C:0 T:3 46704 XUs and 50534 XVs -> 207 XUVs
C:0 T:4 15286 XUs and 12223 XVs -> 129 XUVs
C:0 T:5 64609 XUs and 44701 XVs -> 7140 XUVs
C:0 T:6 119648 XUs and 128426 XVs -> 4425 XUVs
C:0 T:7 49004 XUs and 51678 XVs -> 391 XUVs
C:0 T:8 9731 XUs and 10709 XVs -> 197 XUVs
C:0 T:9 111966 XUs and 115074 XVs -> 18798 XUVs
C:0 T:10 40227 XUs and 22657 XVs -> 4507 XUVs
C:0 T:11 391 XUs and 267 XVs -> 36 XUVs
45717 XUVs total
14100 collection wire objects
42626 potential space points
Neighbour search...
5534194 tests to find 2414534 neighbours
Iterating with no regularization...
Begin: 7.5551e+07
0 6.62859e+07
1 6.56031e+07
2 6.55113e+07
3 6.5486e+07
Now with regularization...
Begin: 5.36425e+07
0 5.36079e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 409785940
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409785940
fLifetime: 30000 [us]
09-Oct-2025 17:19:33 BST  Closed output file "reco_stage1.root"
09-Oct-2025 17:19:33 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          266.12        347.947       440.258       322.138       51.0519        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000993796    0.0038497     0.0052697    0.00429836    0.00143423       10     
reco:ophit:OpHitFinder                             0.254691      0.289613      0.340735       0.28924      0.0229069       10     
reco:opflash:OpFlashFinder                         0.127474      0.166592      0.189881      0.169686      0.0181641       10     
reco:opslicer:OpSlicer                             0.566036      0.677628      0.872413      0.668329      0.0955373       10     
reco:caldata:DataPrepModule                         3.76889       4.55478       5.15141       4.68027      0.440037        10     
reco:wclsdatasp:WireCellToolkit                     23.6464       27.4364       30.2577        27.9         2.2237         10     
reco:gaushit:GausHitFinder                         0.894126       1.20156       1.6249        1.15842      0.224093        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000261186   0.000370832   0.000614261   0.000342814   0.000109773      10     
reco:reco3d:SpacePointSolver                        10.6938       19.2983       28.5411       20.2841       5.01606        10     
reco:hitpdune:DisambigFromSpacePoints               1.01815       1.81516       2.86448       1.84192      0.604865        10     
reco:pandora:StandardPandora                        30.3858       40.6885       69.3696       37.706        11.1693        10     
reco:pandoraWriter:StandardPandora                  0.39694       0.55254      0.727878      0.553643      0.084084        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.72342       5.79907       8.4217        5.88534       1.49386        10     
reco:pandoraShower:LArPandoraShowerCreation         3.3878        6.11625       10.9644       5.36766       2.48252        10     
reco:pandoracalo:Calorimetry                        1.85908       2.73476       3.91043       2.80236      0.680062        10     
reco:pandoracalonosce:Calorimetry                   1.53725       2.87174       3.82271       2.80135      0.828043        10     
reco:pandorapid:Chi2ParticleID                    0.00334922    0.00580274     0.007762     0.00582408    0.00118834       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0313924     0.0600738     0.0755469     0.0632401     0.0134016       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00334096    0.00546869    0.00741841    0.00541524    0.00101937       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.78992       6.10363       9.12861       5.30353       1.7087         10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.52185       5.90232       9.13731       5.62409       1.63122        10     
reco:emtrkmichelid:EmTrackMichelId                  134.365       165.254       195.76        161.624       19.1377        10     
reco:crttag:SingleCRTMatchingProducer              0.0130913     0.0182619     0.0232061     0.0189969    0.00339905       10     
reco:crtreco:TwoCRTMatchingProducer                0.0078054     0.012071      0.0182935     0.010447     0.00328891       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.552108      0.657653      0.839911      0.633104      0.0822751       10     
reco:pandora2Track:LArPandoraTrackCreation          11.2574       19.2644       29.1699       16.1704       5.67133        10     
reco:pandora2calo:Calorimetry                       4.24823       7.95238       13.3325       6.92628       2.50897        10     
reco:pandora2calonosce:Calorimetry                  4.55156       7.57368       10.7131       7.46425       1.76137        10     
reco:pandora2pid:Chi2ParticleID                   0.00888965     0.0139437     0.0182913     0.0143347     0.0024894       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0416834     0.0777833     0.111804      0.0770499     0.0192635       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00872724     0.0131961     0.0182478     0.0137964    0.00280606       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.45484       5.56466       7.73207       5.5907        1.33836        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.70888       6.23381       7.78116       6.18145      0.982821        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.09966       5.84323       8.69878       5.46616       1.39052        10     
[art]:TriggerResults:TriggerResultInserter           4e-05      6.45488e-05   0.000154314   4.86235e-05   3.22783e-05      10     
end_path:out1:RootOutput                           7.651e-06    1.04798e-05   1.6916e-05    9.9605e-06    2.50831e-06      10     
end_path:out1:RootOutput(write)                     2.51316       3.00134       3.56033       2.95484      0.312043        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5628.61 MB
  Peak resident set size usage (VmHWM): 4764.02 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.87 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11659500
-rw-r--r-- 1 dune020 dune 2690356554 Oct  9 16:19 detsim_stage2.root
-rw-r--r-- 1 dune020 dune 2552805642 Oct  9 16:17 detsim_stage1.root
-rw-r--r-- 1 dune020 dune 2435318233 Oct  9 17:19 reco_stage1.root
-rw-r--r-- 1 dune020 dune 2122604903 Oct  9 15:00 g4_stage2.root
-rw-r--r-- 1 dune020 dune 2048056257 Oct  9 14:49 g4_stage1.root
-rw-r--r-- 1 dune020 dune   89551020 Oct  9 17:15 Pandora_Events.pndr
-rw-r--r-- 1 dune020 dune     243151 Oct  9 17:19 jobscript.log
-rw-r--r-- 1 dune020 dune     217088 Oct  9 17:19 mem.db
-rw-r--r-- 1 dune020 dune      62376 Oct  9 17:19 Pandora_Geometry.xml
-rw-r--r-- 1 dune020 dune      36864 Oct  9 17:19 time.db
-rw-r--r-- 1 dune020 dune        519 Oct  9 16:19 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Oct  9 15:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Oct  9 17:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune020 dune         52 Oct  9 14:43 all-input-dids.txt
-rw-r--r-- 1 dune020 dune          7 Oct  9 17:19 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune          0 Oct  9 16:24 ProtoDUNE.log
-rw-r--r-- 1 dune020 dune          0 Oct  9 16:19 debugprod.log