Jobsub ID 226996.0@dunegpschedd02.fnal.gov
| Jobsub ID | 226996.0@dunegpschedd02.fnal.gov | 
| Workflow ID | 8826 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-10 10:17:52 | 
| Site | UK_Oxford | 
| Entry | DUNE_UK_SGrid_Oxford_arc01 | 
| Last heartbeat | 2025-10-10 15:09:40 | 
| From worker node | Hostname | t2wn009.physics.ox.ac.uk | 
| cpuinfo | AMD EPYC 7713P 64-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 257400 (71 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-10 10:18:34 | 
| Input files | monte-carlo-008826-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 4h (17355s) | 
| CPU time | 4h (16717s = 96%) | 
| Max RSS bytes | 4410195968 (4205 MiB) | 
| Outputting started | 2025-10-10 15:07:50 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/08826/1/001/reco_stage1.root
  | 
| Finished | 2025-10-10 15:09:40 | 
| Saved logs | justin-logs:226996.0-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
e:prepare:   Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 141692 traces, 0 summary
Retagger: tagging trace set: gauss with 109803 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109803 traces tagged "gauss"
FrameSaver: q=3.59613e+06 n=1936626 tag=gauss
wclsFrameSaver: saving 141692 traces tagged "wiener"
FrameSaver: q=3.79328e+06 n=1709026 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25887 XUs and 39436 XVs -> 449 XUVs
C:0 T:1 63016 XUs and 89513 XVs -> 5509 XUVs
C:0 T:2 90297 XUs and 155432 XVs -> 7297 XUVs
C:0 T:3 38410 XUs and 53406 XVs -> 403 XUVs
C:0 T:4 13904 XUs and 9369 XVs -> 63 XUVs
C:0 T:5 49489 XUs and 27587 XVs -> 3296 XUVs
C:0 T:6 111810 XUs and 121382 XVs -> 5137 XUVs
C:0 T:7 48298 XUs and 42784 XVs -> 347 XUVs
C:0 T:8 8319 XUs and 6284 XVs -> 66 XUVs
C:0 T:9 58386 XUs and 60254 XVs -> 4348 XUVs
C:0 T:10 58138 XUs and 49819 XVs -> 6190 XUVs
C:0 T:11 27 XUs and 23 XVs -> 1 XUVs
33106 XUVs total
13501 collection wire objects
30294 potential space points
Neighbour search...
1900282 tests to find 945532 neighbours
Iterating with no regularization...
Begin: 8.44514e+07
0 7.0498e+07
1 6.95612e+07
2 6.9452e+07
3 6.94217e+07
Now with regularization...
Begin: 5.98144e+07
0 5.97867e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 409803141
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409803141
fLifetime: 30000 [us]
10-Oct-2025 16:07:47 BST  Closed output file "reco_stage1.root"
10-Oct-2025 16:07:48 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          337.271       454.826       590.632       447.57        74.6349        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00130627    0.00446396    0.00897544    0.00441069    0.00241906       10     
reco:ophit:OpHitFinder                             0.301881      0.329604      0.375676      0.325714      0.0231134       10     
reco:opflash:OpFlashFinder                         0.197774       0.23169      0.300783       0.22491      0.0315143       10     
reco:opslicer:OpSlicer                             0.579538      0.762573      0.962183      0.759761      0.127094        10     
reco:caldata:DataPrepModule                         4.98598       6.24503       8.55372       5.79285       1.11236        10     
reco:wclsdatasp:WireCellToolkit                     33.8897       41.0109       49.8808       41.4624       5.49009        10     
reco:gaushit:GausHitFinder                         0.900784       1.54835       2.25322       1.50818      0.397055        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000500445   0.000640163   0.000801937   0.000650084   9.85518e-05      10     
reco:reco3d:SpacePointSolver                        10.092        19.5715       37.8415       18.1473       8.27701        10     
reco:hitpdune:DisambigFromSpacePoints               1.35524       2.12048       3.21602       2.19689      0.515199        10     
reco:pandora:StandardPandora                        22.7787       43.7982       62.5878       41.8322       10.7113        10     
reco:pandoraWriter:StandardPandora                 0.376316      0.547682      0.800012       0.54453       0.11206        10     
reco:pandoraTrack:LArPandoraTrackCreation           4.74301       6.50047       9.25679       6.11312       1.33244        10     
reco:pandoraShower:LArPandoraShowerCreation         3.25483       6.50059       10.7507       5.96047       2.09216        10     
reco:pandoracalo:Calorimetry                        2.20503       3.59784       5.53387       3.28489       1.14798        10     
reco:pandoracalonosce:Calorimetry                   2.15618       3.46652       5.05908       3.42623      0.999232        10     
reco:pandorapid:Chi2ParticleID                    0.00536147    0.00803121     0.0121601    0.00762327     0.0022589       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0441027     0.196992       1.30003      0.0754581     0.368597        10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00513602    0.00815194     0.0124649    0.00864317    0.00240191       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.73892       7.61162       11.8761       6.49543       2.77409        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.70857       7.42286       11.1901       6.29339       2.56007        10     
reco:emtrkmichelid:EmTrackMichelId                  198.649       238.112       292.268       238.456       29.1248        10     
reco:crttag:SingleCRTMatchingProducer             0.00980838     0.0165891     0.0244531     0.0158224    0.00438639       10     
reco:crtreco:TwoCRTMatchingProducer               0.00834144     0.011796      0.017514      0.0105399    0.00296751       10     
reco:anodepiercerst0:T0RecoAnodePiercers            0.79596       1.10883       1.46259       1.09094       0.19037        10     
reco:pandora2Track:LArPandoraTrackCreation          11.4054       19.5908       34.663        20.413        6.32261        10     
reco:pandora2calo:Calorimetry                       5.72125       9.96479       15.8172       10.4917       3.03873        10     
reco:pandora2calonosce:Calorimetry                  5.35616        9.054        12.8532       9.23009       2.45315        10     
reco:pandora2pid:Chi2ParticleID                    0.0104873     0.0180895     0.0302224     0.0152318    0.00638222       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0525759     0.0836226     0.134756      0.0735482     0.0272396       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0110195     0.0162125     0.0249591     0.0148013    0.00456106       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.5769        6.75825       10.2096       6.19989        2.249         10     
reco:pandora2Showercalo:ShowerCalorimetry           4.67005       8.16255       12.7436       7.3694        2.73185        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.35416       6.88882       10.646        6.26864       2.08656        10     
[art]:TriggerResults:TriggerResultInserter        3.2462e-05    5.27887e-05   0.000141623   4.27725e-05   3.07863e-05      10     
end_path:out1:RootOutput                           4.789e-06    7.1576e-06    1.0951e-05    6.4675e-06    1.70749e-06      10     
end_path:out1:RootOutput(write)                     2.56293       3.37921       4.37766       3.4012       0.587335        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5242.11 MB
  Peak resident set size usage (VmHWM): 4410.2 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.27 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.05 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.16 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10518196
-rw-r--r-- 1 dune020 dune 2464082224 Oct 10 14:49 detsim_stage2.root
-rw-r--r-- 1 dune020 dune 2338267170 Oct 10 14:47 detsim_stage1.root
-rw-r--r-- 1 dune020 dune 2168280936 Oct 10 16:07 reco_stage1.root
-rw-r--r-- 1 dune020 dune 1900652042 Oct 10 11:45 g4_stage2.root
-rw-r--r-- 1 dune020 dune 1818995576 Oct 10 11:27 g4_stage1.root
-rw-r--r-- 1 dune020 dune   79728460 Oct 10 16:01 Pandora_Events.pndr
-rw-r--r-- 1 dune020 dune     243053 Oct 10 16:07 jobscript.log
-rw-r--r-- 1 dune020 dune     217088 Oct 10 16:07 mem.db
-rw-r--r-- 1 dune020 dune      62376 Oct 10 16:07 Pandora_Geometry.xml
-rw-r--r-- 1 dune020 dune      36864 Oct 10 16:07 time.db
-rw-r--r-- 1 dune020 dune        519 Oct 10 14:49 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Oct 10 11:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune020 dune        519 Oct 10 16:07 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune020 dune         52 Oct 10 11:18 all-input-dids.txt
-rw-r--r-- 1 dune020 dune          7 Oct 10 16:07 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune          0 Oct 10 14:55 ProtoDUNE.log
-rw-r--r-- 1 dune020 dune          0 Oct 10 14:49 debugprod.log