Jobsub ID 241906.1@dunegpschedd01.fnal.gov
| Jobsub ID | 241906.1@dunegpschedd01.fnal.gov | 
| Workflow ID | 9523 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-11-02 07:19:15 | 
| Site | UK_Manchester | 
| Entry | UBoone_T2_UK_Manchester_ce02 | 
| Last heartbeat | 2025-11-02 13:31:23 | 
| From worker node | Hostname | wn1205081.tier2.hep.manchester.ac.uk | 
| cpuinfo | AMD EPYC 7702P 64-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 257400 (71 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-11-02 07:20:12 | 
| Input files | monte-carlo-009523-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 6h (22165s) | 
| CPU time | 5h (21355s = 96%) | 
| Max RSS bytes | 4303704064 (4104 MiB) | 
| Outputting started | 2025-11-02 13:29:38 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09523/1/001/reco_stage1.root
  | 
| Finished | 2025-11-02 13:31:23 | 
| Saved logs | justin-logs:241906.1-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 116868 traces, 0 summary
Retagger: tagging trace set: gauss with 88200 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88200 traces tagged "gauss"
FrameSaver: q=3.09782e+06 n=1529795 tag=gauss
wclsFrameSaver: saving 116868 traces tagged "wiener"
FrameSaver: q=3.29843e+06 n=1346706 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30905 XUs and 32151 XVs -> 487 XUVs
C:0 T:1 50572 XUs and 49724 XVs -> 4887 XUVs
C:0 T:2 123927 XUs and 127405 XVs -> 7316 XUVs
C:0 T:3 59957 XUs and 55120 XVs -> 692 XUVs
C:0 T:4 6273 XUs and 8823 XVs -> 38 XUVs
C:0 T:5 19821 XUs and 20456 XVs -> 2227 XUVs
C:0 T:6 195196 XUs and 90556 XVs -> 11380 XUVs
C:0 T:7 39253 XUs and 31249 XVs -> 391 XUVs
C:0 T:8 4083 XUs and 3527 XVs -> 32 XUVs
C:0 T:9 26829 XUs and 23587 XVs -> 1714 XUVs
C:0 T:10 131673 XUs and 49817 XVs -> 14683 XUVs
C:0 T:11 140 XUs and 98 XVs -> 12 XUVs
43859 XUVs total
9918 collection wire objects
40485 potential space points
Neighbour search...
5959693 tests to find 2782326 neighbours
Iterating with no regularization...
Begin: 7.06677e+07
0 6.01264e+07
1 5.94991e+07
2 5.94008e+07
3 5.93731e+07
Now with regularization...
Begin: 4.98251e+07
0 4.97862e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410263065
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410263065
fLifetime: 30000 [us]
02-Nov-2025 13:29:35 GMT  Closed output file "reco_stage1.root"
02-Nov-2025 13:29:35 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          560.355       823.04        1308.16       785.132       207.739        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00219065     0.0081693     0.0227141    0.00686596    0.00562111       10     
reco:ophit:OpHitFinder                             0.397471       0.45377      0.556929      0.442805      0.0488837       10     
reco:opflash:OpFlashFinder                         0.223823      0.288203      0.438117      0.268911      0.0601733       10     
reco:opslicer:OpSlicer                              0.96735       1.26501       1.5106        1.27965      0.160608        10     
reco:caldata:DataPrepModule                         8.58309       9.08118       10.1385       8.99447      0.429244        10     
reco:wclsdatasp:WireCellToolkit                     57.1702       65.7331       68.2405       67.3856       3.41996        10     
reco:gaushit:GausHitFinder                          1.78967       2.31879       3.29441       2.2218       0.427891        10     
reco:nhitsfilter:NumberOfHitsFilter               0.00127006    0.00165454    0.00210391    0.00156633    0.000272399      10     
reco:reco3d:SpacePointSolver                        19.0952       33.5531       56.8182       31.9703       10.7313        10     
reco:hitpdune:DisambigFromSpacePoints               1.82241       3.29066       6.17564       2.99633       1.14517        10     
reco:pandora:StandardPandora                        51.7992       81.1725       191.244       69.7067       38.7983        10     
reco:pandoraWriter:StandardPandora                 0.806443      0.996698       1.49861       0.98724      0.192336        10     
reco:pandoraTrack:LArPandoraTrackCreation           9.61699       13.7388       19.7737       13.6026       3.10953        10     
reco:pandoraShower:LArPandoraShowerCreation         7.83404       15.7239       29.4897       15.0694       6.06702        10     
reco:pandoracalo:Calorimetry                        5.18725       8.13502       12.4723       8.2453        2.24732        10     
reco:pandoracalonosce:Calorimetry                   4.94994       7.84894       12.5314       8.05852       2.29355        10     
reco:pandorapid:Chi2ParticleID                    0.00775955     0.011692      0.0151457     0.011817     0.00216229       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0854202     0.114114      0.154549      0.105165      0.0241329       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00981486     0.0116506     0.0150265     0.0115172    0.00137109       10     
reco:pandoraShowercalo:ShowerCalorimetry            7.63156       18.3068       38.0756       16.7373       8.67124        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       6.41174       17.1788       33.6858       16.758        7.7237         10     
reco:emtrkmichelid:EmTrackMichelId                  296.83        394.424       555.143       382.503       72.9058        10     
reco:crttag:SingleCRTMatchingProducer              0.0268307     0.0438358     0.0813375     0.0378079     0.0171116       10     
reco:crtreco:TwoCRTMatchingProducer                0.020509      0.0288976     0.0396104     0.0276349    0.00617241       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.15171       1.5481        2.02433       1.49344      0.297708        10     
reco:pandora2Track:LArPandoraTrackCreation          25.1801       42.029        78.042        37.8266       15.4835        10     
reco:pandora2calo:Calorimetry                       9.7951        23.3681       46.0552       24.0944       10.6564        10     
reco:pandora2calonosce:Calorimetry                  9.42062       22.581        42.2314       21.9784       9.68371        10     
reco:pandora2pid:Chi2ParticleID                    0.022612      0.0285065     0.0376812     0.0281033    0.00422079       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP         0.10428      0.144898       0.19829      0.143211      0.026481        10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0233432     0.0279491     0.0392777     0.0276012    0.00467301       10     
reco:pandora2Shower:LArPandoraShowerCreation        7.03115       14.7459       25.2877       14.5365       5.23719        10     
reco:pandora2Showercalo:ShowerCalorimetry           7.73036       20.4624       39.0984       21.0082       9.22646        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      6.7688        18.7727       32.6376       19.7384       7.94571        10     
[art]:TriggerResults:TriggerResultInserter        3.8022e-05    7.30227e-05   0.000193705   5.7944e-05    4.20092e-05      10     
end_path:out1:RootOutput                           7.595e-06    9.7426e-06    1.7483e-05     9.017e-06    2.80907e-06      10     
end_path:out1:RootOutput(write)                     4.18296       5.30591       7.32123       5.06673      0.987025        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5151.02 MB
  Peak resident set size usage (VmHWM): 4303.7 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.39 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.76 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.23 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10313076
-rw-r--r-- 1 dune01 dune01 2421756561 Nov  2 11:08 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2299999022 Nov  2 11:04 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2112811999 Nov  2 13:29 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1865496207 Nov  2 07:52 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1783552820 Nov  2 07:30 g4_stage1.root
-rw-r--r-- 1 dune01 dune01   76337490 Nov  2 13:21 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01     242840 Nov  2 13:29 jobscript.log
-rw-r--r-- 1 dune01 dune01     217088 Nov  2 13:29 mem.db
-rw-r--r-- 1 dune01 dune01      62376 Nov  2 13:29 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01      36864 Nov  2 13:29 time.db
-rw-r--r-- 1 dune01 dune01        519 Nov  2 11:08 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01        519 Nov  2 07:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01        519 Nov  2 13:29 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01         52 Nov  2 07:20 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01          7 Nov  2 13:29 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01          0 Nov  2 11:18 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01          0 Nov  2 11:08 debugprod.log