Jobsub ID 239087.1@dunegpschedd01.fnal.gov
| Jobsub ID | 239087.1@dunegpschedd01.fnal.gov | 
| Workflow ID | 9399 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-28 06:21:51 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce02 | 
| Last heartbeat | 2025-10-28 10:40:27 | 
| From worker node | Hostname | cn032.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-28 06:23:20 | 
| Input files | monte-carlo-009399-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 4h (15214s) | 
| CPU time | 4h (14928s = 98%) | 
| Max RSS bytes | 4305362944 (4105 MiB) | 
| Outputting started | 2025-10-28 10:36:55 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09399/1/001/reco_stage1.root
  | 
| Finished | 2025-10-28 10:40:27 | 
| Saved logs | justin-logs:239087.1-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130343 traces, 0 summary
Retagger: tagging trace set: gauss with 99512 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 99512 traces tagged "gauss"
FrameSaver: q=3.28164e+06 n=1773627 tag=gauss
wclsFrameSaver: saving 130343 traces tagged "wiener"
FrameSaver: q=3.47216e+06 n=1568077 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28012 XUs and 33349 XVs -> 229 XUVs
C:0 T:1 59716 XUs and 68911 XVs -> 3895 XUVs
C:0 T:2 64805 XUs and 89628 XVs -> 4626 XUVs
C:0 T:3 33618 XUs and 34402 XVs -> 296 XUVs
C:0 T:4 17608 XUs and 16546 XVs -> 218 XUVs
C:0 T:5 64481 XUs and 53128 XVs -> 7336 XUVs
C:0 T:6 93562 XUs and 89129 XVs -> 4000 XUVs
C:0 T:7 40005 XUs and 37501 XVs -> 374 XUVs
C:0 T:8 7943 XUs and 5599 XVs -> 58 XUVs
C:0 T:9 57268 XUs and 56051 XVs -> 5685 XUVs
C:0 T:10 50253 XUs and 42122 XVs -> 7311 XUVs
C:0 T:11 471 XUs and 444 XVs -> 21 XUVs
34049 XUVs total
12025 collection wire objects
31510 potential space points
Neighbour search...
2261538 tests to find 1190642 neighbours
Iterating with no regularization...
Begin: 4.97003e+07
0 3.93248e+07
1 3.85004e+07
2 3.83834e+07
3 3.83501e+07
Now with regularization...
Begin: 2.99029e+07
0 2.98756e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410161937
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410161937
fLifetime: 30000 [us]
28-Oct-2025 10:36:51 GMT  Closed output file "reco_stage1.root"
28-Oct-2025 10:36:51 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          458.086       744.259       1019.1        775.039       147.238        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00092363    0.00490571     0.0112398    0.00491827    0.00269237       10     
reco:ophit:OpHitFinder                             0.249694      0.418904      0.553355      0.428502      0.0907513       10     
reco:opflash:OpFlashFinder                         0.194667      0.256313      0.328904      0.253958      0.0369969       10     
reco:opslicer:OpSlicer                             0.541037      0.965009       1.38212      0.957819      0.228074        10     
reco:caldata:DataPrepModule                         5.06808       8.7962        10.0782       9.62097       1.86089        10     
reco:wclsdatasp:WireCellToolkit                     43.8484       68.2182       78.9902       73.262        12.2578        10     
reco:gaushit:GausHitFinder                          1.16805       1.9826        2.49026       2.01527      0.395862        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000902014   0.00106771    0.00129857    0.00103808    0.000148132      10     
reco:reco3d:SpacePointSolver                        11.764        24.7097       38.4679       23.0241       8.86348        10     
reco:hitpdune:DisambigFromSpacePoints               1.84942       3.5463        5.75024       3.79299       1.09738        10     
reco:pandora:StandardPandora                        37.5539       61.034        115.555       59.5577       21.177         10     
reco:pandoraWriter:StandardPandora                 0.505106      0.830743       1.14103      0.880368      0.198255        10     
reco:pandoraTrack:LArPandoraTrackCreation           11.0322       16.1854       24.4365       15.9435       3.80377        10     
reco:pandoraShower:LArPandoraShowerCreation         11.0049       17.3091       24.7317       17.4853       3.81256        10     
reco:pandoracalo:Calorimetry                        4.89784       7.82621       11.4986       7.98361       1.95308        10     
reco:pandoracalonosce:Calorimetry                   4.79546       7.52709       11.2628       7.63382       1.8911         10     
reco:pandorapid:Chi2ParticleID                    0.00565818    0.00936949     0.0128839     0.009451     0.00241665       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP          0.05608      0.0965543     0.136071      0.0959424     0.0258181       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00535816    0.00903342     0.0125162    0.00911597    0.00215406       10     
reco:pandoraShowercalo:ShowerCalorimetry            10.0743       17.6919       26.3506       17.8318       4.68211        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       9.92593       17.4042       26.1866       17.6334       4.69316        10     
reco:emtrkmichelid:EmTrackMichelId                  195.442       317.453       418.843       343.115       59.0337        10     
reco:crttag:SingleCRTMatchingProducer              0.0325193     0.0411034     0.0624472     0.038783     0.00860243       10     
reco:crtreco:TwoCRTMatchingProducer                0.0289674     0.0355983     0.0462372     0.0349778    0.00511122       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.1397        1.59227       2.39181       1.44826      0.351954        10     
reco:pandora2Track:LArPandoraTrackCreation          33.9897       52.7149       72.2931       53.6745       12.2907        10     
reco:pandora2calo:Calorimetry                       14.6531       25.7486       35.563        26.3576        6.96          10     
reco:pandora2calonosce:Calorimetry                  14.4611       25.0409       34.4519       26.0335       6.69623        10     
reco:pandora2pid:Chi2ParticleID                    0.0123757     0.0254674     0.0333338     0.0265812    0.00557271       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.070739      0.141005      0.187094      0.146888      0.0338998       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.012256      0.0247826     0.033843      0.0255744    0.00681655       10     
reco:pandora2Shower:LArPandoraShowerCreation        10.6706       18.5036       25.3273       19.7512        4.397         10     
reco:pandora2Showercalo:ShowerCalorimetry           12.0839       22.7621       31.6019       23.8794       6.05022        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      10.5341       20.6707       29.9926       21.9681       5.69134        10     
[art]:TriggerResults:TriggerResultInserter        5.5573e-05    8.17107e-05   0.000113616   8.2101e-05    1.52069e-05      10     
end_path:out1:RootOutput                           9.002e-06    1.03635e-05   1.2299e-05    1.02515e-05   8.62281e-07      10     
end_path:out1:RootOutput(write)                     2.49237       4.45574       5.61311       4.73779      0.821621        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5106.41 MB
  Peak resident set size usage (VmHWM): 4305.36 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.32 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.26 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.29 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10260916
-rw-r--r-- 1 pildune22 pildune 2402589461 Oct 28 08:29 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2280966283 Oct 28 08:27 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2096285412 Oct 28 10:36 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 1862132016 Oct 28 06:51 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1788111749 Oct 28 06:32 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   76480270 Oct 28 10:26 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     242903 Oct 28 10:36 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Oct 28 10:36 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Oct 28 10:36 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Oct 28 10:36 time.db
-rw-r--r-- 1 pildune22 pildune        519 Oct 28 08:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 28 06:51 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 28 10:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Oct 28 06:23 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Oct 28 10:36 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Oct 28 08:36 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Oct 28 08:30 debugprod.log