Jobsub ID 233494.1@dunegpschedd02.fnal.gov
| Jobsub ID | 233494.1@dunegpschedd02.fnal.gov | 
| Workflow ID | 9398 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-28 06:21:51 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce03 | 
| Last heartbeat | 2025-10-28 10:40:00 | 
| From worker node | Hostname | cn517.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-28 06:22:37 | 
| Input files | monte-carlo-009398-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 4h (15227s) | 
| CPU time | 4h (15000s = 98%) | 
| Max RSS bytes | 4169207808 (3976 MiB) | 
| Outputting started | 2025-10-28 10:36:25 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09398/1/001/reco_stage1.root
  | 
| Finished | 2025-10-28 10:40:00 | 
| Saved logs | justin-logs:233494.1-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
ng tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 133456 traces, 0 summary
Retagger: tagging trace set: gauss with 98180 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98180 traces tagged "gauss"
FrameSaver: q=3.58855e+06 n=1699756 tag=gauss
wclsFrameSaver: saving 133456 traces tagged "wiener"
FrameSaver: q=3.82821e+06 n=1502467 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39450 XUs and 28958 XVs -> 385 XUVs
C:0 T:1 83993 XUs and 63471 XVs -> 6646 XUVs
C:0 T:2 103124 XUs and 108109 XVs -> 4956 XUVs
C:0 T:3 52581 XUs and 50927 XVs -> 712 XUVs
C:0 T:4 16250 XUs and 13526 XVs -> 142 XUVs
C:0 T:5 52943 XUs and 38619 XVs -> 4156 XUVs
C:0 T:6 149630 XUs and 120020 XVs -> 17855 XUVs
C:0 T:7 45468 XUs and 40835 XVs -> 966 XUVs
C:0 T:8 6019 XUs and 6482 XVs -> 106 XUVs
C:0 T:9 28607 XUs and 40229 XVs -> 3019 XUVs
C:0 T:10 23597 XUs and 16462 XVs -> 6219 XUVs
C:0 T:11 249 XUs and 181 XVs -> 61 XUVs
45223 XUVs total
10751 collection wire objects
40889 potential space points
Neighbour search...
5055549 tests to find 2499118 neighbours
Iterating with no regularization...
Begin: 5.75711e+07
0 4.8145e+07
1 4.72598e+07
2 4.71245e+07
3 4.70872e+07
Now with regularization...
Begin: 3.67439e+07
0 3.67142e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410161950
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410161950
fLifetime: 30000 [us]
28-Oct-2025 10:36:21 GMT  Closed output file "reco_stage1.root"
28-Oct-2025 10:36:21 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          400.172       620.742       789.737       600.529       114.304        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00143841    0.00444089    0.00689255     0.0043301     0.0017441       10     
reco:ophit:OpHitFinder                             0.306376      0.368294       0.39634      0.382513      0.029081        10     
reco:opflash:OpFlashFinder                         0.250301      0.297907      0.346104      0.297419      0.0351287       10     
reco:opslicer:OpSlicer                             0.651217      0.870312      0.993359       0.9027       0.126723        10     
reco:caldata:DataPrepModule                         7.31404       7.84466       9.00949       7.58205      0.558057        10     
reco:wclsdatasp:WireCellToolkit                     58.5968       62.9982       64.7499       63.3118       1.71498        10     
reco:gaushit:GausHitFinder                          1.4387        1.87729       2.25661       1.84052      0.261366        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000660201   0.000882821   0.00108826    0.000883691   0.000124827      10     
reco:reco3d:SpacePointSolver                        9.44775       40.8299       189.352       20.8382       51.4081        10     
reco:hitpdune:DisambigFromSpacePoints               1.75829       2.98427       5.01293       2.91494      0.863636        10     
reco:pandora:StandardPandora                        28.2365       55.5394       74.9385       58.7413       15.8455        10     
reco:pandoraWriter:StandardPandora                 0.524889       0.68886      0.842605      0.686299      0.0981285       10     
reco:pandoraTrack:LArPandoraTrackCreation           8.41937       13.0758       18.0009       12.5619       2.90831        10     
reco:pandoraShower:LArPandoraShowerCreation         7.07203       14.9385       22.0497       13.3896       4.38084        10     
reco:pandoracalo:Calorimetry                        3.73801       6.23314       8.6778        5.68096       1.51292        10     
reco:pandoracalonosce:Calorimetry                   3.59192       5.89148       8.23421       5.46102       1.40973        10     
reco:pandorapid:Chi2ParticleID                    0.00743697    0.00841772    0.00920887    0.00872178    0.000650938      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0710243     0.0846494     0.107706      0.0819323     0.0111996       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00692911    0.00787887    0.00871608    0.00790731    0.00064817       10     
reco:pandoraShowercalo:ShowerCalorimetry            5.92129       13.9021       21.4917       12.7665       4.63759        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       5.76492       13.5675       20.9655       12.5689       4.32305        10     
reco:emtrkmichelid:EmTrackMichelId                  187.947       249.786       307.65        242.187       35.8387        10     
reco:crttag:SingleCRTMatchingProducer              0.024588      0.0343451     0.041977      0.0344375    0.00517413       10     
reco:crtreco:TwoCRTMatchingProducer                0.0213091     0.0300047     0.0371768     0.0301946    0.00501561       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.34921       1.83317       2.26919       1.80085      0.294658        10     
reco:pandora2Track:LArPandoraTrackCreation          22.0512       41.6944       58.2398       38.5783       11.2496        10     
reco:pandora2calo:Calorimetry                       8.81955       18.6615       27.1219       17.3893       5.42119        10     
reco:pandora2calonosce:Calorimetry                  8.34327       18.0417       26.2123       16.7748       5.48275        10     
reco:pandora2pid:Chi2ParticleID                    0.0136475     0.0185873     0.0226037     0.0183342    0.00296977       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0801577     0.109418      0.175699       0.10073      0.0262185       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0141562     0.0180912     0.0229889     0.0180552    0.00268078       10     
reco:pandora2Shower:LArPandoraShowerCreation        7.47646       14.0367       19.9776       13.4584       3.49558        10     
reco:pandora2Showercalo:ShowerCalorimetry           7.47139       16.0666       22.8958       15.0509       4.64523        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      6.06253       14.556        21.9411       13.6333       4.76435        10     
[art]:TriggerResults:TriggerResultInserter         5.621e-05    8.01733e-05   0.000154544   6.85995e-05   2.71915e-05      10     
end_path:out1:RootOutput                           9.088e-06    1.13188e-05    1.595e-05    1.0459e-05    2.24064e-06      10     
end_path:out1:RootOutput(write)                     2.79462       3.63081       4.79466       3.48409      0.583805        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 4970.12 MB
  Peak resident set size usage (VmHWM): 4169.21 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.28 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.85 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.27 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10233184
-rw-r--r-- 1 pildune32 pildune 2390634309 Oct 28 08:50 detsim_stage2.root
-rw-r--r-- 1 pildune32 pildune 2266714481 Oct 28 08:47 detsim_stage1.root
-rw-r--r-- 1 pildune32 pildune 2071499298 Oct 28 10:36 reco_stage1.root
-rw-r--r-- 1 pildune32 pildune 1878596919 Oct 28 06:52 g4_stage2.root
-rw-r--r-- 1 pildune32 pildune 1796896339 Oct 28 06:30 g4_stage1.root
-rw-r--r-- 1 pildune32 pildune   73824540 Oct 28 10:28 Pandora_Events.pndr
-rw-r--r-- 1 pildune32 pildune     242944 Oct 28 10:36 jobscript.log
-rw-r--r-- 1 pildune32 pildune     217088 Oct 28 10:36 mem.db
-rw-r--r-- 1 pildune32 pildune      62376 Oct 28 10:36 Pandora_Geometry.xml
-rw-r--r-- 1 pildune32 pildune      36864 Oct 28 10:36 time.db
-rw-r--r-- 1 pildune32 pildune        519 Oct 28 08:50 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 28 06:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 28 10:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune32 pildune         52 Oct 28 06:22 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune          7 Oct 28 10:36 justin-processed-pfns.txt
-rw-r--r-- 1 pildune32 pildune          0 Oct 28 08:58 ProtoDUNE.log
-rw-r--r-- 1 pildune32 pildune          0 Oct 28 08:50 debugprod.log