Jobsub ID 239088.1@dunegpschedd01.fnal.gov
| Jobsub ID | 239088.1@dunegpschedd01.fnal.gov | 
| Workflow ID | 9401 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-28 06:21:51 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce03 | 
| Last heartbeat | 2025-10-28 09:45:29 | 
| From worker node | Hostname | cn049.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-28 06:22:48 | 
| Input files | monte-carlo-009401-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 3h (11962s) | 
| CPU time | 3h (11775s = 98%) | 
| Max RSS bytes | 4278542336 (4080 MiB) | 
| Outputting started | 2025-10-28 09:42:12 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09401/1/001/reco_stage1.root
  | 
| Finished | 2025-10-28 09:45:29 | 
| Saved logs | justin-logs:239088.1-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 136687 traces, 0 summary
Retagger: tagging trace set: gauss with 99236 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 99236 traces tagged "gauss"
FrameSaver: q=3.51655e+06 n=1689800 tag=gauss
wclsFrameSaver: saving 136687 traces tagged "wiener"
FrameSaver: q=3.75703e+06 n=1475394 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 50264 XUs and 47622 XVs -> 826 XUVs
C:0 T:1 108965 XUs and 103761 XVs -> 7925 XUVs
C:0 T:2 68018 XUs and 87385 XVs -> 6237 XUVs
C:0 T:3 35482 XUs and 38120 XVs -> 270 XUVs
C:0 T:4 13937 XUs and 13299 XVs -> 167 XUVs
C:0 T:5 70431 XUs and 55239 XVs -> 7718 XUVs
C:0 T:6 51431 XUs and 51362 XVs -> 1509 XUVs
C:0 T:7 23802 XUs and 20300 XVs -> 205 XUVs
C:0 T:8 9278 XUs and 7348 XVs -> 66 XUVs
C:0 T:9 62419 XUs and 76377 XVs -> 5701 XUVs
C:0 T:10 22021 XUs and 19332 XVs -> 3386 XUVs
C:0 T:11 150 XUs and 98 XVs -> 16 XUVs
34026 XUVs total
11300 collection wire objects
31449 potential space points
Neighbour search...
2416285 tests to find 1224572 neighbours
Iterating with no regularization...
Begin: 8.62914e+07
0 7.09293e+07
1 7.00025e+07
2 6.98735e+07
3 6.98342e+07
Now with regularization...
Begin: 6.0063e+07
0 6.00352e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410161914
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410161914
fLifetime: 30000 [us]
28-Oct-2025 09:42:09 GMT  Closed output file "reco_stage1.root"
28-Oct-2025 09:42:09 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          326.823       482.811       731.516       448.206       125.022        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00170741    0.00345602    0.00509561    0.00367913    0.00104355       10     
reco:ophit:OpHitFinder                             0.244405      0.267411      0.313716      0.256984      0.0240872       10     
reco:opflash:OpFlashFinder                         0.193962       0.22998       0.29168      0.212376      0.034388        10     
reco:opslicer:OpSlicer                             0.537437      0.634089      0.821059      0.589943      0.0901194       10     
reco:caldata:DataPrepModule                         4.96491       5.21265       6.03977       5.09368      0.311885        10     
reco:wclsdatasp:WireCellToolkit                     44.1195       47.6644       54.6591       46.7019       3.21902        10     
reco:gaushit:GausHitFinder                          1.10416       1.36908       1.79596       1.39579      0.220588        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000651359   0.00091893    0.00165315    0.000839591   0.000266839      10     
reco:reco3d:SpacePointSolver                        7.57145       14.7217       28.1101       11.3312       7.11882        10     
reco:hitpdune:DisambigFromSpacePoints               1.24564       2.2868        3.74093       1.92727      0.821236        10     
reco:pandora:StandardPandora                        22.9351       43.244        83.7112       40.1455       18.1909        10     
reco:pandoraWriter:StandardPandora                 0.391389      0.517777      0.664134      0.499045      0.0840467       10     
reco:pandoraTrack:LArPandoraTrackCreation           6.28104       11.9815       19.1781       11.1777       3.58379        10     
reco:pandoraShower:LArPandoraShowerCreation         8.15242       16.0054       28.2133       14.888         5.929         10     
reco:pandoracalo:Calorimetry                        2.51476       5.42345       8.7464        5.13848       1.79227        10     
reco:pandoracalonosce:Calorimetry                   2.41156       5.18519       8.48386       4.92117       1.75087        10     
reco:pandorapid:Chi2ParticleID                    0.00425613    0.00589739    0.00868314    0.00553122    0.00121933       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.048676      0.0616625     0.0761024     0.0583579    0.00906398       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00420963     0.0055957    0.00744339     0.0053674    0.000892911      10     
reco:pandoraShowercalo:ShowerCalorimetry            6.66944       14.1771       25.968        13.5101       6.0312         10     
reco:pandoraShowercalonosce:ShowerCalorimetry       6.43992       13.7895       25.2367       13.2282       5.92198        10     
reco:emtrkmichelid:EmTrackMichelId                   140.6        180.607       235.904       168.371       31.5198        10     
reco:crttag:SingleCRTMatchingProducer              0.022674      0.0322106     0.0414712     0.0323009    0.00591654       10     
reco:crtreco:TwoCRTMatchingProducer                0.0200728     0.0287774     0.0352516     0.0292163    0.00526371       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.776196       1.1954        1.5654        1.24262      0.259894        10     
reco:pandora2Track:LArPandoraTrackCreation          23.8146       41.5268        73.26        38.5132       15.0116        10     
reco:pandora2calo:Calorimetry                       8.66121       17.7085       31.967        16.5989       7.28722        10     
reco:pandora2calonosce:Calorimetry                  8.38901       16.7499       30.0248       15.6694       6.86455        10     
reco:pandora2pid:Chi2ParticleID                    0.0102702      0.01372      0.0193436     0.0130488    0.00288467       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.053296      0.0778317      0.10536      0.0747412     0.0150787       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00998882     0.0133189     0.0181857     0.0129226    0.00257377       10     
reco:pandora2Shower:LArPandoraShowerCreation        8.16811       13.1678       21.9179       12.4639       4.11205        10     
reco:pandora2Showercalo:ShowerCalorimetry           7.28284       14.1938       24.3409       13.4526       5.50939        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      6.3639        11.9332       20.8668       11.4907       4.71152        10     
[art]:TriggerResults:TriggerResultInserter        4.2633e-05    5.84677e-05   0.000136808   4.8934e-05    2.66049e-05      10     
end_path:out1:RootOutput                           6.087e-06    7.1028e-06    1.2049e-05     6.567e-06    1.69137e-06      10     
end_path:out1:RootOutput(write)                     1.87318       2.58681       3.58483       2.40333      0.541935        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5078 MB
  Peak resident set size usage (VmHWM): 4278.54 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.22 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10814056
-rw-r--r-- 1 pildune32 pildune 2518378214 Oct 28 08:19 detsim_stage2.root
-rw-r--r-- 1 pildune32 pildune 2387808805 Oct 28 08:17 detsim_stage1.root
-rw-r--r-- 1 pildune32 pildune 2222280837 Oct 28 09:42 reco_stage1.root
-rw-r--r-- 1 pildune32 pildune 1981909682 Oct 28 06:48 g4_stage2.root
-rw-r--r-- 1 pildune32 pildune 1883184058 Oct 28 06:29 g4_stage1.root
-rw-r--r-- 1 pildune32 pildune   79415510 Oct 28 09:37 Pandora_Events.pndr
-rw-r--r-- 1 pildune32 pildune     242779 Oct 28 09:42 jobscript.log
-rw-r--r-- 1 pildune32 pildune     217088 Oct 28 09:42 mem.db
-rw-r--r-- 1 pildune32 pildune      62376 Oct 28 09:42 Pandora_Geometry.xml
-rw-r--r-- 1 pildune32 pildune      36864 Oct 28 09:42 time.db
-rw-r--r-- 1 pildune32 pildune        519 Oct 28 08:19 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 28 06:48 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 28 09:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune32 pildune         52 Oct 28 06:22 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune          7 Oct 28 09:42 justin-processed-pfns.txt
-rw-r--r-- 1 pildune32 pildune          0 Oct 28 08:28 ProtoDUNE.log
-rw-r--r-- 1 pildune32 pildune          0 Oct 28 08:19 debugprod.log