Jobsub ID 238691.0@dunegpschedd01.fnal.gov
| Jobsub ID | 238691.0@dunegpschedd01.fnal.gov | 
| Workflow ID | 9362 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-26 21:35:09 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce03 | 
| Last heartbeat | 2025-10-27 03:11:10 | 
| From worker node | Hostname | cn039.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-26 21:47:32 | 
| Input files | monte-carlo-009362-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 5h (19203s) | 
| CPU time | 5h (18901s = 98%) | 
| Max RSS bytes | 4367077376 (4164 MiB) | 
| Outputting started | 2025-10-27 03:07:36 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09362/1/001/reco_stage1.root
  | 
| Finished | 2025-10-27 03:11:10 | 
| Saved logs | justin-logs:238691.0-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
oolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 167117 traces, 0 summary
Retagger: tagging trace set: gauss with 127967 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 127967 traces tagged "gauss"
FrameSaver: q=4.45894e+06 n=2370183 tag=gauss
wclsFrameSaver: saving 167117 traces tagged "wiener"
FrameSaver: q=4.71037e+06 n=2116289 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39492 XUs and 48518 XVs -> 497 XUVs
C:0 T:1 98576 XUs and 110278 XVs -> 7817 XUVs
C:0 T:2 111214 XUs and 161191 XVs -> 6323 XUVs
C:0 T:3 50833 XUs and 61169 XVs -> 552 XUVs
C:0 T:4 15991 XUs and 14202 XVs -> 229 XUVs
C:0 T:5 104333 XUs and 99629 XVs -> 24645 XUVs
C:0 T:6 231482 XUs and 141306 XVs -> 12298 XUVs
C:0 T:7 73209 XUs and 46502 XVs -> 640 XUVs
C:0 T:8 9735 XUs and 8926 XVs -> 121 XUVs
C:0 T:9 81124 XUs and 110789 XVs -> 16747 XUVs
C:0 T:10 69544 XUs and 44329 XVs -> 4486 XUVs
C:0 T:11 456 XUs and 402 XVs -> 50 XUVs
74405 XUVs total
17133 collection wire objects
69062 potential space points
Neighbour search...
14703564 tests to find 6073242 neighbours
Iterating with no regularization...
Begin: 7.81635e+07
0 6.31231e+07
1 6.19674e+07
2 6.17915e+07
3 6.1741e+07
Now with regularization...
Begin: 5.02218e+07
0 5.01494e+07
1 5.01049e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410134491
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410134491
fLifetime: 30000 [us]
27-Oct-2025 03:07:32 GMT  Closed output file "reco_stage1.root"
27-Oct-2025 03:07:32 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          647.145       808.574       1058.06       755.935       136.44         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00163012    0.00571642     0.0121692    0.00576099    0.00284676       10     
reco:ophit:OpHitFinder                              0.25475      0.342073      0.453821       0.33965      0.0557051       10     
reco:opflash:OpFlashFinder                         0.218235       0.27875      0.363329      0.278098      0.0446727       10     
reco:opslicer:OpSlicer                             0.571982      0.905032       1.22497       0.93082       0.20319        10     
reco:caldata:DataPrepModule                         5.12439       7.67299       8.95908       8.16109       1.27582        10     
reco:wclsdatasp:WireCellToolkit                     52.2748       67.4419       76.0755       70.1372       8.55024        10     
reco:gaushit:GausHitFinder                          1.36389       2.06382       2.65328       2.0942       0.337703        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000918468   0.00138391    0.00179437    0.00140459    0.00022273       10     
reco:reco3d:SpacePointSolver                        10.2237        21.99        30.0668       23.0606       5.54256        10     
reco:hitpdune:DisambigFromSpacePoints               2.10598       3.50053       4.44292       3.52443      0.604877        10     
reco:pandora:StandardPandora                        48.399        72.619        126.661       64.7774       21.617         10     
reco:pandoraWriter:StandardPandora                 0.694193      0.817935       1.02462      0.819923      0.0957325       10     
reco:pandoraTrack:LArPandoraTrackCreation           15.2798       19.7424       23.2101       20.1863       2.71487        10     
reco:pandoraShower:LArPandoraShowerCreation         15.3604       23.155        30.3828       22.5249       4.75744        10     
reco:pandoracalo:Calorimetry                        7.97071       9.67608       11.8716       9.25176       1.34211        10     
reco:pandoracalonosce:Calorimetry                   7.70277       9.32854       11.2589       9.01517       1.40847        10     
reco:pandorapid:Chi2ParticleID                    0.00622732     0.010003      0.0180189    0.00977999    0.00306977       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.058152      0.0995597     0.153249      0.0907024     0.0284867       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00561136    0.00936938     0.0140002    0.00900554    0.00232806       10     
reco:pandoraShowercalo:ShowerCalorimetry            16.8145       24.912        39.2472       24.7575       6.87439        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       16.3217       23.4381       32.0708       23.9521       5.25324        10     
reco:emtrkmichelid:EmTrackMichelId                  186.883       310.92        407.425       314.765       71.5471        10     
reco:crttag:SingleCRTMatchingProducer              0.043918      0.0511073     0.0608628     0.0511817    0.00556825       10     
reco:crtreco:TwoCRTMatchingProducer                0.0377873     0.0428549     0.0504295     0.0416775    0.00420958       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.3688        1.67123       2.39247       1.51864      0.307445        10     
reco:pandora2Track:LArPandoraTrackCreation          44.5105       67.0434       99.8637       60.1711       16.9558        10     
reco:pandora2calo:Calorimetry                       23.0551       32.6823       46.5593       31.0674       8.14617        10     
reco:pandora2calonosce:Calorimetry                  18.4418       30.4149       48.4223       28.3719       8.53826        10     
reco:pandora2pid:Chi2ParticleID                    0.0126395     0.021319      0.033368      0.0202768    0.00652625       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0719916     0.117676       0.19176      0.107722      0.0346201       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0120152     0.020658      0.0336392     0.0194648    0.00662845       10     
reco:pandora2Shower:LArPandoraShowerCreation        12.5607       20.3435       30.209        19.5425       4.81466        10     
reco:pandora2Showercalo:ShowerCalorimetry           16.0378       27.9256       41.3434       27.6763       7.28257        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      13.458        24.9419       35.5535       24.3815       6.17414        10     
[art]:TriggerResults:TriggerResultInserter         6.103e-05    8.62607e-05   0.000149462   8.0957e-05    2.2559e-05       10     
end_path:out1:RootOutput                           9.091e-06    1.2586e-05    1.4887e-05    1.25795e-05   1.55677e-06      10     
end_path:out1:RootOutput(write)                     2.37871       4.0882        5.39206       3.92769      0.869683        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5176.22 MB
  Peak resident set size usage (VmHWM): 4367.08 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.93 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.22 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11127252
-rw-r--r-- 1 pildune32 pildune 2574675771 Oct 27 00:49 detsim_stage2.root
-rw-r--r-- 1 pildune32 pildune 2440149620 Oct 27 00:46 detsim_stage1.root
-rw-r--r-- 1 pildune32 pildune 2291364133 Oct 27 03:07 reco_stage1.root
-rw-r--r-- 1 pildune32 pildune 2046573859 Oct 26 22:18 g4_stage2.root
-rw-r--r-- 1 pildune32 pildune 1958835839 Oct 26 21:57 g4_stage1.root
-rw-r--r-- 1 pildune32 pildune   82092910 Oct 27 02:53 Pandora_Events.pndr
-rw-r--r-- 1 pildune32 pildune     242789 Oct 27 03:07 jobscript.log
-rw-r--r-- 1 pildune32 pildune     217088 Oct 27 03:07 mem.db
-rw-r--r-- 1 pildune32 pildune      62376 Oct 27 03:07 Pandora_Geometry.xml
-rw-r--r-- 1 pildune32 pildune      36864 Oct 27 03:07 time.db
-rw-r--r-- 1 pildune32 pildune        519 Oct 27 00:50 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 26 22:18 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 27 03:07 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune32 pildune         52 Oct 26 21:47 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune          7 Oct 27 03:07 justin-processed-pfns.txt
-rw-r--r-- 1 pildune32 pildune          0 Oct 27 01:02 ProtoDUNE.log
-rw-r--r-- 1 pildune32 pildune          0 Oct 27 00:50 debugprod.log