Jobsub ID 238590.0@dunegpschedd01.fnal.gov
| Jobsub ID | 238590.0@dunegpschedd01.fnal.gov | 
| Workflow ID | 9347 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-26 07:14:19 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce02 | 
| Last heartbeat | 2025-10-26 10:51:16 | 
| From worker node | Hostname | cn028.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-26 07:15:06 | 
| Input files | monte-carlo-009347-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 3h (12766s) | 
| CPU time | 3h (12551s = 98%) | 
| Max RSS bytes | 4212961280 (4017 MiB) | 
| Outputting started | 2025-10-26 10:47:53 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09347/1/001/reco_stage1.root
  | 
| Finished | 2025-10-26 10:51:16 | 
| Saved logs | justin-logs:238590.0-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
eToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 129529 traces, 0 summary
Retagger: tagging trace set: gauss with 104544 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 104544 traces tagged "gauss"
FrameSaver: q=3.73509e+06 n=1983863 tag=gauss
wclsFrameSaver: saving 129529 traces tagged "wiener"
FrameSaver: q=3.93597e+06 n=1810353 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38360 XUs and 34834 XVs -> 556 XUVs
C:0 T:1 71283 XUs and 55851 XVs -> 5483 XUVs
C:0 T:2 94052 XUs and 156827 XVs -> 5738 XUVs
C:0 T:3 43731 XUs and 52686 XVs -> 471 XUVs
C:0 T:4 16849 XUs and 17056 XVs -> 209 XUVs
C:0 T:5 53407 XUs and 42081 XVs -> 4382 XUVs
C:0 T:6 95956 XUs and 96655 XVs -> 7384 XUVs
C:0 T:7 41981 XUs and 39948 XVs -> 423 XUVs
C:0 T:8 11883 XUs and 12885 XVs -> 439 XUVs
C:0 T:9 148166 XUs and 247499 XVs -> 27158 XUVs
C:0 T:10 24276 XUs and 11657 XVs -> 2156 XUVs
C:0 T:11 131 XUs and 94 XVs -> 11 XUVs
54410 XUVs total
11509 collection wire objects
49836 potential space points
Neighbour search...
7839556 tests to find 3584790 neighbours
Iterating with no regularization...
Begin: 8.02784e+07
0 6.21465e+07
1 6.09689e+07
2 6.07886e+07
3 6.07318e+07
Now with regularization...
Begin: 5.13081e+07
0 5.12429e+07
1 5.11949e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410122356
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410122356
fLifetime: 30000 [us]
26-Oct-2025 10:47:50 GMT  Closed output file "reco_stage1.root"
26-Oct-2025 10:47:50 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          419.577       640.114       817.918        634.4        132.024        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                             0.0016023    0.00466247     0.0111482    0.00457779    0.00250534       10     
reco:ophit:OpHitFinder                             0.225918      0.288402      0.447634      0.258644      0.069658        10     
reco:opflash:OpFlashFinder                          0.15836      0.221137      0.326453      0.217202      0.0463038       10     
reco:opslicer:OpSlicer                             0.490285      0.736835       1.23932       0.62093      0.241869        10     
reco:caldata:DataPrepModule                         5.05165       6.18614       8.93284       5.19193       1.39912        10     
reco:wclsdatasp:WireCellToolkit                     47.7377       52.8062       58.0924       52.5597       3.57703        10     
reco:gaushit:GausHitFinder                          1.05558       1.53486       2.25735       1.50113      0.329653        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000763306   0.00105684    0.00125895    0.00110504    0.000162923      10     
reco:reco3d:SpacePointSolver                        12.3938       22.3949       43.3599       20.8973       8.56401        10     
reco:hitpdune:DisambigFromSpacePoints                1.613        2.76605       5.85711       2.40215       1.19949        10     
reco:pandora:StandardPandora                        33.3698       68.3308       95.7711       68.6029       22.1632        10     
reco:pandoraWriter:StandardPandora                 0.448707      0.638989      0.883373      0.603361      0.149466        10     
reco:pandoraTrack:LArPandoraTrackCreation           10.6667       15.7412       26.1087       14.9179       4.11554        10     
reco:pandoraShower:LArPandoraShowerCreation         12.2606       18.8841       30.0114       16.7215       5.56066        10     
reco:pandoracalo:Calorimetry                        5.01075       7.93221       12.9136       7.32275       2.24978        10     
reco:pandoracalonosce:Calorimetry                   4.92494       7.68381       12.6835       7.05968       2.21973        10     
reco:pandorapid:Chi2ParticleID                    0.00501583    0.00807305     0.0110212     0.0084331    0.00230492       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0461944     0.0765118     0.108138      0.0740445     0.0207778       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00466848    0.00740458     0.0106594    0.00688745    0.00205515       10     
reco:pandoraShowercalo:ShowerCalorimetry            11.6904       19.8011       33.8772       17.6644       7.13145        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       11.6003       18.7135       31.5514       16.3365       6.26052        10     
reco:emtrkmichelid:EmTrackMichelId                  152.993       227.317       318.541       208.381       52.7365        10     
reco:crttag:SingleCRTMatchingProducer              0.0270368     0.0406444     0.0482909     0.041945     0.00593526       10     
reco:crtreco:TwoCRTMatchingProducer                0.0244889     0.0357516     0.0439069     0.0353052    0.00557034       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.901353       1.39875       1.93217       1.35661      0.309828        10     
reco:pandora2Track:LArPandoraTrackCreation          34.4665       53.5298       75.8565       48.3826       13.7917        10     
reco:pandora2calo:Calorimetry                       15.7485       25.5572       34.6107       23.3976       6.47349        10     
reco:pandora2calonosce:Calorimetry                  14.9665       24.0538       32.5882       22.1108       6.78908        10     
reco:pandora2pid:Chi2ParticleID                    0.011113      0.0197762     0.0420178     0.0170345     0.0088748       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0633282     0.107374      0.170546      0.0952075     0.0369872       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0112792     0.0184048     0.0290442     0.0166508    0.00631817       10     
reco:pandora2Shower:LArPandoraShowerCreation        11.8213       17.286        28.4276       16.2286       4.75162        10     
reco:pandora2Showercalo:ShowerCalorimetry           13.5698       22.7135       39.7045        19.26        7.74664        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      12.0449       19.7777       36.0892       16.9879       7.50288        10     
[art]:TriggerResults:TriggerResultInserter        5.1455e-05    7.78007e-05   0.000137504   5.8384e-05     3.246e-05       10     
end_path:out1:RootOutput                           8.198e-06    1.0589e-05    1.5632e-05    9.5685e-06    2.41419e-06      10     
end_path:out1:RootOutput(write)                     2.15165       3.27041       5.2833        2.75919       1.15102        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5015.65 MB
  Peak resident set size usage (VmHWM): 4212.96 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.24 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.81 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10266308
-rw-r--r-- 1 pildune22 pildune 2416940833 Oct 26 08:58 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2293537951 Oct 26 08:56 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2124424395 Oct 26 10:47 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 1832189159 Oct 26 07:35 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1765242101 Oct 26 07:21 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   79752330 Oct 26 10:37 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     243180 Oct 26 10:47 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Oct 26 10:47 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Oct 26 10:47 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Oct 26 10:47 time.db
-rw-r--r-- 1 pildune22 pildune        519 Oct 26 08:58 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 26 07:35 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 26 10:47 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Oct 26 07:15 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Oct 26 10:47 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Oct 26 09:06 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Oct 26 08:58 debugprod.log