Jobsub ID 230529.0@dunegpschedd02.fnal.gov
| Jobsub ID | 230529.0@dunegpschedd02.fnal.gov | 
| Workflow ID | 9141 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-18 15:33:29 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce03 | 
| Last heartbeat | 2025-10-18 21:03:51 | 
| From worker node | Hostname | cn114.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-18 15:34:15 | 
| Input files | monte-carlo-009141-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 5h (19549s) | 
| CPU time | 5h (19244s = 98%) | 
| Max RSS bytes | 4528525312 (4318 MiB) | 
| Outputting started | 2025-10-18 21:00:05 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09141/1/001/reco_stage1.root
  | 
| Finished | 2025-10-18 21:03:51 | 
| Saved logs | justin-logs:230529.0-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
unning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 133571 traces, 0 summary
Retagger: tagging trace set: gauss with 105746 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105746 traces tagged "gauss"
FrameSaver: q=3.60727e+06 n=1893046 tag=gauss
wclsFrameSaver: saving 133571 traces tagged "wiener"
FrameSaver: q=3.78606e+06 n=1692767 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27100 XUs and 42071 XVs -> 383 XUVs
C:0 T:1 61110 XUs and 68429 XVs -> 3979 XUVs
C:0 T:2 155218 XUs and 160950 XVs -> 6442 XUVs
C:0 T:3 76647 XUs and 67688 XVs -> 527 XUVs
C:0 T:4 12082 XUs and 11997 XVs -> 73 XUVs
C:0 T:5 39328 XUs and 29057 XVs -> 2593 XUVs
C:0 T:6 80269 XUs and 64578 XVs -> 2206 XUVs
C:0 T:7 35544 XUs and 27343 XVs -> 240 XUVs
C:0 T:8 4614 XUs and 5886 XVs -> 68 XUVs
C:0 T:9 22044 XUs and 33019 XVs -> 1723 XUVs
C:0 T:10 79623 XUs and 37451 XVs -> 5261 XUVs
C:0 T:11 568 XUs and 330 XVs -> 55 XUVs
23550 XUVs total
10561 collection wire objects
21605 potential space points
Neighbour search...
730289 tests to find 373272 neighbours
Iterating with no regularization...
Begin: 8.30188e+07
0 6.74992e+07
1 6.66076e+07
2 6.65059e+07
3 6.64788e+07
Now with regularization...
Begin: 5.70878e+07
0 5.70847e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 409968501
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409968501
fLifetime: 30000 [us]
18-Oct-2025 22:00:01 BST  Closed output file "reco_stage1.root"
18-Oct-2025 22:00:01 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          595.574       895.559       1221.16       909.472       158.512        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                             0.0011684    0.00500222    0.00769649    0.00533422     0.0020418       10     
reco:ophit:OpHitFinder                             0.267492      0.438866      0.532668      0.441645      0.0735547       10     
reco:opflash:OpFlashFinder                         0.216683      0.310413      0.411601      0.322926      0.0664797       10     
reco:opslicer:OpSlicer                             0.611589       0.99739       1.33835      0.956526      0.251452        10     
reco:caldata:DataPrepModule                         5.66312       8.27988       9.68472       8.79624       1.20221        10     
reco:wclsdatasp:WireCellToolkit                     59.0783        74.27        86.4459       75.6235       8.20702        10     
reco:gaushit:GausHitFinder                          1.64905       2.49018       3.05665       2.48456      0.493775        10     
reco:nhitsfilter:NumberOfHitsFilter               0.00105256    0.00135764    0.00182058    0.00131989    0.000223437      10     
reco:reco3d:SpacePointSolver                        15.6079       32.868        49.7739       33.8914       8.98353        10     
reco:hitpdune:DisambigFromSpacePoints               2.38051       5.00206       6.75409       5.12024       1.42478        10     
reco:pandora:StandardPandora                        40.7129       98.8668       136.371       101.491       27.5643        10     
reco:pandoraWriter:StandardPandora                 0.725449      0.942455       1.05297      0.972139      0.109261        10     
reco:pandoraTrack:LArPandoraTrackCreation           10.8001       22.7724       29.5535       22.8957       5.12193        10     
reco:pandoraShower:LArPandoraShowerCreation         11.4048       25.1051       36.2834       25.1612       6.94191        10     
reco:pandoracalo:Calorimetry                        4.87995       11.2264       14.2398       11.4216       2.54096        10     
reco:pandoracalonosce:Calorimetry                    4.568        10.9298       13.5823       11.2582       2.41254        10     
reco:pandorapid:Chi2ParticleID                    0.00931543     0.012815      0.0177011     0.0120156    0.00269035       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0823613     0.116852      0.170808      0.111446      0.0281528       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00694058     0.0128334     0.0169705     0.0129375     0.0028195       10     
reco:pandoraShowercalo:ShowerCalorimetry            11.0847       26.991        38.6361       26.917        8.63233        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       11.3732       26.4334       38.018        26.2156       8.46603        10     
reco:emtrkmichelid:EmTrackMichelId                  253.513       317.779       412.452       319.109       44.6558        10     
reco:crttag:SingleCRTMatchingProducer              0.0424028     0.052399      0.0667378     0.050531     0.00831016       10     
reco:crtreco:TwoCRTMatchingProducer                0.0313857     0.0434864     0.0575887     0.0433706    0.00659942       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.32206       2.08618       2.90449       1.91634      0.500399        10     
reco:pandora2Track:LArPandoraTrackCreation          39.2815       73.7371       122.024       69.444        21.8316        10     
reco:pandora2calo:Calorimetry                       18.7022       36.1779       58.9547       34.0563       10.8627        10     
reco:pandora2calonosce:Calorimetry                  17.9494       33.7633       55.1878       31.8739       10.3968        10     
reco:pandora2pid:Chi2ParticleID                    0.0160629     0.0302082     0.0413727     0.0330696    0.00828605       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0861299     0.150839      0.208414      0.157729      0.0395098       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0153292     0.0289305     0.0405934     0.0311694    0.00877507       10     
reco:pandora2Shower:LArPandoraShowerCreation        14.1312       21.3962       31.2031       19.9384       5.9858         10     
reco:pandora2Showercalo:ShowerCalorimetry           17.3294       30.4092       47.4707       28.8178       9.25899        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      16.2901       26.9331       42.8627       23.9722       8.42799        10     
[art]:TriggerResults:TriggerResultInserter        5.3143e-05    9.70143e-05   0.000191628   8.6172e-05    3.77801e-05      10     
end_path:out1:RootOutput                           9.049e-06    1.29069e-05   1.8395e-05    1.23115e-05   3.27409e-06      10     
end_path:out1:RootOutput(write)                     2.84045        4.616        6.37642       4.84071       1.04856        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5335.37 MB
  Peak resident set size usage (VmHWM): 4528.53 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.31 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.00 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.27 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11273168
-rw-r--r-- 1 pildune32 pildune 2608085808 Oct 18 19:27 detsim_stage2.root
-rw-r--r-- 1 pildune32 pildune 2475260730 Oct 18 19:23 detsim_stage1.root
-rw-r--r-- 1 pildune32 pildune 2336786543 Oct 18 22:00 reco_stage1.root
-rw-r--r-- 1 pildune32 pildune 2063105294 Oct 18 17:07 g4_stage2.root
-rw-r--r-- 1 pildune32 pildune 1974446568 Oct 18 16:42 g4_stage1.root
-rw-r--r-- 1 pildune32 pildune   85429320 Oct 18 21:49 Pandora_Events.pndr
-rw-r--r-- 1 pildune32 pildune     243672 Oct 18 22:00 jobscript.log
-rw-r--r-- 1 pildune32 pildune     217088 Oct 18 22:00 mem.db
-rw-r--r-- 1 pildune32 pildune      62376 Oct 18 22:00 Pandora_Geometry.xml
-rw-r--r-- 1 pildune32 pildune      36864 Oct 18 22:00 time.db
-rw-r--r-- 1 pildune32 pildune        519 Oct 18 19:27 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 18 17:07 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune32 pildune        519 Oct 18 22:00 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune32 pildune         52 Oct 18 16:34 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune          7 Oct 18 22:00 justin-processed-pfns.txt
-rw-r--r-- 1 pildune32 pildune          0 Oct 18 19:36 ProtoDUNE.log
-rw-r--r-- 1 pildune32 pildune          0 Oct 18 19:27 debugprod.log