Jobsub ID 236250.1@dunegpschedd02.fnal.gov
| Jobsub ID | 236250.1@dunegpschedd02.fnal.gov | 
| Workflow ID | 9522 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-11-02 07:19:15 | 
| Site | UK_Manchester | 
| Entry | UBoone_T2_UK_Manchester_ce02 | 
| Last heartbeat | 2025-11-02 13:08:35 | 
| From worker node | Hostname | wn1904251.tier2.hep.manchester.ac.uk | 
| cpuinfo | AMD EPYC 7513 32-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 257400 (71 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-11-02 07:20:27 | 
| Input files | monte-carlo-009522-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 5h (20774s) | 
| CPU time | 5h (20124s = 96%) | 
| Max RSS bytes | 4539363328 (4329 MiB) | 
| Outputting started | 2025-11-02 13:06:43 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09522/1/001/reco_stage1.root
  | 
| Finished | 2025-11-02 13:08:35 | 
| Saved logs | justin-logs:236250.1-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
olBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 135635 traces, 0 summary
Retagger: tagging trace set: gauss with 102117 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102117 traces tagged "gauss"
FrameSaver: q=3.46615e+06 n=1782123 tag=gauss
wclsFrameSaver: saving 135635 traces tagged "wiener"
FrameSaver: q=3.66629e+06 n=1559336 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25690 XUs and 19145 XVs -> 135 XUVs
C:0 T:1 46319 XUs and 38108 XVs -> 3495 XUVs
C:0 T:2 180893 XUs and 133907 XVs -> 10026 XUVs
C:0 T:3 59738 XUs and 41799 XVs -> 564 XUVs
C:0 T:4 13937 XUs and 9820 XVs -> 99 XUVs
C:0 T:5 39365 XUs and 22021 XVs -> 3062 XUVs
C:0 T:6 123818 XUs and 116099 XVs -> 6301 XUVs
C:0 T:7 47536 XUs and 41836 XVs -> 429 XUVs
C:0 T:8 6066 XUs and 6039 XVs -> 61 XUVs
C:0 T:9 43311 XUs and 55978 XVs -> 3272 XUVs
C:0 T:10 88281 XUs and 49356 XVs -> 13448 XUVs
C:0 T:11 119 XUs and 82 XVs -> 9 XUVs
40901 XUVs total
12816 collection wire objects
37819 potential space points
Neighbour search...
4022503 tests to find 1862334 neighbours
Iterating with no regularization...
Begin: 5.9643e+07
0 4.79907e+07
1 4.70344e+07
2 4.68788e+07
3 4.68281e+07
4 4.68049e+07
Now with regularization...
Begin: 3.6619e+07
0 3.65769e+07
1 3.65544e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410263077
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410263077
fLifetime: 30000 [us]
02-Nov-2025 13:06:39 GMT  Closed output file "reco_stage1.root"
02-Nov-2025 13:06:39 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          543.815       750.171       913.159       754.704       125.68         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00166174    0.00792176     0.010892     0.00972645    0.00311113       10     
reco:ophit:OpHitFinder                             0.375917      0.494472      0.595972      0.492428      0.0715206       10     
reco:opflash:OpFlashFinder                         0.213799      0.342008      0.573199      0.330484      0.0954814       10     
reco:opslicer:OpSlicer                              0.86956       1.19686       1.51362       1.19611      0.179936        10     
reco:caldata:DataPrepModule                         7.68425       8.14779       8.85538       8.14393      0.312707        10     
reco:wclsdatasp:WireCellToolkit                     47.5311       53.2484       64.5819       51.0661       4.78555        10     
reco:gaushit:GausHitFinder                          1.83305       2.26651       2.77244       2.25206      0.322162        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000753283   0.00128871    0.00206913    0.00110608    0.000481362      10     
reco:reco3d:SpacePointSolver                        22.8918       43.9478       84.5904       37.0393       19.2023        10     
reco:hitpdune:DisambigFromSpacePoints               2.52476       3.5259        4.89924       3.61797      0.772201        10     
reco:pandora:StandardPandora                        41.5324       90.5744       130.699       90.8132       29.8393        10     
reco:pandoraWriter:StandardPandora                 0.696236      0.917428       1.22384      0.922771      0.135632        10     
reco:pandoraTrack:LArPandoraTrackCreation           8.91262       12.9621       17.4103       13.0219       2.71147        10     
reco:pandoraShower:LArPandoraShowerCreation         12.3441       17.6035       23.4688       17.4028       3.87932        10     
reco:pandoracalo:Calorimetry                        6.02045       7.97064       11.8503       7.60461       1.80997        10     
reco:pandoracalonosce:Calorimetry                   5.2269        7.41336       10.2188       7.24821       1.59324        10     
reco:pandorapid:Chi2ParticleID                    0.00834952     0.0111989     0.0168992     0.0104912     0.0025198       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0748049     0.104415      0.151143      0.100205      0.0205425       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00845257     0.0105263     0.0141796     0.0101214     0.0015327       10     
reco:pandoraShowercalo:ShowerCalorimetry            14.3344       19.2613       27.6898       18.637        4.30838        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       13.4462       18.2995       25.175        17.7195       4.0574         10     
reco:emtrkmichelid:EmTrackMichelId                  249.759       324.78        374.987       340.65        43.1415        10     
reco:crttag:SingleCRTMatchingProducer              0.0259766     0.0374806     0.0753887     0.0311665     0.014312        10     
reco:crtreco:TwoCRTMatchingProducer                0.0185485     0.0242047     0.0311899     0.0232481    0.00433841       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.05584       1.30312       1.48994       1.35776       0.1616         10     
reco:pandora2Track:LArPandoraTrackCreation          28.9315       41.0486       52.7157       42.2178       7.52008        10     
reco:pandora2calo:Calorimetry                       14.602        22.5587       30.548        23.1525        4.606         10     
reco:pandora2calonosce:Calorimetry                  13.641        21.1059       28.0556       21.2855       4.32539        10     
reco:pandora2pid:Chi2ParticleID                    0.0135894     0.0268555     0.0445192     0.026086     0.00762252       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0607442     0.127275       0.16497      0.131678      0.0265843       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0119725     0.0246188     0.0323437     0.0251376    0.00536191       10     
reco:pandora2Shower:LArPandoraShowerCreation        9.40207       13.6717       17.3134       13.9498       2.3161         10     
reco:pandora2Showercalo:ShowerCalorimetry           13.1568       17.6918       22.0961       18.1802       2.7271         10     
reco:pandora2Showercalonosce:ShowerCalorimetry      10.7467       14.3149       18.1749       14.1732       2.2068         10     
[art]:TriggerResults:TriggerResultInserter        8.2003e-05    0.000115414   0.000200466   9.6411e-05    4.03402e-05      10     
end_path:out1:RootOutput                          1.2814e-05    1.80699e-05   2.4726e-05    1.7909e-05    3.60424e-06      10     
end_path:out1:RootOutput(write)                     3.20829       4.85939       6.29887       4.93858      0.823519        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5378.92 MB
  Peak resident set size usage (VmHWM): 4539.36 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.39 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.99 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.21 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12135616
-rw-r--r-- 1 dune01 dune01 2774654180 Nov  2 10:58 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2625892723 Nov  2 10:54 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2539012995 Nov  2 13:06 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 2239640079 Nov  2 07:53 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 2153763084 Nov  2 07:30 g4_stage1.root
-rw-r--r-- 1 dune01 dune01   93272540 Nov  2 12:59 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01     243207 Nov  2 13:06 jobscript.log
-rw-r--r-- 1 dune01 dune01     217088 Nov  2 13:06 mem.db
-rw-r--r-- 1 dune01 dune01      62376 Nov  2 13:06 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01      36864 Nov  2 13:06 time.db
-rw-r--r-- 1 dune01 dune01        519 Nov  2 10:58 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01        519 Nov  2 07:53 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01        519 Nov  2 13:06 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01         52 Nov  2 07:20 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01          7 Nov  2 13:06 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01          0 Nov  2 11:08 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01          0 Nov  2 10:58 debugprod.log