Jobsub ID 236448.1@dunegpschedd02.fnal.gov
| Jobsub ID | 236448.1@dunegpschedd02.fnal.gov | 
| Workflow ID | 9532 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-11-02 23:12:06 | 
| Site | UK_Manchester | 
| Entry | UBoone_T2_UK_Manchester_ce02 | 
| Last heartbeat | 2025-11-03 05:44:37 | 
| From worker node | Hostname | wn1207241.tier2.hep.manchester.ac.uk | 
| cpuinfo | AMD EPYC 7702P 64-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 257400 (71 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-11-02 23:13:27 | 
| Input files | monte-carlo-009532-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 6h (23362s) | 
| CPU time | 6h (22565s = 96%) | 
| Max RSS bytes | 4421623808 (4216 MiB) | 
| Outputting started | 2025-11-03 05:42:50 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09532/1/001/reco_stage1.root
  | 
| Finished | 2025-11-03 05:44:37 | 
| Saved logs | justin-logs:236448.1-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
pare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 139149 traces, 0 summary
Retagger: tagging trace set: gauss with 103524 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 103524 traces tagged "gauss"
FrameSaver: q=3.64461e+06 n=1849992 tag=gauss
wclsFrameSaver: saving 139149 traces tagged "wiener"
FrameSaver: q=3.89544e+06 n=1631385 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 66375 XUs and 48746 XVs -> 1199 XUVs
C:0 T:1 224053 XUs and 147682 XVs -> 20064 XUVs
C:0 T:2 42849 XUs and 71546 XVs -> 6222 XUVs
C:0 T:3 22687 XUs and 31002 XVs -> 92 XUVs
C:0 T:4 12018 XUs and 8358 XVs -> 87 XUVs
C:0 T:5 58116 XUs and 33829 XVs -> 5502 XUVs
C:0 T:6 72570 XUs and 81199 XVs -> 2631 XUVs
C:0 T:7 31519 XUs and 35410 XVs -> 254 XUVs
C:0 T:8 8858 XUs and 6879 XVs -> 68 XUVs
C:0 T:9 64858 XUs and 65234 XVs -> 8035 XUVs
C:0 T:10 85339 XUs and 59733 XVs -> 8881 XUVs
C:0 T:11 5681 XUs and 5243 XVs -> 649 XUVs
53684 XUVs total
13811 collection wire objects
49154 potential space points
Neighbour search...
6987102 tests to find 3276366 neighbours
Iterating with no regularization...
Begin: 7.90125e+07
0 5.3832e+07
1 5.15488e+07
2 5.11769e+07
3 5.10655e+07
4 5.10173e+07
Now with regularization...
Begin: 3.93494e+07
0 3.92418e+07
1 3.91756e+07
2 3.9128e+07
3 3.90902e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410276694
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410276694
fLifetime: 30000 [us]
03-Nov-2025 05:42:46 GMT  Closed output file "reco_stage1.root"
03-Nov-2025 05:42:46 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          636.585       852.917       1114.41       835.838       168.742        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00167673    0.00694757     0.0131909    0.00720803    0.00357575       10     
reco:ophit:OpHitFinder                             0.375362      0.502702      0.568997       0.51741      0.0557925       10     
reco:opflash:OpFlashFinder                         0.252618      0.351553      0.543434      0.346466      0.0793916       10     
reco:opslicer:OpSlicer                             0.999093       1.30294       1.57928       1.31178      0.180056        10     
reco:caldata:DataPrepModule                         8.16896       8.87239       9.4352        8.87519      0.342845        10     
reco:wclsdatasp:WireCellToolkit                     49.6437       62.4167        72.16        64.2108       7.05903        10     
reco:gaushit:GausHitFinder                          1.90706       2.36806       2.95642       2.29505      0.307841        10     
reco:nhitsfilter:NumberOfHitsFilter               0.00112147    0.00166002    0.00233802    0.00171013    0.000325053      10     
reco:reco3d:SpacePointSolver                        19.5247       33.2015       47.693        31.9211       10.1789        10     
reco:hitpdune:DisambigFromSpacePoints               2.29518       3.41109       4.63041       3.37449      0.847808        10     
reco:pandora:StandardPandora                        44.9473       79.3992       120.993       70.4849       28.3265        10     
reco:pandoraWriter:StandardPandora                 0.805224      0.961266       1.25896      0.886609      0.145111        10     
reco:pandoraTrack:LArPandoraTrackCreation           9.9625        15.3202       22.241        15.5382       4.38522        10     
reco:pandoraShower:LArPandoraShowerCreation         10.071        16.8456       26.2996       15.4098       5.54179        10     
reco:pandoracalo:Calorimetry                        4.9757        9.07812       13.0547       8.95734        2.804         10     
reco:pandoracalonosce:Calorimetry                   4.03856       8.6588        12.6547       8.64693       2.53393        10     
reco:pandorapid:Chi2ParticleID                    0.00974375     0.0127808     0.0159081     0.0130863    0.00205713       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0705196     0.109133      0.148486      0.108204      0.0233686       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00676286     0.0117729     0.0160869     0.011383     0.00252262       10     
reco:pandoraShowercalo:ShowerCalorimetry            10.1412       19.6403       31.4263       18.4676       6.70798        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       11.5798       18.8519       29.9035       17.6593       5.63651        10     
reco:emtrkmichelid:EmTrackMichelId                  339.827       410.804       520.408       395.925       64.6138        10     
reco:crttag:SingleCRTMatchingProducer              0.0213205     0.0394432      0.05492      0.040162     0.00908441       10     
reco:crtreco:TwoCRTMatchingProducer                0.0199997     0.0308409     0.042117      0.0299904    0.00649151       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.33715       1.69675        2.374        1.57356      0.311988        10     
reco:pandora2Track:LArPandoraTrackCreation          28.0028       46.5857       66.0787       45.9732       12.7071        10     
reco:pandora2calo:Calorimetry                       15.2865       27.6297       38.2194       27.197        8.01645        10     
reco:pandora2calonosce:Calorimetry                  11.5212       24.7553       35.4851       24.4503       8.38991        10     
reco:pandora2pid:Chi2ParticleID                    0.0238663     0.0303786     0.0417828     0.0288377    0.00611139       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0882945     0.150027      0.208999       0.15001      0.0332371       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.023391      0.0304423     0.0404971     0.0307099    0.00583283       10     
reco:pandora2Shower:LArPandoraShowerCreation        8.31878       14.2757       20.9669       14.0501       3.93842        10     
reco:pandora2Showercalo:ShowerCalorimetry           8.54285       21.0178       29.929        20.4073       6.26434        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      6.95886       18.6435       27.6453       18.2134       5.90707        10     
[art]:TriggerResults:TriggerResultInserter        4.4274e-05    6.97745e-05   0.000187804   5.50385e-05   4.31278e-05      10     
end_path:out1:RootOutput                           7.303e-06    9.3956e-06     1.593e-05    8.3805e-06    2.65929e-06      10     
end_path:out1:RootOutput(write)                     4.18248       5.6002        7.08915       5.36013      0.956519        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5276.94 MB
  Peak resident set size usage (VmHWM): 4421.62 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.37 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.66 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.22 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11070144
-rw-r--r-- 1 dune01 dune01 2560133095 Nov  3 03:16 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2425085270 Nov  3 03:12 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2275951186 Nov  3 05:42 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 2034378373 Nov  2 23:49 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1957503644 Nov  2 23:24 g4_stage1.root
-rw-r--r-- 1 dune01 dune01   82141640 Nov  3 05:31 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01     243020 Nov  3 05:42 jobscript.log
-rw-r--r-- 1 dune01 dune01     217088 Nov  3 05:42 mem.db
-rw-r--r-- 1 dune01 dune01      62376 Nov  3 05:42 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01      36864 Nov  3 05:42 time.db
-rw-r--r-- 1 dune01 dune01        519 Nov  3 03:16 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01        519 Nov  2 23:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01        519 Nov  3 05:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01         52 Nov  2 23:13 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01          7 Nov  3 05:42 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01          0 Nov  3 03:26 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01          0 Nov  3 03:16 debugprod.log