Jobsub ID 233054.0@dunegpschedd02.fnal.gov
| Jobsub ID | 233054.0@dunegpschedd02.fnal.gov | 
| Workflow ID | 9357 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-26 13:20:39 | 
| Site | UK_QMUL | 
| Entry | DUNE_UK_London_QMUL_arcce02 | 
| Last heartbeat | 2025-10-26 17:59:37 | 
| From worker node | Hostname | cn028.htc.esc.qmul | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 171000 (47 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-26 13:25:44 | 
| Input files | monte-carlo-009357-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 4h (16210s) | 
| CPU time | 4h (15924s = 98%) | 
| Max RSS bytes | 4496543744 (4288 MiB) | 
| Outputting started | 2025-10-26 17:55:55 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09357/1/001/reco_stage1.root
  | 
| Finished | 2025-10-26 17:59:37 | 
| Saved logs | justin-logs:233054.0-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
epare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 121067 traces, 0 summary
Retagger: tagging trace set: gauss with 93168 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93168 traces tagged "gauss"
FrameSaver: q=3.1806e+06 n=1657654 tag=gauss
wclsFrameSaver: saving 121067 traces tagged "wiener"
FrameSaver: q=3.36636e+06 n=1474713 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 18286 XUs and 25930 XVs -> 260 XUVs
C:0 T:1 50530 XUs and 48707 XVs -> 5215 XUVs
C:0 T:2 82004 XUs and 136029 XVs -> 8666 XUVs
C:0 T:3 35772 XUs and 45229 XVs -> 275 XUVs
C:0 T:4 9073 XUs and 9387 XVs -> 63 XUVs
C:0 T:5 36920 XUs and 27876 XVs -> 4041 XUVs
C:0 T:6 102836 XUs and 70951 XVs -> 13685 XUVs
C:0 T:7 31358 XUs and 24145 XVs -> 774 XUVs
C:0 T:8 12126 XUs and 14578 XVs -> 157 XUVs
C:0 T:9 77918 XUs and 102139 XVs -> 10865 XUVs
C:0 T:10 64100 XUs and 28539 XVs -> 6720 XUVs
50721 XUVs total
10504 collection wire objects
46855 potential space points
Neighbour search...
7974883 tests to find 3771170 neighbours
Iterating with no regularization...
Begin: 6.13504e+07
0 5.30234e+07
1 5.24621e+07
2 5.23732e+07
3 5.23444e+07
Now with regularization...
Begin: 4.37894e+07
0 4.3731e+07
1 4.36854e+07
2 4.36469e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410127514
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410127514
fLifetime: 30000 [us]
26-Oct-2025 17:55:50 GMT  Closed output file "reco_stage1.root"
26-Oct-2025 17:55:50 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          470.527       620.989       900.271       584.687       134.759        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00202704    0.00395903    0.00537965    0.00419521    0.00118695       10     
reco:ophit:OpHitFinder                             0.229244      0.277861      0.333932      0.278318      0.030988        10     
reco:opflash:OpFlashFinder                         0.177881      0.221259       0.2604       0.222563      0.0283646       10     
reco:opslicer:OpSlicer                             0.554263      0.698165       0.92695      0.660628      0.111774        10     
reco:caldata:DataPrepModule                         5.05156       5.91214       8.4666        5.43924       1.13139        10     
reco:wclsdatasp:WireCellToolkit                     47.4913       51.7602       65.8305       50.3237       4.91972        10     
reco:gaushit:GausHitFinder                          1.32169       1.60743       2.17417       1.45138      0.313562        10     
reco:nhitsfilter:NumberOfHitsFilter               0.00085921    0.00113108    0.00147881    0.00110091    0.000199433      10     
reco:reco3d:SpacePointSolver                        11.6182       16.6639       23.2978       15.2325       3.7721         10     
reco:hitpdune:DisambigFromSpacePoints               1.89318       2.70211       3.68411       2.44717      0.627552        10     
reco:pandora:StandardPandora                        32.9255       60.9365       128.574       54.6624       26.3877        10     
reco:pandoraWriter:StandardPandora                 0.491849      0.597184      0.788151      0.577014      0.0964735       10     
reco:pandoraTrack:LArPandoraTrackCreation           12.4738       16.5799       22.8803       14.9483       4.12783        10     
reco:pandoraShower:LArPandoraShowerCreation         14.1679       20.2325       30.5243       18.2477       5.82828        10     
reco:pandoracalo:Calorimetry                        5.81328       8.00946       10.9921       7.36456       2.01298        10     
reco:pandoracalonosce:Calorimetry                   5.72762       7.75139       10.7969       7.0433        1.96295        10     
reco:pandorapid:Chi2ParticleID                    0.00543542    0.00693336     0.0122455    0.00644404    0.00192931       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0590583     0.0778571      0.12018      0.0722082     0.0176601       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0053305    0.00656259     0.0104404    0.00604007    0.00147201       10     
reco:pandoraShowercalo:ShowerCalorimetry             13.31        20.0612       30.6574       18.7861       5.90521        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       13.1815       19.4816       29.8123       17.9877       5.67896        10     
reco:emtrkmichelid:EmTrackMichelId                  171.145       221.628       372.486       208.342       55.8689        10     
reco:crttag:SingleCRTMatchingProducer              0.0342009     0.040761      0.0490061     0.0397014    0.00457023       10     
reco:crtreco:TwoCRTMatchingProducer                0.0303751     0.0352015     0.042553      0.0348334    0.00402314       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.987229       1.35111       1.60262       1.30556      0.193347        10     
reco:pandora2Track:LArPandoraTrackCreation          37.4505       52.6499       80.043        46.2855       14.425         10     
reco:pandora2calo:Calorimetry                       16.7439       25.2708       36.7204       22.3021       6.88858        10     
reco:pandora2calonosce:Calorimetry                  16.0058       25.014        34.6423       22.9133       6.69796        10     
reco:pandora2pid:Chi2ParticleID                    0.0121772     0.0169694     0.0224828     0.0161285    0.00378893       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0693081     0.0957476     0.129284      0.0929984     0.0192466       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0122596     0.0162792     0.0234343     0.0158816     0.003632        10     
reco:pandora2Shower:LArPandoraShowerCreation        11.9593       17.2388        21.79        16.8748       3.08895        10     
reco:pandora2Showercalo:ShowerCalorimetry           13.8988       21.7832       28.0765       20.8072       5.12997        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      11.8997       18.9866       23.7508       19.1653       4.07287        10     
[art]:TriggerResults:TriggerResultInserter        5.1485e-05    6.57349e-05   0.000123657   5.48955e-05   2.14231e-05      10     
end_path:out1:RootOutput                           6.961e-06    8.3908e-06    1.2551e-05     8.066e-06    1.56447e-06      10     
end_path:out1:RootOutput(write)                     2.35262       3.02926       4.01082       2.99329      0.499161        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5224.09 MB
  Peak resident set size usage (VmHWM): 4422.72 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.23 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.71 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10880244
-rw-r--r-- 1 pildune22 pildune 2534644711 Oct 26 16:09 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2406477761 Oct 26 16:06 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2262677502 Oct 26 17:55 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 1960122397 Oct 26 13:57 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1891827032 Oct 26 13:33 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   85010660 Oct 26 17:49 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     243059 Oct 26 17:55 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Oct 26 17:55 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Oct 26 17:55 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Oct 26 17:55 time.db
-rw-r--r-- 1 pildune22 pildune        519 Oct 26 16:09 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 26 13:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 26 17:55 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Oct 26 13:25 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Oct 26 17:55 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Oct 26 16:18 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Oct 26 16:09 debugprod.log