justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 236035.0@dunegpschedd01.fnal.gov

Jobsub ID236035.0@dunegpschedd01.fnal.gov
Workflow ID9142
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-18 15:33:29
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-10-18 21:27:04
From worker nodeHostnamecn009.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-18 15:34:06
Input filesmonte-carlo-009142-000001
JobscriptExit code0
Real time5h (20965s)
CPU time5h (20540s = 97%)
Max RSS bytes4482617344 (4274 MiB)
Outputting started2025-10-18 21:23:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09142/1/001/reco_stage1.root
Finished2025-10-18 21:27:04
Saved logsjustin-logs:236035.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

e:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 103718 traces, 0 summary
Retagger: tagging trace set: gauss with 83942 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83942 traces tagged "gauss"
FrameSaver: q=2.73581e+06 n=1543073 tag=gauss
wclsFrameSaver: saving 103718 traces tagged "wiener"
FrameSaver: q=2.86915e+06 n=1388325 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 42928 XUs and 35271 XVs -> 466 XUVs
C:0 T:1 93490 XUs and 73248 XVs -> 7283 XUVs
C:0 T:2 73157 XUs and 104800 XVs -> 3037 XUVs
C:0 T:3 41103 XUs and 45813 XVs -> 211 XUVs
C:0 T:4 7529 XUs and 10346 XVs -> 77 XUVs
C:0 T:5 29939 XUs and 25058 XVs -> 2445 XUVs
C:0 T:6 93373 XUs and 95102 XVs -> 3236 XUVs
C:0 T:7 40152 XUs and 40821 XVs -> 308 XUVs
C:0 T:8 3208 XUs and 3920 XVs -> 50 XUVs
C:0 T:9 16768 XUs and 26941 XVs -> 1413 XUVs
C:0 T:10 18856 XUs and 10026 XVs -> 1976 XUVs
C:0 T:11 275 XUs and 180 XVs -> 25 XUVs
20527 XUVs total
9680 collection wire objects
18698 potential space points
Neighbour search...
807920 tests to find 415962 neighbours
Iterating with no regularization...
Begin: 4.97238e+07
0 4.23918e+07
1 4.19061e+07
2 4.18388e+07
3 4.18227e+07
Now with regularization...
Begin: 3.4498e+07
0 3.44873e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 409968491
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409968491
fLifetime: 30000 [us]
18-Oct-2025 22:23:28 BST  Closed output file "reco_stage1.root"
18-Oct-2025 22:23:28 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          722.954       960.399       1546.86       932.406       217.638        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00182268    0.00627974    0.00948229     0.0069521    0.00232191       10     
reco:ophit:OpHitFinder                             0.389072      0.460765      0.574435      0.446627      0.0529427       10     
reco:opflash:OpFlashFinder                         0.237068      0.310572      0.445811      0.274716      0.0716031       10     
reco:opslicer:OpSlicer                             0.906191       1.12938       1.48254       1.16679       0.16568        10     
reco:caldata:DataPrepModule                         8.79353       9.34494       9.75568       9.3239       0.280318        10     
reco:wclsdatasp:WireCellToolkit                     74.0085       78.1465       83.1695       78.036        2.53835        10     
reco:gaushit:GausHitFinder                          2.25635       2.58866       3.7316        2.50775      0.406747        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000983965   0.00139224     0.0026448    0.00113009    0.000528249      10     
reco:reco3d:SpacePointSolver                        18.9934       35.8168       78.3444       34.8508       16.3051        10     
reco:hitpdune:DisambigFromSpacePoints               3.10006       5.07583       9.61023       4.75021       1.73193        10     
reco:pandora:StandardPandora                        59.7084       93.4263       225.629       83.1237       45.2368        10     
reco:pandoraWriter:StandardPandora                 0.691744      0.940233       1.37054       0.93812      0.179334        10     
reco:pandoraTrack:LArPandoraTrackCreation           17.4939       21.8208       32.4642       21.0752       3.8819         10     
reco:pandoraShower:LArPandoraShowerCreation         16.9615       25.5114       48.8001       24.928        8.53597        10     
reco:pandoracalo:Calorimetry                        8.64221       10.8664       16.5094       10.6204       2.10674        10     
reco:pandoracalonosce:Calorimetry                   8.29441       10.4425       15.8271       10.0934       2.03502        10     
reco:pandorapid:Chi2ParticleID                     0.0085717     0.0126316     0.016173      0.013426     0.00236486       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0799192      0.11994      0.152831      0.124395      0.0240671       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0086049     0.0115142     0.0144038     0.0123359    0.00211697       10     
reco:pandoraShowercalo:ShowerCalorimetry            14.6273       27.5138       54.721        26.9372       10.2233        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       14.4933       27.0067       53.2857       26.5768       9.9165         10     
reco:emtrkmichelid:EmTrackMichelId                  302.48        377.02        523.566       365.984       59.277         10     
reco:crttag:SingleCRTMatchingProducer              0.0350211     0.0527771     0.0682911     0.0494705     0.0102469       10     
reco:crtreco:TwoCRTMatchingProducer                0.030111      0.0437781     0.0602666     0.0436368    0.00790704       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.21583       1.96408       2.46392       2.05428      0.391112        10     
reco:pandora2Track:LArPandoraTrackCreation          51.318        73.6922       129.216       72.6545       20.6383        10     
reco:pandora2calo:Calorimetry                       23.7968       36.1587       64.8124       35.377        10.8736        10     
reco:pandora2calonosce:Calorimetry                  23.7541       34.5933       59.5834       33.7771       9.56142        10     
reco:pandora2pid:Chi2ParticleID                    0.0220048     0.0273977     0.0403419     0.0266873     0.0048729       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.104665      0.142992      0.185478      0.137743      0.0254971       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0220288     0.0277068     0.038514      0.0260298    0.00462522       10     
reco:pandora2Shower:LArPandoraShowerCreation        15.4973       22.498        31.837        21.7741       4.10955        10     
reco:pandora2Showercalo:ShowerCalorimetry           21.3584       30.897        50.0892       30.4386       7.64374        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      18.4946       27.6479       43.6662       27.2328       6.74784        10     
[art]:TriggerResults:TriggerResultInserter        7.7505e-05    0.000114218   0.000231384   0.000100567   4.24184e-05      10     
end_path:out1:RootOutput                          1.0992e-05    1.63497e-05   2.9366e-05    1.54095e-05   5.38972e-06      10     
end_path:out1:RootOutput(write)                     3.72005       4.80421       6.88929       4.63574      0.863537        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5291.13 MB
  Peak resident set size usage (VmHWM): 4482.62 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.37 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.86 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11016084
-rw-r--r-- 1 pildune22 pildune 2554662316 Oct 18 19:39 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2426358021 Oct 18 19:35 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2263965070 Oct 18 22:23 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 2017851809 Oct 18 17:12 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1936530987 Oct 18 16:44 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   80493070 Oct 18 22:14 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     243182 Oct 18 22:23 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Oct 18 22:23 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Oct 18 22:23 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Oct 18 22:23 time.db
-rw-r--r-- 1 pildune22 pildune        519 Oct 18 19:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 18 17:12 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 18 22:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Oct 18 16:34 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Oct 18 22:23 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Oct 18 19:53 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Oct 18 19:39 debugprod.log
justIN time: 2025-11-04 01:55:20 UTC       justIN version: 01.05.01