Jobsub ID 207247.15@dunegpschedd02.fnal.gov

Jobsub ID	207247.15@dunegpschedd02.fnal.gov
Workflow ID	8090
Stage ID	1
User name	calcuttj@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	8387559424 (7999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-26 14:09:37
Site	UK_QMUL
Entry	DUNE_UK_London_QMUL_arcce03
Last heartbeat	2025-09-26 17:40:12
From worker node	Hostname	cn506.htc.esc.qmul
	cpuinfo	Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-26 15:23:33
Input files	usertests:prod_beam_p5GeV_protodunehd_1_212254_45_1758820591_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
Jobscript	Exit code	0
	Real time	2h (7756s)
	CPU time	2h (7545s = 97%)
	Max RSS bytes	6891978752 (6572 MiB)
Outputting started	2025-09-26 17:32:50
Output files	usertests:prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim_reco1.root
Finished	2025-09-26 17:40:12
Saved logs	justin-logs:207247.15-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

races, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 72206 traces tagged "gauss"
FrameSaver: q=2.29038e+06 n=1148440 tag=gauss
wclsFrameSaver: saving 86494 traces tagged "wiener"
FrameSaver: q=3.0907e+06 n=1143336 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120248 traces, 120248 summary
Retagger: tagging trace set: gauss with 92867 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 92867 traces tagged "gauss"
FrameSaver: q=3.07923e+06 n=1422562 tag=gauss
wclsFrameSaver: saving 120248 traces tagged "wiener"
FrameSaver: q=4.33171e+06 n=1415742 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 103983 traces, 103983 summary
Retagger: tagging trace set: gauss with 83365 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83365 traces tagged "gauss"
FrameSaver: q=2.62289e+06 n=1333396 tag=gauss
wclsFrameSaver: saving 103983 traces tagged "wiener"
FrameSaver: q=3.40565e+06 n=1269986 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 90795 traces, 90795 summary
Retagger: tagging trace set: gauss with 71695 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 71695 traces tagged "gauss"
FrameSaver: q=2.225e+06 n=1147815 tag=gauss
wclsFrameSaver: saving 90795 traces tagged "wiener"
FrameSaver: q=2.61557e+06 n=1094299 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 86505 traces, 86505 summary
Retagger: tagging trace set: gauss with 69437 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 69437 traces tagged "gauss"
FrameSaver: q=2.16483e+06 n=1069668 tag=gauss
wclsFrameSaver: saving 86505 traces tagged "wiener"
FrameSaver: q=2.86192e+06 n=1046389 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 109355 traces, 109355 summary
Retagger: tagging trace set: gauss with 88095 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88095 traces tagged "gauss"
FrameSaver: q=2.84666e+06 n=1412439 tag=gauss
wclsFrameSaver: saving 109355 traces tagged "wiener"
FrameSaver: q=3.80998e+06 n=1367259 tag=wiener
26-Sep-2025 18:32:47 BST  Closed output file "prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim_reco1.root"
26-Sep-2025 18:32:47 BST  Closed input file "prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            177.529       286.482       459.402       286.306       84.006         10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.00139407    0.00793092     0.0130868    0.00871327    0.00359223       10     
reco:opdec:Deconvolution                              1.12327       1.5352        1.89536       1.5832       0.205115        10     
reco:ophitspe:OpHitFinderDeco                        0.269036      0.390841       0.56196      0.379108      0.104076        10     
reco:opflash:OpFlashFinder                           0.0940474     0.153037      0.211896      0.157264      0.0378823       10     
reco:opslicer:OpSlicer                               0.264734      0.440462      0.593092      0.477117      0.100732        10     
reco:wclsdatahd:WireCellToolkit                       72.396        87.8768       99.4566       91.0149       10.0964        10     
reco:gaushit:GausHitFinder                            1.05088       1.69035       2.33677       1.76322      0.456606        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000531428   0.000849984   0.00153071    0.000792683   0.000273903      10     
reco:reco3d:SpacePointSolver                         0.653964       2.49311       4.93569       2.33667       1.08563        10     
reco:hitpdune:DisambigFromSpacePoints                 0.80805       1.89539       3.75721       1.68576      0.931534        10     
reco:pandora:StandardPandora                          19.0767       67.2356       178.377       58.0943       43.8529        10     
reco:pandoraWriter:StandardPandora                   0.315061      0.526993       0.75938       0.49679      0.151742        10     
reco:pandoraTrack:LArPandoraTrackCreation             2.71078       7.45355       13.9344       6.6148        3.58634        10     
reco:pandoraShower:LArPandoraShowerCreation           3.96019       8.21213       14.3034       7.68534       3.22978        10     
reco:pandoracalo:Calorimetry                          1.19811       3.2302        6.00693       3.07089       1.51758        10     
reco:pandoracalonosce:Calorimetry                     1.0978        3.06417       5.83276       3.00003       1.33328        10     
reco:pandoraShowercalo:ShowerCalorimetry              3.11439       6.77234       12.1752       6.95996       2.74973        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         3.00032       6.81955       13.4571       6.80788       3.10604        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0633924     0.106067      0.179448      0.0934595     0.038909        10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0621036     0.103955       0.17315      0.0928796     0.0373899       10     
reco:emtrkmichelid:EmTrackMichelId                    15.1856       24.5041       32.5708       24.8925       5.94747        10     
reco:crttag:SingleCRTMatchingProducer                0.0130058     0.0191848     0.0277217     0.0184629    0.00475691       10     
reco:crtreco:TwoCRTMatchingProducer                  0.0121629     0.0182775     0.0255048     0.0188075    0.00468438       10     
reco:pandora2Track:LArPandoraTrackCreation            10.8659       20.0627       37.4148       16.9273       8.49421        10     
reco:pandora2calo:ShowerCalorimetry                   3.0658        6.30627       13.8934       5.29034       3.29802        10     
reco:pandora2calonosce:ShowerCalorimetry              2.92507       6.15994       13.3704       4.97178       3.20827        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.0662864     0.107939      0.184658      0.089916      0.0415938       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0650231     0.105603      0.197853      0.0879954     0.0420621       10     
reco:pandora2Shower:LArPandoraShowerCreation          4.00628       8.11209       15.0454       6.46088       3.75528        10     
reco:pandora2Showercalo:ShowerCalorimetry             3.48923       8.42955       17.2942       6.33687       4.72995        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        3.56941       8.49693       17.1278       7.58341       4.55692        10     
[art]:TriggerResults:TriggerResultInserter          3.0488e-05    6.04539e-05   0.000143475   5.1772e-05    3.20329e-05      10     
end_path:out1:RootOutput                             6.183e-06    1.30248e-05   4.0345e-05    1.1021e-05    9.37467e-06      10     
end_path:out1:RootOutput(write)                       2.74904       3.9495        5.65699       3.6418        1.10424        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6752.39 MB
  Peak resident set size usage (VmHWM): 4206.1 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim_reco1.root', 'start_time': 1758904902.5520039, 'end_time': 1758907969.765695}
lsing
total 12G
-rw-r--r-- 1 pildune32 pildune 5.9G Sep 26 18:32 prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim_reco1.root
-rw-r--r-- 1 pildune32 pildune 5.6G Sep 26 17:41 prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim.root
-rw-r--r-- 1 pildune32 pildune  54M Sep 26 18:29 Pandora_Events.pndr
-rw-r--r-- 1 pildune32 pildune 196K Sep 26 18:32 mem.db
-rw-r--r-- 1 pildune32 pildune 179K Sep 26 18:32 jobscript.log
-rw-r--r-- 1 pildune32 pildune  36K Sep 26 18:32 time.db
-rw-r--r-- 1 pildune32 pildune  13K Sep 26 18:32 prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim_reco1.err
-rw-r--r-- 1 pildune32 pildune  12K Sep 26 17:41 prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim.log
-rw-r--r-- 1 pildune32 pildune  11K Sep 26 18:32 prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim_reco1.log
-rw-r--r-- 1 pildune32 pildune 4.4K Sep 26 17:41 prod_beam_p5GeV_protodunehd_1_207247_15_1758900224_detsim.err
-rw-r--r-- 1 pildune32 pildune 3.5K Sep 26 18:32 Pandora_Geometry.xml
-rw-r--r-- 1 pildune32 pildune  519 Sep 26 17:41 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 pildune32 pildune  519 Sep 26 18:32 reco_protodunehd_hist.root
-rw-r--r-- 1 pildune32 pildune  110 Sep 26 16:23 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune    0 Sep 26 17:47 ProtoDUNE.log
-rw-r--r-- 1 pildune32 pildune    0 Sep 26 17:41 debugprod.log
disk usage
12G	.