justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 207247.9@dunegpschedd02.fnal.gov

Jobsub ID207247.9@dunegpschedd02.fnal.gov
Workflow ID8090
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-26 14:09:37
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-09-26 18:24:09
From worker nodeHostnamewn1907241.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-26 15:09:56
Input filesusertests:prod_beam_p5GeV_protodunehd_1_212259_7_1758823079_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time3h (11495s)
CPU time3h (10972s = 95%)
Max RSS bytes7128018944 (6797 MiB)
Outputting started2025-09-26 18:21:32
Output filesusertests:prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim_reco1.root
Finished2025-09-26 18:24:09
Saved logsjustin-logs:207247.9-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s, 119634 summary
Retagger: tagging trace set: gauss with 95014 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95014 traces tagged "gauss"
FrameSaver: q=3.32419e+06 n=1620847 tag=gauss
wclsFrameSaver: saving 119634 traces tagged "wiener"
FrameSaver: q=4.35564e+06 n=1592223 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88161 traces, 88161 summary
Retagger: tagging trace set: gauss with 73186 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73186 traces tagged "gauss"
FrameSaver: q=2.22941e+06 n=1140604 tag=gauss
wclsFrameSaver: saving 88161 traces tagged "wiener"
FrameSaver: q=2.86762e+06 n=1119455 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 113307 traces, 113307 summary
Retagger: tagging trace set: gauss with 90345 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90345 traces tagged "gauss"
FrameSaver: q=2.89776e+06 n=1439029 tag=gauss
wclsFrameSaver: saving 113307 traces tagged "wiener"
FrameSaver: q=3.62817e+06 n=1372714 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 100263 traces, 100263 summary
Retagger: tagging trace set: gauss with 78098 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 78098 traces tagged "gauss"
FrameSaver: q=2.45333e+06 n=1278229 tag=gauss
wclsFrameSaver: saving 100263 traces tagged "wiener"
FrameSaver: q=2.92069e+06 n=1211132 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 101049 traces, 101049 summary
Retagger: tagging trace set: gauss with 82370 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82370 traces tagged "gauss"
FrameSaver: q=2.66699e+06 n=1352835 tag=gauss
wclsFrameSaver: saving 101049 traces tagged "wiener"
FrameSaver: q=3.3807e+06 n=1308676 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 103283 traces, 103283 summary
Retagger: tagging trace set: gauss with 83700 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83700 traces tagged "gauss"
FrameSaver: q=2.60793e+06 n=1369624 tag=gauss
wclsFrameSaver: saving 103283 traces tagged "wiener"
FrameSaver: q=3.27048e+06 n=1309121 tag=wiener
26-Sep-2025 19:21:28 BST  Closed output file "prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim_reco1.root"
26-Sep-2025 19:21:28 BST  Closed input file "prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            258.619       327.836       411.32        331.269       46.5116        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.00152581    0.00774893     0.0122739    0.00804245    0.00346779       10     
reco:opdec:Deconvolution                              1.39004       1.84634       2.17197       1.84469      0.247746        10     
reco:ophitspe:OpHitFinderDeco                         0.39128       0.43089      0.458105       0.43285      0.0194745       10     
reco:opflash:OpFlashFinder                           0.0992178     0.154592      0.231843      0.151288      0.0410016       10     
reco:opslicer:OpSlicer                               0.328066       0.51891      0.669643      0.519774      0.104337        10     
reco:wclsdatahd:WireCellToolkit                       77.9044       92.546        99.6007       94.1904       6.79095        10     
reco:gaushit:GausHitFinder                            1.30097       1.83805       2.43597       1.82187      0.293663        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000545659   0.000789979   0.00112955    0.000801416   0.000169046      10     
reco:reco3d:SpacePointSolver                          1.26167       1.90457       3.9933        1.75968      0.780899        10     
reco:hitpdune:DisambigFromSpacePoints                 1.17378       1.75976       3.32634       1.59021      0.584763        10     
reco:pandora:StandardPandora                          37.8502       60.7385       111.165       57.9462       18.2702        10     
reco:pandoraWriter:StandardPandora                   0.385638      0.574108      0.665478      0.602685      0.0828525       10     
reco:pandoraTrack:LArPandoraTrackCreation             4.79067       7.30975       8.8821        7.59812       1.28218        10     
reco:pandoraShower:LArPandoraShowerCreation           4.5363        7.55904       11.0671       7.42712       2.18488        10     
reco:pandoracalo:Calorimetry                          2.12539       2.96375       3.84655       2.9835       0.547012        10     
reco:pandoracalonosce:Calorimetry                     2.07294       3.16806       4.66014       3.07158      0.669179        10     
reco:pandoraShowercalo:ShowerCalorimetry              3.26426       6.55255       10.7358       6.16349       2.34019        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         3.14585       5.95893       10.5706       5.18213       2.39881        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0542495     0.119976      0.205347      0.122855      0.0397555       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0724219     0.125084      0.200576       0.12634      0.0342527       10     
reco:emtrkmichelid:EmTrackMichelId                    53.8494       72.6091       106.301       70.8953       15.777         10     
reco:crttag:SingleCRTMatchingProducer                0.0110526     0.0186865     0.0244995     0.0193492    0.00373247       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00731218     0.0145355     0.0233965     0.0147888    0.00432516       10     
reco:pandora2Track:LArPandoraTrackCreation            13.237        19.4279       26.7255       17.7344       4.6268         10     
reco:pandora2calo:ShowerCalorimetry                   3.50851       5.60058       9.11583       4.87565       1.78445        10     
reco:pandora2calonosce:ShowerCalorimetry              3.52596       5.7513        9.2741        5.17474       1.84443        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.0925864     0.124292      0.154197      0.128615      0.0217942       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0928592     0.135384      0.196884      0.128896      0.0311478       10     
reco:pandora2Shower:LArPandoraShowerCreation          5.0116        8.0719        13.1606       7.56864       2.2881         10     
reco:pandora2Showercalo:ShowerCalorimetry             5.1512        8.03144       13.7539       7.37372       2.5547         10     
reco:pandora2Showercalonosce:ShowerCalorimetry        4.91217       7.55407       12.1266       7.10135       2.33502        10     
[art]:TriggerResults:TriggerResultInserter          3.1195e-05    6.4357e-05    0.000176302    5.049e-05    3.91573e-05      10     
end_path:out1:RootOutput                             9.952e-06    1.54758e-05   4.4696e-05    1.2643e-05    9.82873e-06      10     
end_path:out1:RootOutput(write)                       3.31901       4.21836       5.85491       4.07645      0.706015        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6293.52 MB
  Peak resident set size usage (VmHWM): 4065.98 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim_reco1.root', 'start_time': 1758907400.5294695, 'end_time': 1758910891.1537712}
lsing
total 12G
-rw-r--r-- 1 dune01 dune01 6.0G Sep 26 19:21 prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim_reco1.root
-rw-r--r-- 1 dune01 dune01 5.7G Sep 26 18:23 prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim.root
-rw-r--r-- 1 dune01 dune01  56M Sep 26 19:18 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 196K Sep 26 19:21 mem.db
-rw-r--r-- 1 dune01 dune01 179K Sep 26 19:21 jobscript.log
-rw-r--r-- 1 dune01 dune01  36K Sep 26 19:21 time.db
-rw-r--r-- 1 dune01 dune01  13K Sep 26 19:21 prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim_reco1.err
-rw-r--r-- 1 dune01 dune01  12K Sep 26 18:23 prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim.log
-rw-r--r-- 1 dune01 dune01  11K Sep 26 19:21 prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim_reco1.log
-rw-r--r-- 1 dune01 dune01 4.4K Sep 26 18:23 prod_beam_p5GeV_protodunehd_1_207247_9_1758899416_detsim.err
-rw-r--r-- 1 dune01 dune01 3.5K Sep 26 19:21 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01  519 Sep 26 18:23 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 dune01 dune01  519 Sep 26 19:21 reco_protodunehd_hist.root
-rw-r--r-- 1 dune01 dune01  109 Sep 26 16:10 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01    0 Sep 26 18:30 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01    0 Sep 26 18:23 debugprod.log
disk usage
12G	.
justIN time: 2025-11-05 12:58:47 UTC       justIN version: 01.05.01