justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 207247.12@dunegpschedd02.fnal.gov

Jobsub ID207247.12@dunegpschedd02.fnal.gov
Workflow ID8090
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-26 14:09:37
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2025-09-26 16:48:22
From worker nodeHostnamen248.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-26 15:20:23
Input filesusertests:prod_beam_p5GeV_protodunehd_1_212254_42_1758820583_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time1h (4473s)
CPU time1h (4102s = 91%)
Max RSS bytes7415345152 (7071 MiB)
Outputting started2025-09-26 16:34:57
Output filesusertests:prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim_reco1.root
Finished2025-09-26 16:48:22
Saved logsjustin-logs:207247.12-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

races, 106645 summary
Retagger: tagging trace set: gauss with 91281 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91281 traces tagged "gauss"
FrameSaver: q=3.06552e+06 n=1560042 tag=gauss
wclsFrameSaver: saving 106645 traces tagged "wiener"
FrameSaver: q=3.91354e+06 n=1527378 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 85283 traces, 85283 summary
Retagger: tagging trace set: gauss with 67431 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 67431 traces tagged "gauss"
FrameSaver: q=1.81584e+06 n=992424 tag=gauss
wclsFrameSaver: saving 85283 traces tagged "wiener"
FrameSaver: q=2.2889e+06 n=951566 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 93282 traces, 93282 summary
Retagger: tagging trace set: gauss with 75797 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75797 traces tagged "gauss"
FrameSaver: q=2.23244e+06 n=1167907 tag=gauss
wclsFrameSaver: saving 93282 traces tagged "wiener"
FrameSaver: q=2.9146e+06 n=1138570 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88854 traces, 88854 summary
Retagger: tagging trace set: gauss with 70378 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 70378 traces tagged "gauss"
FrameSaver: q=2.0168e+06 n=1092364 tag=gauss
wclsFrameSaver: saving 88854 traces tagged "wiener"
FrameSaver: q=2.46818e+06 n=1058464 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108711 traces, 108711 summary
Retagger: tagging trace set: gauss with 85842 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 85842 traces tagged "gauss"
FrameSaver: q=2.64627e+06 n=1396818 tag=gauss
wclsFrameSaver: saving 108711 traces tagged "wiener"
FrameSaver: q=3.38889e+06 n=1353360 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 91554 traces, 91554 summary
Retagger: tagging trace set: gauss with 73513 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73513 traces tagged "gauss"
FrameSaver: q=2.14455e+06 n=1136264 tag=gauss
wclsFrameSaver: saving 91554 traces tagged "wiener"
FrameSaver: q=2.69421e+06 n=1109059 tag=wiener
26-Sep-2025 17:34:55 BST  Closed output file "prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim_reco1.root"
26-Sep-2025 17:34:55 BST  Closed input file "prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            76.7902       100.186       137.426       88.4823       22.1321        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000420904    0.003912     0.00657147    0.00456504    0.00208808       10     
reco:opdec:Deconvolution                             0.495625      0.680369      0.865006      0.706192      0.103466        10     
reco:ophitspe:OpHitFinderDeco                        0.103777      0.111882      0.122186      0.111117     0.00543227       10     
reco:opflash:OpFlashFinder                           0.0567491     0.084179      0.113215      0.0874943     0.0192582       10     
reco:opslicer:OpSlicer                               0.110175       0.20158      0.278912       0.20121      0.0470956       10     
reco:wclsdatahd:WireCellToolkit                       33.3764       33.8746        34.5         33.8033      0.352746        10     
reco:gaushit:GausHitFinder                           0.411262      0.588775      0.824239      0.531091      0.138237        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000193556   0.000237571   0.000318251   0.000227329   4.13664e-05      10     
reco:reco3d:SpacePointSolver                         0.324471       0.74414       1.0148       0.791268      0.238913        10     
reco:hitpdune:DisambigFromSpacePoints                0.319892      0.590678       1.07615      0.467787      0.261606        10     
reco:pandora:StandardPandora                          7.89627       18.7937       33.5851       16.3242       9.29676        10     
reco:pandoraWriter:StandardPandora                   0.134286      0.177072      0.232876      0.163785      0.0327319       10     
reco:pandoraTrack:LArPandoraTrackCreation            0.717327       1.43736       2.92214       1.32309      0.696449        10     
reco:pandoraShower:LArPandoraShowerCreation          0.788899       1.38782       2.33278       1.14264      0.544524        10     
reco:pandoracalo:Calorimetry                         0.407528       0.80225       1.5563       0.740459       0.37804        10     
reco:pandoracalonosce:Calorimetry                    0.395824      0.790954       1.54024      0.726025       0.3743         10     
reco:pandoraShowercalo:ShowerCalorimetry             0.800222       1.47916       2.49803       1.1551       0.623012        10     
reco:pandoraShowercalonosce:ShowerCalorimetry        0.786717       1.42314       2.37914       1.10809      0.598307        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0290137     0.0383979     0.0486066     0.0381765    0.00630065       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0296914     0.0368267     0.0468688     0.0366742    0.00536975       10     
reco:emtrkmichelid:EmTrackMichelId                    18.1964       23.7189       30.7761       22.7094       4.05816        10     
reco:crttag:SingleCRTMatchingProducer               0.00291918    0.00372102    0.00505376    0.00358349    0.000625131      10     
reco:crtreco:TwoCRTMatchingProducer                  0.0026711    0.00326152    0.00388907    0.00313144    0.000379629      10     
reco:pandora2Track:LArPandoraTrackCreation            1.7285        3.45137       6.34426       2.86235       1.5006         10     
reco:pandora2calo:ShowerCalorimetry                  0.715424       1.34991       2.41833       1.03041      0.625404        10     
reco:pandora2calonosce:ShowerCalorimetry             0.696569       1.31038       2.33466       1.01728      0.606141        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.0314033     0.0387702     0.0490764     0.037725     0.00644317       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0299332     0.0373419     0.0486011     0.0362444    0.00649392       10     
reco:pandora2Shower:LArPandoraShowerCreation         0.867107       1.60455       3.05349       1.2949       0.710333        10     
reco:pandora2Showercalo:ShowerCalorimetry            0.929135       1.85646       3.58958       1.42666      0.905504        10     
reco:pandora2Showercalonosce:ShowerCalorimetry       0.876887       1.79454       3.43817       1.38551      0.871888        10     
[art]:TriggerResults:TriggerResultInserter          1.4537e-05    2.31929e-05   6.2458e-05    1.9141e-05    1.32706e-05      10     
end_path:out1:RootOutput                             3.116e-06    6.5945e-06     2.119e-05    5.0795e-06    5.11815e-06      10     
end_path:out1:RootOutput(write)                       1.33652       1.70972       2.22046       1.68654      0.280587        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6503.68 MB
  Peak resident set size usage (VmHWM): 4300.55 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim_reco1.root', 'start_time': 1758903429.3957913, 'end_time': 1758904496.6684368}
lsing
total 13G
-rw-r--r--. 1 dune001 dune 6.2G Sep 26 17:34 prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim_reco1.root
-rw-r--r--. 1 dune001 dune 5.9G Sep 26 17:17 prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim.root
-rw-r--r--. 1 dune001 dune  55M Sep 26 17:34 Pandora_Events.pndr
-rw-r--r--. 1 dune001 dune 196K Sep 26 17:34 mem.db
-rw-r--r--. 1 dune001 dune 181K Sep 26 17:34 jobscript.log
-rw-r--r--. 1 dune001 dune  36K Sep 26 17:34 time.db
-rw-r--r--. 1 dune001 dune  13K Sep 26 17:34 prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim_reco1.log
-rw-r--r--. 1 dune001 dune  13K Sep 26 17:34 prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim_reco1.err
-rw-r--r--. 1 dune001 dune  12K Sep 26 17:17 prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim.log
-rw-r--r--. 1 dune001 dune 4.4K Sep 26 17:17 prod_beam_p5GeV_protodunehd_1_207247_12_1758900029_detsim.err
-rw-r--r--. 1 dune001 dune 3.5K Sep 26 17:34 Pandora_Geometry.xml
-rw-r--r--. 1 dune001 dune  519 Sep 26 17:17 detsim_single_protodunehd_hist.root
-rw-r--r--. 1 dune001 dune  519 Sep 26 17:34 reco_protodunehd_hist.root
-rw-r--r--. 1 dune001 dune  110 Sep 26 16:20 all-input-dids.txt
-rw-r--r--. 1 dune001 dune    0 Sep 26 17:18 ProtoDUNE.log
-rw-r--r--. 1 dune001 dune    0 Sep 26 17:17 debugprod.log
disk usage
13G	.
justIN time: 2025-11-05 12:58:46 UTC       justIN version: 01.05.01