justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 207247.11@dunegpschedd02.fnal.gov

Jobsub ID207247.11@dunegpschedd02.fnal.gov
Workflow ID8090
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-26 14:09:37
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-09-26 19:07:47
From worker nodeHostnamehnode68.pic.es
cpuinfoAMD EPYC 7402P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-26 15:19:31
Input filesusertests:prod_beam_p5GeV_protodunehd_1_212254_164_1758822982_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time3h (13420s)
CPU time1h (5977s = 44%)
Max RSS bytes6940487680 (6618 MiB)
Outputting started2025-09-26 19:03:12
Output filesusertests:prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim_reco1.root
Finished2025-09-26 19:07:47
Saved logsjustin-logs:207247.11-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

iener with 94609 traces, 94609 summary
Retagger: tagging trace set: gauss with 74067 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 74067 traces tagged "gauss"
FrameSaver: q=2.21566e+06 n=1069468 tag=gauss
wclsFrameSaver: saving 94609 traces tagged "wiener"
FrameSaver: q=3.00611e+06 n=1045661 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 99521 traces, 99521 summary
Retagger: tagging trace set: gauss with 81522 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 81522 traces tagged "gauss"
FrameSaver: q=2.66324e+06 n=1405728 tag=gauss
wclsFrameSaver: saving 99521 traces tagged "wiener"
FrameSaver: q=3.18018e+06 n=1338410 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 82629 traces, 82629 summary
Retagger: tagging trace set: gauss with 67340 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 67340 traces tagged "gauss"
FrameSaver: q=1.91965e+06 n=1064112 tag=gauss
wclsFrameSaver: saving 82629 traces tagged "wiener"
FrameSaver: q=2.47331e+06 n=1024353 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 84781 traces, 84781 summary
Retagger: tagging trace set: gauss with 69221 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 69221 traces tagged "gauss"
FrameSaver: q=1.89083e+06 n=1034655 tag=gauss
wclsFrameSaver: saving 84781 traces tagged "wiener"
FrameSaver: q=2.50076e+06 n=995910 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88946 traces, 88946 summary
Retagger: tagging trace set: gauss with 70762 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 70762 traces tagged "gauss"
FrameSaver: q=1.96935e+06 n=1084042 tag=gauss
wclsFrameSaver: saving 88946 traces tagged "wiener"
FrameSaver: q=2.37363e+06 n=1017790 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 77186 traces, 77186 summary
Retagger: tagging trace set: gauss with 62306 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 62306 traces tagged "gauss"
FrameSaver: q=1.65926e+06 n=934253 tag=gauss
wclsFrameSaver: saving 77186 traces tagged "wiener"
FrameSaver: q=2.01946e+06 n=905534 tag=wiener
26-Sep-2025 21:03:09 CEST  Closed output file "prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim_reco1.root"
26-Sep-2025 21:03:09 CEST  Closed input file "prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            90.4067       234.946       414.353       250.924       111.034        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                               0.0011939    0.00572102    0.00781711    0.00595603    0.00195473       10     
reco:opdec:Deconvolution                             0.664062       0.95168       1.37139      0.884095      0.221075        10     
reco:ophitspe:OpHitFinderDeco                         0.12845      0.178865      0.249282      0.160771      0.0473335       10     
reco:opflash:OpFlashFinder                           0.0540017     0.084006      0.155196      0.0751269     0.0286899       10     
reco:opslicer:OpSlicer                                0.1572       0.257266      0.440979      0.221812      0.0916313       10     
reco:wclsdatahd:WireCellToolkit                       43.3868       98.2686       307.219        47.52        85.5414        10     
reco:gaushit:GausHitFinder                           0.546927      0.879508       1.45624      0.833247      0.262234        10     
reco:nhitsfilter:NumberOfHitsFilter                  0.0003454    0.000554197   0.00118389    0.000534875   0.000230696      10     
reco:reco3d:SpacePointSolver                          0.31214       1.20548       3.84299       1.00023      0.978779        10     
reco:hitpdune:DisambigFromSpacePoints                0.257658      0.769218       2.05803      0.663876      0.494941        10     
reco:pandora:StandardPandora                          8.91473       70.6722       241.523       30.1311       76.6016        10     
reco:pandoraWriter:StandardPandora                   0.187862      0.292692      0.487409      0.286635      0.0778391       10     
reco:pandoraTrack:LArPandoraTrackCreation            0.837202       2.15745       4.76644       1.99335       1.03693        10     
reco:pandoraShower:LArPandoraShowerCreation          0.814476       2.17101       5.63481       1.7336        1.28067        10     
reco:pandoracalo:Calorimetry                         0.440198      0.968851       1.92965       0.8682       0.423813        10     
reco:pandoracalonosce:Calorimetry                    0.447502      0.966729       1.88434      0.906323      0.397672        10     
reco:pandoraShowercalo:ShowerCalorimetry             0.821562       1.90827       4.35275       1.61388      0.934899        10     
reco:pandoraShowercalonosce:ShowerCalorimetry        0.796294       1.76444       4.12755       1.47971       0.88672        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0439009     0.058025      0.091604      0.0540732     0.0145514       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0433122     0.0569261     0.0917668     0.0533611     0.0143421       10     
reco:emtrkmichelid:EmTrackMichelId                    22.0798       32.7808       54.7198       30.6454       10.3853        10     
reco:crttag:SingleCRTMatchingProducer               0.00330059     0.006236      0.0139663    0.00491795    0.00333723       10     
reco:crtreco:TwoCRTMatchingProducer                  0.0030409    0.00532893     0.0101878     0.0046887    0.00225095       10     
reco:pandora2Track:LArPandoraTrackCreation            1.89782       5.68713       10.9717       4.91439       2.93379        10     
reco:pandora2calo:ShowerCalorimetry                  0.601021       1.83877       3.24406       1.81259      0.854578        10     
reco:pandora2calonosce:ShowerCalorimetry             0.577854       1.80748       3.32492       1.84697       0.86181        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry           0.04222      0.0600704     0.0881793     0.0536874     0.0158565       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0408985     0.0605377     0.0894322     0.0534091     0.0164338       10     
reco:pandora2Shower:LArPandoraShowerCreation         0.785615       2.41562       4.24126       2.59559       1.05535        10     
reco:pandora2Showercalo:ShowerCalorimetry            0.790172       2.18175       4.18324       2.07184       1.00236        10     
reco:pandora2Showercalonosce:ShowerCalorimetry       0.781596       2.13055       3.93815       2.0013        0.96041        10     
[art]:TriggerResults:TriggerResultInserter          1.6001e-05    2.32596e-05   6.5322e-05     1.737e-05    1.42901e-05      10     
end_path:out1:RootOutput                             3.77e-06      5.572e-06     1.782e-05     4.115e-06    4.10586e-06      10     
end_path:out1:RootOutput(write)                       1.61402       2.1981        4.05349       1.99735      0.679713        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6216.92 MB
  Peak resident set size usage (VmHWM): 3983.72 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim_reco1.root', 'start_time': 1758910925.366978, 'end_time': 1758913391.3157067}
lsing
total 11G
-rw-r--r-- 1 dune001 dune 5.4G Sep 26 21:03 prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim_reco1.root
-rw-r--r-- 1 dune001 dune 5.1G Sep 26 20:22 prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim.root
-rw-r--r-- 1 dune001 dune  52M Sep 26 21:02 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 196K Sep 26 21:03 mem.db
-rw-r--r-- 1 dune001 dune 178K Sep 26 21:03 jobscript.log
-rw-r--r-- 1 dune001 dune  36K Sep 26 21:03 time.db
-rw-r--r-- 1 dune001 dune  13K Sep 26 21:03 prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim_reco1.err
-rw-r--r-- 1 dune001 dune  12K Sep 26 20:22 prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim.log
-rw-r--r-- 1 dune001 dune 9.5K Sep 26 21:03 prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim_reco1.log
-rw-r--r-- 1 dune001 dune 4.4K Sep 26 20:22 prod_beam_p5GeV_protodunehd_1_207247_11_1758899979_detsim.err
-rw-r--r-- 1 dune001 dune 3.5K Sep 26 21:03 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune  519 Sep 26 20:22 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 dune001 dune  519 Sep 26 21:03 reco_protodunehd_hist.root
-rw-r--r-- 1 dune001 dune  111 Sep 26 17:19 all-input-dids.txt
-rw-r--r-- 1 dune001 dune    0 Sep 26 20:29 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune    0 Sep 26 20:22 debugprod.log
disk usage
11G	.
justIN time: 2025-11-05 13:03:53 UTC       justIN version: 01.05.01