justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 207247.13@dunegpschedd02.fnal.gov

Jobsub ID207247.13@dunegpschedd02.fnal.gov
Workflow ID8090
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-26 14:09:37
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2025-09-26 16:56:58
From worker nodeHostnamemilan17.farm.particle.cz
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-26 15:21:23
Input filesusertests:prod_beam_p5GeV_protodunehd_1_212254_72_1758821484_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time1h (5654s)
CPU time1h (5517s = 97%)
Max RSS bytes6576304128 (6271 MiB)
Outputting started2025-09-26 16:55:38
Output filesusertests:prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim_reco1.root
Finished2025-09-26 16:56:58
Saved logsjustin-logs:207247.13-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

summary
Retagger: tagging trace set: gauss with 64037 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 64037 traces tagged "gauss"
FrameSaver: q=1.77384e+06 n=987383 tag=gauss
wclsFrameSaver: saving 77169 traces tagged "wiener"
FrameSaver: q=2.22934e+06 n=962607 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 93738 traces, 93738 summary
Retagger: tagging trace set: gauss with 75748 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75748 traces tagged "gauss"
FrameSaver: q=2.21673e+06 n=1189822 tag=gauss
wclsFrameSaver: saving 93738 traces tagged "wiener"
FrameSaver: q=2.95686e+06 n=1164324 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 67864 traces, 67864 summary
Retagger: tagging trace set: gauss with 56403 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 56403 traces tagged "gauss"
FrameSaver: q=1.5092e+06 n=787958 tag=gauss
wclsFrameSaver: saving 67864 traces tagged "wiener"
FrameSaver: q=2.03422e+06 n=786684 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 84908 traces, 84908 summary
Retagger: tagging trace set: gauss with 70075 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 70075 traces tagged "gauss"
FrameSaver: q=1.98034e+06 n=1041234 tag=gauss
wclsFrameSaver: saving 84908 traces tagged "wiener"
FrameSaver: q=2.64417e+06 n=1022098 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 101052 traces, 101052 summary
Retagger: tagging trace set: gauss with 82660 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82660 traces tagged "gauss"
FrameSaver: q=2.68015e+06 n=1280381 tag=gauss
wclsFrameSaver: saving 101052 traces tagged "wiener"
FrameSaver: q=3.6113e+06 n=1255407 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 77414 traces, 77414 summary
Retagger: tagging trace set: gauss with 62448 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 62448 traces tagged "gauss"
FrameSaver: q=1.67492e+06 n=927832 tag=gauss
wclsFrameSaver: saving 77414 traces tagged "wiener"
FrameSaver: q=2.11579e+06 n=898735 tag=wiener
26-Sep-2025 18:55:36 CEST  Closed output file "prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim_reco1.root"
26-Sep-2025 18:55:36 CEST  Closed input file "prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            86.3228       114.606       179.081       111.247       26.242         10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000616369    0.0042159    0.00778034    0.00418031    0.00216447       10     
reco:opdec:Deconvolution                             0.620942      0.780127      0.940231      0.768261      0.100184        10     
reco:ophitspe:OpHitFinderDeco                        0.119166      0.161891      0.233137       0.13224      0.0463038       10     
reco:opflash:OpFlashFinder                           0.0515852     0.0805893     0.120231      0.0806972     0.0176436       10     
reco:opslicer:OpSlicer                               0.179516      0.231713      0.281368      0.230683      0.0348225       10     
reco:wclsdatahd:WireCellToolkit                       41.6708       43.2388       45.0786       43.0093       1.16238        10     
reco:gaushit:GausHitFinder                           0.365777      0.630373      0.883432      0.615604      0.137181        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000147639   0.000245905   0.00039719    0.000254589   7.26162e-05      10     
reco:reco3d:SpacePointSolver                         0.330492      0.801184       1.64577      0.681401       0.37912        10     
reco:hitpdune:DisambigFromSpacePoints                0.250534      0.588751       1.32064      0.492439      0.318519        10     
reco:pandora:StandardPandora                          6.93972       22.6485       71.5798       16.7722       17.9484        10     
reco:pandoraWriter:StandardPandora                    0.13501      0.202736      0.305484      0.205874      0.0471314       10     
reco:pandoraTrack:LArPandoraTrackCreation            0.574796       1.17194       1.72499       1.15535      0.392908        10     
reco:pandoraShower:LArPandoraShowerCreation          0.466478       1.04162       1.59524       0.97474      0.355291        10     
reco:pandoracalo:Calorimetry                         0.344543      0.603865       0.9036        0.6228       0.191375        10     
reco:pandoracalonosce:Calorimetry                    0.343081      0.617208      0.922472      0.620874      0.195658        10     
reco:pandoraShowercalo:ShowerCalorimetry             0.520268       1.11421       1.83798       1.10559      0.345724        10     
reco:pandoraShowercalonosce:ShowerCalorimetry        0.620044       1.09175       1.61768       1.01855      0.310888        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0247895     0.0452972     0.0732714     0.0406525      0.01446        10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0234741     0.0456504     0.0726308     0.0457005     0.0141158       10     
reco:emtrkmichelid:EmTrackMichelId                    20.5957       28.3399       34.0224       27.7364       4.50331        10     
reco:crttag:SingleCRTMatchingProducer               0.00314244    0.00509706    0.00731242     0.0054009    0.00133982       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00281669    0.00393083    0.00533378    0.00401729     0.0008498       10     
reco:pandora2Track:LArPandoraTrackCreation            1.59033       2.84196       3.95222       3.03003      0.878936        10     
reco:pandora2calo:ShowerCalorimetry                  0.521162      0.990572       1.53419      0.961147      0.293387        10     
reco:pandora2calonosce:ShowerCalorimetry             0.407296      0.992997       1.54826       1.01178      0.341803        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.024557      0.0510497     0.0742193     0.0544041     0.0158058       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.023339      0.0498688     0.0719329     0.0501113     0.0159569       10     
reco:pandora2Shower:LArPandoraShowerCreation         0.648132       1.2418        1.74495       1.1581       0.386556        10     
reco:pandora2Showercalo:ShowerCalorimetry            0.822936       1.41247       2.07299       1.41655       0.42358        10     
reco:pandora2Showercalonosce:ShowerCalorimetry       0.776373       1.34728       2.02409       1.38032      0.384437        10     
[art]:TriggerResults:TriggerResultInserter           1.86e-05     3.6646e-05    0.00013545    2.7335e-05    3.32029e-05      10     
end_path:out1:RootOutput                             7.69e-06     1.1008e-05     3.326e-05     8.685e-06    7.43592e-06      10     
end_path:out1:RootOutput(write)                       1.41534       2.16475       2.80933       2.1629       0.410134        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6212.55 MB
  Peak resident set size usage (VmHWM): 3979.8 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim_reco1.root', 'start_time': 1758904501.5200872, 'end_time': 1758905737.8572297}
lsing
total 11G
-rw-r--r-- 1 fermilab users 5.5G Sep 26 18:55 prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim_reco1.root
-rw-r--r-- 1 fermilab users 5.2G Sep 26 18:35 prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim.root
-rw-r--r-- 1 fermilab users  46M Sep 26 18:55 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 196K Sep 26 18:55 mem.db
-rw-r--r-- 1 fermilab users 196K Sep 26 18:55 jobscript.log
-rw-r--r-- 1 fermilab users  36K Sep 26 18:55 time.db
-rw-r--r-- 1 fermilab users  28K Sep 26 18:55 prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim_reco1.log
-rw-r--r-- 1 fermilab users  13K Sep 26 18:55 prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim_reco1.err
-rw-r--r-- 1 fermilab users  12K Sep 26 18:35 prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim.log
-rw-r--r-- 1 fermilab users 4.4K Sep 26 18:35 prod_beam_p5GeV_protodunehd_1_207247_13_1758900092_detsim.err
-rw-r--r-- 1 fermilab users 3.5K Sep 26 18:55 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users  519 Sep 26 18:35 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 fermilab users  519 Sep 26 18:55 reco_protodunehd_hist.root
-rw-r--r-- 1 fermilab users  110 Sep 26 17:21 all-input-dids.txt
-rw-r--r-- 1 fermilab users    0 Sep 26 18:37 ProtoDUNE.log
-rw-r--r-- 1 fermilab users    0 Sep 26 18:35 debugprod.log
disk usage
11G	.
justIN time: 2025-11-05 13:03:53 UTC       justIN version: 01.05.01