justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47174.0@dunegpschedd01.fnal.gov

Jobsub ID47174.0@dunegpschedd01.fnal.gov
Workflow ID2573
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 21:46:22
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2025-09-16 23:59:57
From worker nodeHostnamewn-la-13.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 21:47:57
Input filesusertests:prod_beam_p5GeV_protodunehd_1_39241_41_1757750403_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time2h (7647s)
CPU time2h (7483s = 97%)
Max RSS bytes8107696128 (7732 MiB)
Outputting started2025-09-16 23:55:25
Output filesusertests:prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02573/1/001/prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02573/1/001/prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02573/1/001/prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02573/1/001/prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2_tfile.root
Finished2025-09-16 23:59:57
Saved logsjustin-logs:47174.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102910 traces tagged "gauss"
FrameSaver: q=3.10767e+06 n=1564446 tag=gauss
wclsFrameSaver: saving 124237 traces tagged "wiener"
FrameSaver: q=3.32594e+06 n=1520421 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 89831 traces, 89831 summary
Retagger: tagging trace set: gauss with 77603 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77603 traces tagged "gauss"
FrameSaver: q=1.9352e+06 n=1092846 tag=gauss
wclsFrameSaver: saving 89831 traces tagged "wiener"
FrameSaver: q=2.08322e+06 n=1068244 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 86783 traces, 86783 summary
Retagger: tagging trace set: gauss with 75667 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75667 traces tagged "gauss"
FrameSaver: q=2.05221e+06 n=1066168 tag=gauss
wclsFrameSaver: saving 86783 traces tagged "wiener"
FrameSaver: q=2.16515e+06 n=1055221 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 95268 traces, 95268 summary
Retagger: tagging trace set: gauss with 80929 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 80929 traces tagged "gauss"
FrameSaver: q=2.20597e+06 n=1178630 tag=gauss
wclsFrameSaver: saving 95268 traces tagged "wiener"
FrameSaver: q=2.36904e+06 n=1165091 tag=wiener
17-Sep-2025 01:55:22 CEST  Closed output file "prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.root"
17-Sep-2025 01:55:22 CEST  Closed input file "prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            146.431       211.29        363.851       180.987       68.7286        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.00114486    0.00781666     0.0160845    0.00629363    0.00479608       10     
reco:wclsdatahd:WireCellToolkit                       45.9183       50.7852       59.8398       50.9649       3.6134         10     
reco:gaushit:GausHitFinder                           0.677509      0.873098       1.0868       0.853912      0.149792        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000636203   0.00176566    0.00310503    0.00131111    0.00101209       10     
reco:reco3d:SpacePointSolver                         0.606607       1.91716       8.11707       1.18209       2.12427        10     
reco:hitpdune:DisambigFromSpacePoints                0.462439      0.849284       1.34223      0.729759      0.323037        10     
reco:pandora:StandardPandora                          16.064        42.065        149.354       29.2858       37.5527        10     
reco:pandoraWriter:StandardPandora                   0.248595      0.330621      0.445483      0.304592      0.0686451       10     
reco:pandoraTrack:LArPandoraTrackCreation             2.34445       3.91541       6.44397       3.65293       1.25734        10     
reco:pandoraShower:LArPandoraShowerCreation           2.44563       4.84525       9.03422       4.31314       2.16599        10     
reco:pandoracalo:Calorimetry                         0.968042       1.77996       2.8384        1.6784       0.629368        10     
reco:pandoracalonosce:Calorimetry                    0.970877       1.74242       2.66168       1.59638      0.643413        10     
reco:pandoraShowercalo:ShowerCalorimetry              1.79891       3.8653        7.30766       3.08155       1.91565        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         2.03281       3.56645       6.87754       2.6503        1.75224        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0484699     0.0566569     0.0696634     0.0529826    0.00742739       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0443592     0.0551282     0.0691444     0.0530846    0.00716211       10     
reco:emtrkmichelid:EmTrackMichelId                    19.5685       24.0891       30.5442       23.161        3.94361        10     
reco:opdec:Deconvolution                             0.820694      0.936156       1.05832      0.929456      0.0828053       10     
reco:ophitspe:OpHitFinderDeco                        0.148079      0.160114       0.20793      0.153293      0.0174326       10     
reco:opflash:OpFlashFinder                           0.0961727     0.129001      0.179154      0.125705      0.0275692       10     
reco:opslicer:OpSlicer                               0.236537      0.283066      0.341124      0.273862      0.0349077       10     
reco:crtreco:TwoCRTMatchingProducer                  0.0076639     0.0129606     0.0208225     0.0117047    0.00404499       10     
reco:crttag:SingleCRTMatchingProducer                0.0064255     0.0101191     0.016721     0.00919465    0.00310162       10     
reco:pandora2Track:LArPandoraTrackCreation            5.54292       10.1411       19.0808       7.77608       4.63149        10     
reco:pandora2calo:ShowerCalorimetry                   1.4671        3.18421       6.16619       2.24308        1.721         10     
reco:pandora2calonosce:ShowerCalorimetry              1.33127       2.9866        5.57634       2.40443       1.4604         10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.0437957     0.059652      0.110224      0.0523375     0.0186455       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.043834      0.0589724     0.0968567     0.0539234     0.0147412       10     
reco:pandora2Shower:LArPandoraShowerCreation          2.22711       4.12738       7.11591       3.58068       1.85722        10     
reco:pandora2Showercalo:ShowerCalorimetry             1.79672       3.73046       6.28432       3.13617       1.69794        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        1.79041       3.42137       5.91099       2.6474        1.62012        10     
[art]:TriggerResults:TriggerResultInserter          2.1291e-05    4.12657e-05   0.000106048   3.3811e-05    2.3235e-05       10     
end_path:out1:RootOutput                             5.267e-06    8.2023e-06    2.5288e-05     6.134e-06    5.76206e-06      10     
end_path:michelremoving:michelremoving               0.0383654     0.182828      0.499467      0.134057      0.157356        10     
end_path:michelremovinggnocchi:michelremoving        0.0342428     0.173474      0.466698      0.132107      0.150828        10     
end_path:calibanagnocchi:CalibAnaTree                 20.4278       38.5364       93.943        28.6819       21.3893        10     
end_path:out1:RootOutput(write)                       1.79028       2.15643       2.58544       2.05401      0.289855        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8385.74 MB
  Peak resident set size usage (VmHWM): 5936.25 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.root', 'tfile_out': 'prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2_tfile.root', 'start_time': 1758064711.6010916, 'end_time': 1758066924.2904356}
lsing
total 20G
-rw-r--r--. 1 dune003 dune 6.8G Sep 17 01:18 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1.root
-rw-r--r--. 1 dune003 dune 6.2G Sep 17 01:13 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim.root
-rw-r--r--. 1 dune003 dune 6.0G Sep 17 01:55 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.root
-rw-r--r--. 1 dune003 dune  61M Sep 17 01:55 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2_tfile.root
-rw-r--r--. 1 dune003 dune  56M Sep 17 01:53 Pandora_Events.pndr
-rw-r--r--. 1 dune003 dune 220K Sep 17 01:55 mem.db
-rw-r--r--. 1 dune003 dune 199K Sep 17 01:55 jobscript.log
-rw-r--r--. 1 dune003 dune  40K Sep 17 01:55 time.db
-rw-r--r--. 1 dune003 dune  13K Sep 17 01:55 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.log
-rw-r--r--. 1 dune003 dune  13K Sep 17 01:55 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1_reco2.err
-rw-r--r--. 1 dune003 dune  13K Sep 17 01:13 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim.log
-rw-r--r--. 1 dune003 dune 6.8K Sep 17 01:18 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1.err
-rw-r--r--. 1 dune003 dune 4.5K Sep 17 01:13 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim.err
-rw-r--r--. 1 dune003 dune 3.5K Sep 17 01:55 Pandora_Geometry.xml
-rw-r--r--. 1 dune003 dune 1.4K Sep 17 01:18 prod_beam_p5GeV_protodunehd_1_47174_0_1758059290_detsim_reco1.log
-rw-r--r--. 1 dune003 dune  519 Sep 17 01:13 detsim_single_protodunehd_hist.root
-rw-r--r--. 1 dune003 dune  519 Sep 17 01:18 reco_protodunehd_hist.root
-rw-r--r--. 1 dune003 dune  109 Sep 16 23:48 all-input-dids.txt
-rw-r--r--. 1 dune003 dune    0 Sep 17 01:23 ProtoDUNE.log
-rw-r--r--. 1 dune003 dune    0 Sep 17 01:18 debugprod.log
disk usage
20G	.
justIN time: 2025-09-19 06:52:53 UTC       justIN version: 01.05.00