justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40382.1@dunegpschedd02.fnal.gov

Jobsub ID40382.1@dunegpschedd02.fnal.gov
Workflow ID2568
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 11:34:52
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-09-16 16:38:56
From worker nodeHostnamewn1205091.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 11:35:37
Input filesusertests:prod_beam_p5GeV_protodunehd_1_39241_5_1757750254_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time4h (17963s)
CPU time3h (13098s = 72%)
Max RSS bytes6885134336 (6566 MiB)
Outputting started2025-09-16 16:35:01
Output filesusertests:prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02568/1/001/prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02568/1/001/prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02568/1/001/prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02568/1/001/prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2_tfile.root
Finished2025-09-16 16:38:56
Saved logsjustin-logs:40382.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 92695 traces tagged "gauss"
FrameSaver: q=2.70482e+06 n=1429479 tag=gauss
wclsFrameSaver: saving 108070 traces tagged "wiener"
FrameSaver: q=2.77525e+06 n=1373094 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 116838 traces, 116838 summary
Retagger: tagging trace set: gauss with 96614 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 96614 traces tagged "gauss"
FrameSaver: q=2.85208e+06 n=1460807 tag=gauss
wclsFrameSaver: saving 116838 traces tagged "wiener"
FrameSaver: q=3.05631e+06 n=1401096 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 91201 traces, 91201 summary
Retagger: tagging trace set: gauss with 76840 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 76840 traces tagged "gauss"
FrameSaver: q=2.16032e+06 n=1099496 tag=gauss
wclsFrameSaver: saving 91201 traces tagged "wiener"
FrameSaver: q=2.28216e+06 n=1081292 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 98789 traces, 98789 summary
Retagger: tagging trace set: gauss with 83210 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83210 traces tagged "gauss"
FrameSaver: q=2.46969e+06 n=1189082 tag=gauss
wclsFrameSaver: saving 98789 traces tagged "wiener"
FrameSaver: q=2.62329e+06 n=1155965 tag=wiener
16-Sep-2025 17:34:57 BST  Closed output file "prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.root"
16-Sep-2025 17:34:57 BST  Closed input file "prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            270.383       430.351       617.285        451.1        111.088        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.00268428    0.00802899     0.0134432    0.00847254    0.00304583       10     
reco:wclsdatahd:WireCellToolkit                       65.465        74.1233       86.7201       71.2823       6.55858        10     
reco:gaushit:GausHitFinder                            1.16667       1.82025       2.46216       1.82738      0.420385        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.00115747    0.00170371    0.00310756    0.00143825    0.000563133      10     
reco:reco3d:SpacePointSolver                          1.44157       2.62229       4.28096       2.50751      0.822083        10     
reco:hitpdune:DisambigFromSpacePoints                0.966313       1.96271       2.66187       2.12998       0.54829        10     
reco:pandora:StandardPandora                          31.7867       66.2867       106.803       62.9517       22.061         10     
reco:pandoraWriter:StandardPandora                   0.519364      0.706934      0.862706      0.697857      0.0932853       10     
reco:pandoraTrack:LArPandoraTrackCreation             3.41293       8.04115       17.4479       7.72258       3.87807        10     
reco:pandoraShower:LArPandoraShowerCreation           4.95724       10.6243       21.256        10.3531       4.69987        10     
reco:pandoracalo:Calorimetry                          1.09516       4.2762        11.2131       3.96206       2.79049        10     
reco:pandoracalonosce:Calorimetry                     1.26249       4.33974       10.6514       4.41518       2.60381        10     
reco:pandoraShowercalo:ShowerCalorimetry              3.52076       11.3229       23.7707       10.7693       5.93959        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         2.87233       10.3225       22.7887       9.82148       5.60324        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0767723     0.135299       0.20325      0.134383      0.0412865       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0869435     0.137727       0.20156       0.12972      0.0392082       10     
reco:emtrkmichelid:EmTrackMichelId                    46.7295       72.6079       112.169       72.6677       17.886         10     
reco:opdec:Deconvolution                              1.21953       1.61627       1.94023       1.63386      0.194681        10     
reco:ophitspe:OpHitFinderDeco                        0.284621       0.37668      0.443513      0.378495      0.0514004       10     
reco:opflash:OpFlashFinder                           0.102518      0.170781      0.240328      0.176986      0.0433827       10     
reco:opslicer:OpSlicer                               0.407114      0.516086      0.696984      0.480053      0.0927217       10     
reco:crtreco:TwoCRTMatchingProducer                  0.0100268     0.0181386     0.0270002     0.0175406    0.00569511       10     
reco:crttag:SingleCRTMatchingProducer               0.00997922     0.0166139     0.0293464     0.0152782    0.00592575       10     
reco:pandora2Track:LArPandoraTrackCreation            14.2216       24.1013       37.3514       23.8061       7.85143        10     
reco:pandora2calo:ShowerCalorimetry                   3.98293       8.8533        18.7794       7.8646        4.23666        10     
reco:pandora2calonosce:ShowerCalorimetry              2.29141       8.43994       15.2606       7.58858       4.07945        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.092134      0.154862      0.193915      0.163104      0.0325144       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0897831     0.148535      0.198373      0.160965      0.0377512       10     
reco:pandora2Shower:LArPandoraShowerCreation          4.74735       10.8272       17.5471       10.5206       4.08227        10     
reco:pandora2Showercalo:ShowerCalorimetry             5.05625       12.5791       25.311        11.5577       6.15073        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        5.04029       12.6634       22.262        12.784        5.96205        10     
[art]:TriggerResults:TriggerResultInserter          2.4286e-05    5.36278e-05   0.000190388   3.61675e-05   4.7059e-05       10     
end_path:out1:RootOutput                             5.631e-06    9.6783e-06    3.7581e-05     6.643e-06    9.33051e-06      10     
end_path:michelremoving:michelremoving               0.100514      0.492247       1.7468       0.417985       0.45819        10     
end_path:michelremovinggnocchi:michelremoving        0.0974819     0.475926       1.56715      0.396941      0.412678        10     
end_path:calibanagnocchi:CalibAnaTree                 47.3865        75.3         111.524       74.769        21.5322        10     
end_path:out1:RootOutput(write)                       2.81578       3.96898       4.86751       3.93226      0.595689        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8013.14 MB
  Peak resident set size usage (VmHWM): 5567.64 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.root', 'tfile_out': 'prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2_tfile.root', 'start_time': 1758035960.9374344, 'end_time': 1758040500.688222}
lsing
total 18G
-rw-r--r-- 1 dune01 dune01 6.2G Sep 16 16:19 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1.root
-rw-r--r-- 1 dune01 dune01 5.6G Sep 16 16:12 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim.root
-rw-r--r-- 1 dune01 dune01 5.4G Sep 16 17:34 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.root
-rw-r--r-- 1 dune01 dune01  66M Sep 16 17:34 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2_tfile.root
-rw-r--r-- 1 dune01 dune01  58M Sep 16 17:31 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 377K Sep 16 17:35 jobscript.log
-rw-r--r-- 1 dune01 dune01 220K Sep 16 17:34 mem.db
-rw-r--r-- 1 dune01 dune01 191K Sep 16 17:35 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.log
-rw-r--r-- 1 dune01 dune01  40K Sep 16 17:34 time.db
-rw-r--r-- 1 dune01 dune01  13K Sep 16 17:35 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1_reco2.err
-rw-r--r-- 1 dune01 dune01  13K Sep 16 16:12 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim.log
-rw-r--r-- 1 dune01 dune01 6.8K Sep 16 16:19 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1.err
-rw-r--r-- 1 dune01 dune01 4.5K Sep 16 16:12 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim.err
-rw-r--r-- 1 dune01 dune01 3.5K Sep 16 17:34 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 1.4K Sep 16 16:19 prod_beam_p5GeV_protodunehd_1_40382_1_1758022564_detsim_reco1.log
-rw-r--r-- 1 dune01 dune01  519 Sep 16 16:12 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 dune01 dune01  519 Sep 16 16:19 reco_protodunehd_hist.root
-rw-r--r-- 1 dune01 dune01  108 Sep 16 12:36 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01    0 Sep 16 16:26 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01    0 Sep 16 16:19 debugprod.log
disk usage
18G	.
justIN time: 2025-09-19 14:58:27 UTC       justIN version: 01.05.00