Jobsub ID 44201.1@dunegpschedd01.fnal.gov
| Jobsub ID | 44201.1@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 08:06:05 | |
| Site | US_UChicago | |
| Entry | Engage_US_MWT2_iut2_gk02_condce_mcore | |
| Last heartbeat | 2025-09-10 08:55:42 | |
| From worker node | Hostname | iut2-c425.iu.edu |
| cpuinfo | AMD EPYC 7443 24-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 08:06:56 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_000988_412718_1_20250614T003227.root | |
| Jobscript | Exit code | 0 |
| Real time | 47m (2857s) | |
| CPU time | 45m (2740s = 95%) | |
| Max RSS bytes | 4093505536 (3903 MiB) | |
| Outputting started | 2025-09-10 08:54:34 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log | |
| Finished | 2025-09-10 08:55:42 | |
| Saved logs | justin-logs:44201.1-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
um geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 04:47:12 EDT Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 04:47:13 EDT Opened input file "prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 83816 traces, 83816 summary
Retagger: tagging trace set: gauss with 72828 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 72828 traces tagged "gauss"
FrameSaver: q=1.92945e+06 n=1074610 tag=gauss
wclsFrameSaver: saving 83816 traces tagged "wiener"
FrameSaver: q=1.99373e+06 n=1047518 tag=wiener
10-Sep-2025 04:50:02 EDT Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 74930 traces, 74930 summary
Retagger: tagging trace set: gauss with 64544 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 64544 traces tagged "gauss"
FrameSaver: q=1.59024e+06 n=902789 tag=gauss
wclsFrameSaver: saving 74930 traces tagged "wiener"
FrameSaver: q=1.65774e+06 n=886805 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 71707 traces, 71707 summary
Retagger: tagging trace set: gauss with 61617 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 61617 traces tagged "gauss"
FrameSaver: q=1.33838e+06 n=756228 tag=gauss
wclsFrameSaver: saving 71707 traces tagged "wiener"
FrameSaver: q=1.47771e+06 n=789855 tag=wiener
10-Sep-2025 04:54:32 EDT Closed output file "prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 04:54:32 EDT Closed input file "prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 120.995 138.617 166.451 128.406 19.9128 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00171134 0.00246786 0.00287152 0.00282071 0.000535337 3
reco:wclsdatahd:WireCellToolkit 40.9153 43.2207 44.6334 44.1134 1.64391 3
reco:gaushit:GausHitFinder 0.645334 0.737838 0.88753 0.68065 0.106826 3
reco:nhitsfilter:NumberOfHitsFilter 0.0006348 0.00111024 0.00151128 0.00118466 0.000361668 3
reco:reco3d:SpacePointSolver 0.461408 0.732892 1.09163 0.64564 0.26458 3
reco:hitpdune:DisambigFromSpacePoints 0.380927 0.526014 0.762455 0.43466 0.168622 3
reco:pandora:StandardPandora 8.22527 14.8594 19.1132 17.2396 4.75297 3
reco:pandoraWriter:StandardPandora 0.232729 0.35515 0.475405 0.357316 0.0990839 3
reco:pandoraTrack:LArPandoraTrackCreation 2.36943 2.55467 2.86857 2.426 0.223165 3
reco:pandoraShower:LArPandoraShowerCreation 1.83954 2.59989 4.04889 1.91122 1.02502 3
reco:pandoracalo:Calorimetry 0.871136 1.09919 1.23438 1.19205 0.16218 3
reco:pandoracalonosce:Calorimetry 0.619468 0.944947 1.40439 0.81098 0.334152 3
reco:pandoraShowercalo:ShowerCalorimetry 0.849746 1.7464 2.29356 2.0959 0.639146 3
reco:pandoraShowercalonosce:ShowerCalorimetry 0.882581 1.54727 2.02784 1.73139 0.48534 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0516013 0.0852765 0.117515 0.0867129 0.0269284 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0785346 0.090648 0.106797 0.0866119 0.0118859 3
reco:emtrkmichelid:EmTrackMichelId 26.444 33.0949 42.0848 30.756 6.59604 3
reco:opdec:Deconvolution 0.779146 0.90953 1.04952 0.899925 0.110589 3
reco:ophitspe:OpHitFinderDeco 0.291044 0.329749 0.401649 0.296556 0.0508904 3
reco:opflash:OpFlashFinder 0.0565333 0.104759 0.154195 0.10355 0.0398792 3
reco:opslicer:OpSlicer 0.206081 0.300293 0.366984 0.327813 0.0685101 3
reco:crtreco:TwoCRTMatchingProducer 0.00777279 0.0122913 0.0175887 0.0115124 0.00404499 3
reco:crttag:SingleCRTMatchingProducer 0.0057256 0.00999159 0.0140163 0.0102329 0.00338896 3
reco:pandora2Track:LArPandoraTrackCreation 2.00907 5.43794 7.90518 6.39957 2.50128 3
reco:pandora2calo:ShowerCalorimetry 0.45019 1.59307 2.39169 1.93734 0.829153 3
reco:pandora2calonosce:ShowerCalorimetry 0.502338 1.60117 2.50498 1.79619 0.829122 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0408377 0.0581945 0.0804135 0.0533322 0.0165185 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0360301 0.0504096 0.0673299 0.0478688 0.0129038 3
reco:pandora2Shower:LArPandoraShowerCreation 0.792672 1.36867 1.73713 1.57621 0.412558 3
reco:pandora2Showercalo:ShowerCalorimetry 0.733898 1.55814 2.36712 1.57339 0.666848 3
reco:pandora2Showercalonosce:ShowerCalorimetry 0.618823 1.98213 2.94604 2.38153 0.99117 3
[art]:TriggerResults:TriggerResultInserter 4.2771e-05 0.000105887 0.000219916 5.4973e-05 8.07846e-05 3
end_path:out1:RootOutput 1.06e-05 2.5351e-05 5.1657e-05 1.3796e-05 1.86469e-05 3
end_path:michelremoving:michelremoving 0.0300225 0.269941 0.537651 0.242149 0.208168 3
end_path:michelremovinggnocchi:michelremoving 0.0260438 0.230322 0.468246 0.196676 0.182089 3
end_path:calibanagnocchi:CalibAnaTree 11.4463 16.3884 20.8593 16.8595 3.85724 3
end_path:out1:RootOutput(write) 1.21487 1.99529 2.67506 2.09593 0.600354 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6417.09 MB
Peak resident set size usage (VmHWM): 4054.92 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44201_1_1757491637_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757493962.2805305, 'end_time': 1757494474.271227}