Jobsub ID 44175.3@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.3@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_UChicago | |
| Entry | Engage_US_MWT2_iut2_gk02_condce_mcore | |
| Last heartbeat | 2025-09-10 08:22:56 | |
| From worker node | Hostname | mwt2-c049.campuscluster.illinois.edu |
| cpuinfo | AMD EPYC 7443 24-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:31 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_001691_412475_21_20250613T180930.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (3714s) | |
| CPU time | 59m (3564s = 95%) | |
| Max RSS bytes | 4915490816 (4687 MiB) | |
| Outputting started | 2025-09-10 08:21:26 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext.log | |
| Finished | 2025-09-10 08:22:56 | |
| Saved logs | justin-logs:44175.3-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
eometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 03:12:50 CDT Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 03:12:51 CDT Opened input file "prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 91411 traces, 91411 summary
Retagger: tagging trace set: gauss with 78864 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 78864 traces tagged "gauss"
FrameSaver: q=2.09932e+06 n=1128568 tag=gauss
wclsFrameSaver: saving 91411 traces tagged "wiener"
FrameSaver: q=2.19792e+06 n=1108797 tag=wiener
10-Sep-2025 03:15:29 CDT Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 85812 traces, 85812 summary
Retagger: tagging trace set: gauss with 73251 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73251 traces tagged "gauss"
FrameSaver: q=1.9594e+06 n=1058243 tag=gauss
wclsFrameSaver: saving 85812 traces tagged "wiener"
FrameSaver: q=2.05281e+06 n=1023753 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 89986 traces, 89986 summary
Retagger: tagging trace set: gauss with 77440 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77440 traces tagged "gauss"
FrameSaver: q=2.11066e+06 n=1124141 tag=gauss
wclsFrameSaver: saving 89986 traces tagged "wiener"
FrameSaver: q=2.21954e+06 n=1094114 tag=wiener
10-Sep-2025 03:21:23 CDT Closed output file "prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 03:21:23 CDT Closed input file "prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 144.728 160.907 182.398 155.595 15.8309 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00122376 0.0021348 0.00345421 0.00172642 0.00095527 3
reco:wclsdatahd:WireCellToolkit 34.8988 38.3425 43.797 36.3318 3.90101 3
reco:gaushit:GausHitFinder 0.671971 0.830414 0.938801 0.880471 0.114539 3
reco:nhitsfilter:NumberOfHitsFilter 0.000640241 0.000801103 0.00102109 0.000741983 0.000161001 3
reco:reco3d:SpacePointSolver 0.439096 0.506265 0.54306 0.536639 0.047568 3
reco:hitpdune:DisambigFromSpacePoints 0.521504 0.714943 0.836579 0.786746 0.138287 3
reco:pandora:StandardPandora 13.5233 16.4536 19.7334 16.1041 2.54728 3
reco:pandoraWriter:StandardPandora 0.307435 0.360869 0.401826 0.373345 0.0395318 3
reco:pandoraTrack:LArPandoraTrackCreation 1.12258 2.30501 3.84724 1.9452 1.14106 3
reco:pandoraShower:LArPandoraShowerCreation 1.18695 1.91665 2.52794 2.03507 0.553821 3
reco:pandoracalo:Calorimetry 0.408145 0.781223 1.01183 0.923696 0.266248 3
reco:pandoracalonosce:Calorimetry 0.492305 0.790736 0.95614 0.923763 0.211436 3
reco:pandoraShowercalo:ShowerCalorimetry 1.0649 1.66541 2.0141 1.91722 0.426459 3
reco:pandoraShowercalonosce:ShowerCalorimetry 1.40002 1.95615 2.32053 2.14788 0.399504 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0422302 0.0581892 0.0768966 0.0554409 0.0142853 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0434474 0.0542369 0.0739007 0.0453624 0.0139264 3
reco:emtrkmichelid:EmTrackMichelId 37.9889 39.4063 41.5187 38.7113 1.52251 3
reco:opdec:Deconvolution 0.977704 1.00109 1.04632 0.979251 0.0319868 3
reco:ophitspe:OpHitFinderDeco 0.227383 0.265947 0.322971 0.247488 0.0411489 3
reco:opflash:OpFlashFinder 0.0970398 0.116694 0.129599 0.123444 0.014123 3
reco:opslicer:OpSlicer 0.281966 0.309125 0.346663 0.298747 0.0274131 3
reco:crtreco:TwoCRTMatchingProducer 0.0100819 0.0129868 0.015446 0.0134324 0.00221247 3
reco:crttag:SingleCRTMatchingProducer 0.00797062 0.0105717 0.0143369 0.0094076 0.00272626 3
reco:pandora2Track:LArPandoraTrackCreation 6.95913 9.23403 11.9589 8.78404 2.06581 3
reco:pandora2calo:ShowerCalorimetry 1.31771 1.69288 2.18722 1.5737 0.364844 3
reco:pandora2calonosce:ShowerCalorimetry 1.58438 1.70273 1.80204 1.72178 0.0898737 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0548207 0.0590259 0.0621893 0.0600677 0.00309707 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0462794 0.0486364 0.051834 0.0477957 0.00234427 3
reco:pandora2Shower:LArPandoraShowerCreation 2.54309 3.13243 3.91468 2.93952 0.576323 3
reco:pandora2Showercalo:ShowerCalorimetry 2.69155 3.28404 4.28523 2.87533 0.711912 3
reco:pandora2Showercalonosce:ShowerCalorimetry 2.38345 3.05299 3.63597 3.13955 0.51499 3
[art]:TriggerResults:TriggerResultInserter 8.4218e-05 0.000126888 0.000166933 0.000129513 3.38192e-05 3
end_path:out1:RootOutput 1.1421e-05 2.84333e-05 4.8411e-05 2.5468e-05 1.5246e-05 3
end_path:michelremoving:michelremoving 0.106131 0.291954 0.504657 0.265073 0.163804 3
end_path:michelremovinggnocchi:michelremoving 0.0687238 0.26479 0.483207 0.242438 0.169948 3
end_path:calibanagnocchi:CalibAnaTree 25.3424 27.4254 30.5811 26.3527 2.2692 3
end_path:out1:RootOutput(write) 2.57849 2.67764 2.79228 2.66215 0.0879608 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6766.93 MB
Peak resident set size usage (VmHWM): 4368.88 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_3_1757488792_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757491902.1897087, 'end_time': 1757492485.9378521}