Jobsub ID 44175.6@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.6@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_UChicago | |
| Entry | Engage_US_MWT2_uiuc_condce_mcore | |
| Last heartbeat | 2025-09-10 08:22:24 | |
| From worker node | Hostname | mwt2-c011.campuscluster.illinois.edu |
| cpuinfo | AMD EPYC 7302 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:48 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_008490_220006_13_20250614T013506.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (3666s) | |
| CPU time | 58m (3521s = 96%) | |
| Max RSS bytes | 4701786112 (4483 MiB) | |
| Outputting started | 2025-09-10 08:20:54 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant.log | |
| Finished | 2025-09-10 08:22:24 | |
| Saved logs | justin-logs:44175.6-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
eometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 03:12:33 CDT Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 03:12:34 CDT Opened input file "prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 73611 traces, 73611 summary
Retagger: tagging trace set: gauss with 64473 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 64473 traces tagged "gauss"
FrameSaver: q=1.58941e+06 n=891012 tag=gauss
wclsFrameSaver: saving 73611 traces tagged "wiener"
FrameSaver: q=1.69468e+06 n=875972 tag=wiener
10-Sep-2025 03:14:39 CDT Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 95464 traces, 95464 summary
Retagger: tagging trace set: gauss with 78234 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 78234 traces tagged "gauss"
FrameSaver: q=2.26561e+06 n=1172636 tag=gauss
wclsFrameSaver: saving 95464 traces tagged "wiener"
FrameSaver: q=2.45269e+06 n=1106957 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 102753 traces, 102753 summary
Retagger: tagging trace set: gauss with 84524 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 84524 traces tagged "gauss"
FrameSaver: q=2.39777e+06 n=1232203 tag=gauss
wclsFrameSaver: saving 102753 traces tagged "wiener"
FrameSaver: q=2.57194e+06 n=1181280 tag=wiener
10-Sep-2025 03:20:52 CDT Closed output file "prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 03:20:52 CDT Closed input file "prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 120.746 158.282 199.347 154.755 32.1852 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00159494 0.00200832 0.00255846 0.00187156 0.000405071 3
reco:wclsdatahd:WireCellToolkit 36.4467 37.5058 38.249 37.8217 0.76893 3
reco:gaushit:GausHitFinder 0.828836 1.00762 1.1149 1.07911 0.127259 3
reco:nhitsfilter:NumberOfHitsFilter 0.00114461 0.00127546 0.00136828 0.00131351 9.51933e-05 3
reco:reco3d:SpacePointSolver 0.709999 0.865206 1.12245 0.763166 0.183191 3
reco:hitpdune:DisambigFromSpacePoints 0.431085 0.844551 1.10734 0.995229 0.295925 3
reco:pandora:StandardPandora 14.9145 17.6788 20.9367 17.185 2.48323 3
reco:pandoraWriter:StandardPandora 0.366785 0.40291 0.469466 0.37248 0.0471194 3
reco:pandoraTrack:LArPandoraTrackCreation 0.882312 1.74651 2.72591 1.6313 0.75704 3
reco:pandoraShower:LArPandoraShowerCreation 1.13023 2.54819 3.4923 3.02204 1.02086 3
reco:pandoracalo:Calorimetry 0.582234 1.0106 1.53342 0.916153 0.394022 3
reco:pandoracalonosce:Calorimetry 0.437426 0.831664 1.36347 0.694096 0.39037 3
reco:pandoraShowercalo:ShowerCalorimetry 1.1792 2.32594 3.20656 2.59207 0.848788 3
reco:pandoraShowercalonosce:ShowerCalorimetry 1.26845 2.40502 3.55906 2.38754 0.935219 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0668699 0.0872811 0.100108 0.094865 0.0145908 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0592376 0.0835745 0.0959312 0.0955548 0.0172095 3
reco:emtrkmichelid:EmTrackMichelId 29.1064 35.2242 41.0562 35.5099 4.88269 3
reco:opdec:Deconvolution 0.975253 1.01074 1.05328 1.00368 0.0322409 3
reco:ophitspe:OpHitFinderDeco 0.235501 0.244067 0.256236 0.240465 0.00883996 3
reco:opflash:OpFlashFinder 0.0748729 0.098526 0.112035 0.10867 0.0167816 3
reco:opslicer:OpSlicer 0.224916 0.302796 0.346579 0.336893 0.0552115 3
reco:crtreco:TwoCRTMatchingProducer 0.00881357 0.0119602 0.0150472 0.01202 0.00254521 3
reco:crttag:SingleCRTMatchingProducer 0.0105375 0.0117594 0.013869 0.0108716 0.00149798 3
reco:pandora2Track:LArPandoraTrackCreation 2.7888 7.55001 11.9528 7.90839 3.74977 3
reco:pandora2calo:ShowerCalorimetry 0.938958 2.57987 4.49718 2.30347 1.46573 3
reco:pandora2calonosce:ShowerCalorimetry 0.925434 2.61147 4.35979 2.5492 1.40276 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0539752 0.0844224 0.10476 0.0945319 0.0219306 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.060765 0.0808074 0.106244 0.0754134 0.0189544 3
reco:pandora2Shower:LArPandoraShowerCreation 1.16932 2.79188 5.23068 1.97564 1.75563 3
reco:pandora2Showercalo:ShowerCalorimetry 1.16235 2.82551 5.46886 1.84532 1.88981 3
reco:pandora2Showercalonosce:ShowerCalorimetry 1.14824 2.64379 4.89647 1.88666 1.62116 3
[art]:TriggerResults:TriggerResultInserter 2.2532e-05 6.22807e-05 0.000122902 4.1408e-05 4.35529e-05 3
end_path:out1:RootOutput 9.117e-06 1.9303e-05 3.8072e-05 1.072e-05 1.32878e-05 3
end_path:michelremoving:michelremoving 0.0518447 0.2716 0.541085 0.221871 0.202803 3
end_path:michelremovinggnocchi:michelremoving 0.0464636 0.26046 0.544029 0.190887 0.209003 3
end_path:calibanagnocchi:CalibAnaTree 18.6052 27.8479 38.5707 26.3679 8.21776 3
end_path:out1:RootOutput(write) 1.58893 2.33939 2.8335 2.59575 0.539462 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6518.85 MB
Peak resident set size usage (VmHWM): 4142.38 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_6_1757488808_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757491894.5948048, 'end_time': 1757492454.32878}