Jobsub ID 44175.5@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.5@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_UChicago | |
| Entry | Engage_US_MWT2_uiuc_gk02_condce_mcore | |
| Last heartbeat | 2025-09-10 09:05:48 | |
| From worker node | Hostname | mwt2-c169.campuscluster.illinois.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:42 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_006776_412718_6_20250614T003248.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (6275s) | |
| CPU time | 1h (6015s = 95%) | |
| Max RSS bytes | 5310869504 (5064 MiB) | |
| Outputting started | 2025-09-10 09:04:17 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1.log | |
| Finished | 2025-09-10 09:05:48 | |
| Saved logs | justin-logs:44175.5-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
ometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 03:43:31 CDT Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 03:43:33 CDT Opened input file "prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 78770 traces, 78770 summary
Retagger: tagging trace set: gauss with 68377 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 68377 traces tagged "gauss"
FrameSaver: q=1.69173e+06 n=946901 tag=gauss
wclsFrameSaver: saving 78770 traces tagged "wiener"
FrameSaver: q=1.81754e+06 n=950726 tag=wiener
10-Sep-2025 03:47:48 CDT Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 97914 traces, 97914 summary
Retagger: tagging trace set: gauss with 77537 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77537 traces tagged "gauss"
FrameSaver: q=2.30092e+06 n=1107237 tag=gauss
wclsFrameSaver: saving 97914 traces tagged "wiener"
FrameSaver: q=2.52343e+06 n=1064631 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 114325 traces, 114325 summary
Retagger: tagging trace set: gauss with 93576 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93576 traces tagged "gauss"
FrameSaver: q=2.8621e+06 n=1376517 tag=gauss
wclsFrameSaver: saving 114325 traces tagged "wiener"
FrameSaver: q=3.08417e+06 n=1352073 tag=wiener
10-Sep-2025 04:04:14 CDT Closed output file "prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 04:04:14 CDT Closed input file "prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 252.405 397.168 564.358 374.743 128.338 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0014569 0.00310288 0.00463941 0.00321231 0.00130156 3
reco:wclsdatahd:WireCellToolkit 75.0184 96.6877 111.764 103.28 15.709 3
reco:gaushit:GausHitFinder 1.4958 2.07773 2.68673 2.05067 0.486572 3
reco:nhitsfilter:NumberOfHitsFilter 0.00126335 0.00173379 0.00199248 0.00194555 0.000333204 3
reco:reco3d:SpacePointSolver 0.753783 2.54518 3.57777 3.30398 1.27163 3
reco:hitpdune:DisambigFromSpacePoints 0.935002 2.37206 3.40924 2.77193 1.04893 3
reco:pandora:StandardPandora 30.3209 50.8428 79.6842 42.5234 20.9936 3
reco:pandoraWriter:StandardPandora 0.560693 0.637072 0.731655 0.618867 0.070972 3
reco:pandoraTrack:LArPandoraTrackCreation 4.61176 8.00309 11.3964 8.00107 2.76984 3
reco:pandoraShower:LArPandoraShowerCreation 5.99253 12.7429 21.6891 10.547 6.59353 3
reco:pandoracalo:Calorimetry 2.73889 4.33879 6.55974 3.71774 1.62049 3
reco:pandoracalonosce:Calorimetry 2.35255 4.20778 6.74378 3.52701 1.85622 3
reco:pandoraShowercalo:ShowerCalorimetry 5.90761 12.9717 23.3811 9.6263 7.51553 3
reco:pandoraShowercalonosce:ShowerCalorimetry 6.24872 12.8234 23.0335 9.18803 7.31867 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.132058 0.164051 0.190245 0.16985 0.0241057 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.119936 0.158528 0.193891 0.161756 0.0302781 3
reco:emtrkmichelid:EmTrackMichelId 23.3679 29.8693 35.7633 30.4767 5.07862 3
reco:opdec:Deconvolution 1.74862 1.90539 2.02914 1.93841 0.116876 3
reco:ophitspe:OpHitFinderDeco 0.337579 0.469851 0.538401 0.533572 0.0935508 3
reco:opflash:OpFlashFinder 0.211538 0.228595 0.246663 0.227585 0.0143573 3
reco:opslicer:OpSlicer 0.560364 0.575886 0.601008 0.566286 0.0179275 3
reco:crtreco:TwoCRTMatchingProducer 0.0262484 0.030004 0.0346621 0.0291015 0.00349367 3
reco:crttag:SingleCRTMatchingProducer 0.0247409 0.0273197 0.0318512 0.0253671 0.00321442 3
reco:pandora2Track:LArPandoraTrackCreation 14.3769 26.1699 40.3903 23.7425 10.7578 3
reco:pandora2calo:ShowerCalorimetry 5.54195 9.51097 15.8063 7.18464 4.50171 3
reco:pandora2calonosce:ShowerCalorimetry 5.72004 9.44804 15.9538 6.67028 4.61659 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.107635 0.125803 0.160971 0.108802 0.0248723 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.106625 0.123971 0.154339 0.110948 0.021546 3
reco:pandora2Shower:LArPandoraShowerCreation 5.95872 11.498 17.1362 11.3992 4.56371 3
reco:pandora2Showercalo:ShowerCalorimetry 4.7707 12.0826 20.4431 11.034 6.44106 3
reco:pandora2Showercalonosce:ShowerCalorimetry 3.66999 13.9701 26.6228 11.6174 9.51699 3
[art]:TriggerResults:TriggerResultInserter 0.000126807 0.000140432 0.000153688 0.000140802 1.09772e-05 3
end_path:out1:RootOutput 2.9786e-05 4.22623e-05 5.1969e-05 4.5032e-05 9.26552e-06 3
end_path:michelremoving:michelremoving 0.063047 0.338624 0.816577 0.136248 0.339282 3
end_path:michelremovinggnocchi:michelremoving 0.053336 0.278173 0.659292 0.121891 0.270941 3
end_path:calibanagnocchi:CalibAnaTree 43.5051 64.6054 94.8261 55.4851 21.9218 3
end_path:out1:RootOutput(write) 4.27131 5.09344 6.09417 4.91485 0.754821 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 7834.08 MB
Peak resident set size usage (VmHWM): 5217.13 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_5_1757488807_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757493728.8502922, 'end_time': 1757495057.5796564}