Jobsub ID 44175.7@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.7@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-09-10 07:56:12 | |
| From worker node | Hostname | dunegli-45691-0-cmswn5006.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:44 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_002639_412624_14_20250613T235538.root | |
| Jobscript | Exit code | 0 |
| Real time | 35m (2153s) | |
| CPU time | 34m (2080s = 96%) | |
| Max RSS bytes | 4902608896 (4675 MiB) | |
| Outputting started | 2025-09-10 07:55:37 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log | |
| Finished | 2025-09-10 07:56:12 | |
| Saved logs | justin-logs:44175.7-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
eometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 07:50:26 UTC Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 07:50:26 UTC Opened input file "prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 99187 traces, 99187 summary
Retagger: tagging trace set: gauss with 83309 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83309 traces tagged "gauss"
FrameSaver: q=2.38332e+06 n=1221349 tag=gauss
wclsFrameSaver: saving 99187 traces tagged "wiener"
FrameSaver: q=2.5371e+06 n=1202282 tag=wiener
10-Sep-2025 07:52:13 UTC Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 83231 traces, 83231 summary
Retagger: tagging trace set: gauss with 71882 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 71882 traces tagged "gauss"
FrameSaver: q=1.6642e+06 n=965872 tag=gauss
wclsFrameSaver: saving 83231 traces tagged "wiener"
FrameSaver: q=1.76304e+06 n=961170 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 105469 traces, 105469 summary
Retagger: tagging trace set: gauss with 89804 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 89804 traces tagged "gauss"
FrameSaver: q=2.61351e+06 n=1333177 tag=gauss
wclsFrameSaver: saving 105469 traces tagged "wiener"
FrameSaver: q=2.76273e+06 n=1290120 tag=wiener
10-Sep-2025 07:55:36 UTC Closed output file "prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 07:55:36 UTC Closed input file "prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 74.9391 98.7628 116.813 104.536 17.5757 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00040547 0.00110507 0.00172759 0.00118215 0.000542499 3
reco:wclsdatahd:WireCellToolkit 25.4433 26.4881 28.5067 25.5144 1.42761 3
reco:gaushit:GausHitFinder 0.444753 0.55694 0.641722 0.584344 0.0827141 3
reco:nhitsfilter:NumberOfHitsFilter 0.000182451 0.000332716 0.000535609 0.000280088 0.000148901 3
reco:reco3d:SpacePointSolver 0.252449 0.634411 0.861559 0.789224 0.271697 3
reco:hitpdune:DisambigFromSpacePoints 0.26652 0.515835 0.663164 0.617822 0.177262 3
reco:pandora:StandardPandora 8.74891 12.0581 14.8836 12.5419 2.52773 3
reco:pandoraWriter:StandardPandora 0.107712 0.152524 0.17682 0.173039 0.0317243 3
reco:pandoraTrack:LArPandoraTrackCreation 0.557456 0.889173 1.09179 1.01827 0.236472 3
reco:pandoraShower:LArPandoraShowerCreation 0.729154 1.14397 1.41383 1.28893 0.297719 3
reco:pandoracalo:Calorimetry 0.325287 0.50491 0.633183 0.556261 0.130838 3
reco:pandoracalonosce:Calorimetry 0.317691 0.496561 0.633057 0.538935 0.132188 3
reco:pandoraShowercalo:ShowerCalorimetry 0.754904 1.20355 1.44795 1.40779 0.317662 3
reco:pandoraShowercalonosce:ShowerCalorimetry 0.710185 1.1535 1.39676 1.35355 0.313966 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0257869 0.0344612 0.0401259 0.0374709 0.00622873 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0250315 0.0317908 0.036071 0.0342698 0.00483576 3
reco:emtrkmichelid:EmTrackMichelId 16.9125 22.6633 26.431 24.6464 4.13118 3
reco:opdec:Deconvolution 0.597639 0.634917 0.690567 0.616547 0.0400999 3
reco:ophitspe:OpHitFinderDeco 0.105916 0.108939 0.113661 0.107242 0.00338188 3
reco:opflash:OpFlashFinder 0.0718049 0.0817731 0.0941962 0.0793183 0.00930454 3
reco:opslicer:OpSlicer 0.167986 0.182095 0.205773 0.172525 0.0168456 3
reco:crtreco:TwoCRTMatchingProducer 0.00274036 0.00395242 0.00533776 0.00377915 0.00106744 3
reco:crttag:SingleCRTMatchingProducer 0.00229101 0.00291255 0.00342166 0.00302497 0.000468379 3
reco:pandora2Track:LArPandoraTrackCreation 1.76958 2.84829 3.56349 3.2118 0.77616 3
reco:pandora2calo:ShowerCalorimetry 0.684113 1.1123 1.42286 1.22993 0.312852 3
reco:pandora2calonosce:ShowerCalorimetry 0.677932 1.09526 1.39549 1.21237 0.30442 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0254731 0.0348143 0.0400351 0.0389347 0.00662048 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0246355 0.0340307 0.0388964 0.0385601 0.00664478 3
reco:pandora2Shower:LArPandoraShowerCreation 0.801583 1.29523 1.6076 1.47651 0.353141 3
reco:pandora2Showercalo:ShowerCalorimetry 0.871896 1.45139 1.87419 1.60809 0.423922 3
reco:pandora2Showercalonosce:ShowerCalorimetry 0.850874 1.44165 1.88212 1.59196 0.434212 3
[art]:TriggerResults:TriggerResultInserter 1.8054e-05 5.043e-05 0.000105573 2.7663e-05 3.91888e-05 3
end_path:out1:RootOutput 7.484e-06 1.47413e-05 2.8915e-05 7.825e-06 1.00233e-05 3
end_path:michelremoving:michelremoving 0.0442864 0.159886 0.268436 0.166937 0.0916445 3
end_path:michelremovinggnocchi:michelremoving 0.0301308 0.150806 0.256825 0.165462 0.0931258 3
end_path:calibanagnocchi:CalibAnaTree 11.0095 18.0361 24.8384 18.2604 5.64787 3
end_path:out1:RootOutput(write) 1.29061 1.51149 1.68516 1.55871 0.164497 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 7249.58 MB
Peak resident set size usage (VmHWM): 4781.78 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_7_1757488789_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757490603.9568233, 'end_time': 1757490937.1992354}