Jobsub ID 44175.10@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.10@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-09-10 07:54:10 | |
| From worker node | Hostname | dunegli-45691-0-cmswn5006.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:21 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_005310_220006_42_20250614T012524.root | |
| Jobscript | Exit code | 0 |
| Real time | 34m (2057s) | |
| CPU time | 33m (1994s = 96%) | |
| Max RSS bytes | 4837863424 (4613 MiB) | |
| Outputting started | 2025-09-10 07:53:39 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log | |
| Finished | 2025-09-10 07:54:10 | |
| Saved logs | justin-logs:44175.10-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
y depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 07:48:51 UTC Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 07:48:52 UTC Opened input file "prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 92635 traces, 92635 summary
Retagger: tagging trace set: gauss with 77826 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77826 traces tagged "gauss"
FrameSaver: q=2.24791e+06 n=1124005 tag=gauss
wclsFrameSaver: saving 92635 traces tagged "wiener"
FrameSaver: q=2.46305e+06 n=1092697 tag=wiener
10-Sep-2025 07:50:38 UTC Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88729 traces, 88729 summary
Retagger: tagging trace set: gauss with 73832 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73832 traces tagged "gauss"
FrameSaver: q=1.8504e+06 n=1000990 tag=gauss
wclsFrameSaver: saving 88729 traces tagged "wiener"
FrameSaver: q=2.00615e+06 n=995616 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94570 traces, 94570 summary
Retagger: tagging trace set: gauss with 79045 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 79045 traces tagged "gauss"
FrameSaver: q=2.13271e+06 n=1129227 tag=gauss
wclsFrameSaver: saving 94570 traces tagged "wiener"
FrameSaver: q=2.18705e+06 n=1100582 tag=wiener
10-Sep-2025 07:53:38 UTC Closed output file "prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 07:53:38 UTC Closed input file "prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 75.9626 90.7511 105.442 90.8484 12.0352 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000365633 0.00104885 0.00165249 0.00112844 0.000528362 3
reco:wclsdatahd:WireCellToolkit 23.4344 26.0196 28.2287 26.3956 1.97527 3
reco:gaushit:GausHitFinder 0.405558 0.497033 0.554843 0.530699 0.0654294 3
reco:nhitsfilter:NumberOfHitsFilter 0.000214843 0.000315908 0.000479472 0.000253408 0.000116724 3
reco:reco3d:SpacePointSolver 0.255563 0.406237 0.521655 0.441493 0.111455 3
reco:hitpdune:DisambigFromSpacePoints 0.301632 0.456054 0.542982 0.523549 0.109481 3
reco:pandora:StandardPandora 7.12793 10.1356 12.1665 11.1125 2.16987 3
reco:pandoraWriter:StandardPandora 0.1194 0.144306 0.172879 0.140639 0.0219863 3
reco:pandoraTrack:LArPandoraTrackCreation 0.658149 0.82522 1.1491 0.668415 0.229053 3
reco:pandoraShower:LArPandoraShowerCreation 0.83786 1.11824 1.31378 1.20309 0.203345 3
reco:pandoracalo:Calorimetry 0.374681 0.457386 0.596581 0.400895 0.0990059 3
reco:pandoracalonosce:Calorimetry 0.368552 0.452047 0.582198 0.405392 0.0932511 3
reco:pandoraShowercalo:ShowerCalorimetry 0.823825 1.09614 1.24317 1.22144 0.192763 3
reco:pandoraShowercalonosce:ShowerCalorimetry 0.787147 1.04844 1.18968 1.16849 0.184965 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.030327 0.0361987 0.0394997 0.0387694 0.0041626 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.028868 0.0348661 0.0400333 0.035697 0.00459593 3
reco:emtrkmichelid:EmTrackMichelId 17.991 22.704 29.1287 20.9924 4.70524 3
reco:opdec:Deconvolution 0.504189 0.57484 0.616558 0.603774 0.05023 3
reco:ophitspe:OpHitFinderDeco 0.0999464 0.104204 0.108027 0.104638 0.00331295 3
reco:opflash:OpFlashFinder 0.0520966 0.061359 0.0664307 0.0655498 0.00655941 3
reco:opslicer:OpSlicer 0.126879 0.16361 0.188867 0.175083 0.0265752 3
reco:crtreco:TwoCRTMatchingProducer 0.00308019 0.0046436 0.00655795 0.00429265 0.00144131 3
reco:crttag:SingleCRTMatchingProducer 0.00258465 0.00313636 0.00385934 0.0029651 0.000534296 3
reco:pandora2Track:LArPandoraTrackCreation 2.05477 2.59512 3.01715 2.71343 0.401698 3
reco:pandora2calo:ShowerCalorimetry 0.744388 0.98321 1.10584 1.0994 0.168893 3
reco:pandora2calonosce:ShowerCalorimetry 0.727916 0.967839 1.08926 1.08634 0.169656 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0305045 0.0352771 0.0387326 0.0365943 0.00348584 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0291506 0.033149 0.0361859 0.0341105 0.00295154 3
reco:pandora2Shower:LArPandoraShowerCreation 0.92046 1.21834 1.43648 1.29807 0.21808 3
reco:pandora2Showercalo:ShowerCalorimetry 0.945531 1.25372 1.49325 1.32238 0.228817 3
reco:pandora2Showercalonosce:ShowerCalorimetry 0.930647 1.23604 1.46684 1.31062 0.225163 3
[art]:TriggerResults:TriggerResultInserter 1.9207e-05 5.55367e-05 0.000123497 2.3906e-05 4.80935e-05 3
end_path:out1:RootOutput 9.368e-06 1.98617e-05 4.0748e-05 9.469e-06 1.47689e-05 3
end_path:michelremoving:michelremoving 0.0211652 0.105475 0.262622 0.0326367 0.111219 3
end_path:michelremovinggnocchi:michelremoving 0.0174731 0.0974438 0.249683 0.0251755 0.107695 3
end_path:calibanagnocchi:CalibAnaTree 11.0093 14.47 16.3595 16.0411 2.45054 3
end_path:out1:RootOutput(write) 1.19623 1.36368 1.46493 1.4299 0.11927 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6648.12 MB
Peak resident set size usage (VmHWM): 4232.42 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_10_1757488765_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757490509.1814375, 'end_time': 1757490819.1077516}