Jobsub ID 44175.14@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.14@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-09-10 07:54:21 | |
| From worker node | Hostname | dunegli-45691-0-cmswn5006.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:29 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_005186_220006_21_20250614T012654.root | |
| Jobscript | Exit code | 0 |
| Real time | 34m (2058s) | |
| CPU time | 33m (1994s = 96%) | |
| Max RSS bytes | 5353574400 (5105 MiB) | |
| Outputting started | 2025-09-10 07:53:47 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log | |
| Finished | 2025-09-10 07:54:21 | |
| Saved logs | justin-logs:44175.14-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
etry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 07:48:58 UTC Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 07:48:59 UTC Opened input file "prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 90974 traces, 90974 summary
Retagger: tagging trace set: gauss with 80823 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 80823 traces tagged "gauss"
FrameSaver: q=2.38407e+06 n=1254531 tag=gauss
wclsFrameSaver: saving 90974 traces tagged "wiener"
FrameSaver: q=2.43199e+06 n=1221186 tag=wiener
10-Sep-2025 07:50:51 UTC Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 95699 traces, 95699 summary
Retagger: tagging trace set: gauss with 82100 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82100 traces tagged "gauss"
FrameSaver: q=2.4675e+06 n=1240674 tag=gauss
wclsFrameSaver: saving 95699 traces tagged "wiener"
FrameSaver: q=2.6396e+06 n=1212081 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 67998 traces, 67998 summary
Retagger: tagging trace set: gauss with 59897 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 59897 traces tagged "gauss"
FrameSaver: q=1.41607e+06 n=816434 tag=gauss
wclsFrameSaver: saving 67998 traces tagged "wiener"
FrameSaver: q=1.50035e+06 n=823285 tag=wiener
10-Sep-2025 07:53:44 UTC Closed output file "prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 07:53:44 UTC Closed input file "prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 56.0901 90.5109 110.468 104.974 24.4423 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000375201 0.000792654 0.00101206 0.000990705 0.000295313 3
reco:wclsdatahd:WireCellToolkit 23.6323 26.1977 27.8223 27.1384 1.83534 3
reco:gaushit:GausHitFinder 0.339753 0.510177 0.61283 0.577949 0.121347 3
reco:nhitsfilter:NumberOfHitsFilter 0.000226495 0.0003345 0.000505041 0.000271963 0.000122011 3
reco:reco3d:SpacePointSolver 0.166144 0.295499 0.364179 0.356173 0.0915257 3
reco:hitpdune:DisambigFromSpacePoints 0.158475 0.411645 0.573097 0.503363 0.181268 3
reco:pandora:StandardPandora 3.96473 11.4156 17.7132 12.5689 5.67174 3
reco:pandoraWriter:StandardPandora 0.111467 0.148421 0.17408 0.159717 0.0267805 3
reco:pandoraTrack:LArPandoraTrackCreation 0.364806 0.843823 1.27197 0.894699 0.372089 3
reco:pandoraShower:LArPandoraShowerCreation 0.478383 1.13199 1.53067 1.38692 0.465882 3
reco:pandoracalo:Calorimetry 0.225134 0.489509 0.765611 0.477782 0.220804 3
reco:pandoracalonosce:Calorimetry 0.219761 0.479786 0.750658 0.468941 0.216874 3
reco:pandoraShowercalo:ShowerCalorimetry 0.502406 1.21237 1.75524 1.37946 0.524936 3
reco:pandoraShowercalonosce:ShowerCalorimetry 0.481421 1.16017 1.66965 1.32944 0.499642 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0247351 0.0319387 0.0361663 0.0349149 0.00511933 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.021659 0.0290313 0.0339252 0.0315097 0.00530547 3
reco:emtrkmichelid:EmTrackMichelId 13.0131 21.3589 28.631 22.4324 6.42101 3
reco:opdec:Deconvolution 0.510085 0.582848 0.630308 0.608151 0.0522406 3
reco:ophitspe:OpHitFinderDeco 0.101608 0.105046 0.107524 0.106007 0.0025091 3
reco:opflash:OpFlashFinder 0.0432935 0.0581674 0.0670875 0.0641212 0.0105869 3
reco:opslicer:OpSlicer 0.144822 0.153628 0.160397 0.155664 0.00651913 3
reco:crtreco:TwoCRTMatchingProducer 0.00308396 0.00468343 0.00578985 0.00517648 0.00115839 3
reco:crttag:SingleCRTMatchingProducer 0.0021508 0.0029399 0.00348484 0.00318404 0.000571325 3
reco:pandora2Track:LArPandoraTrackCreation 1.04651 2.61078 3.80654 2.97927 1.15651 3
reco:pandora2calo:ShowerCalorimetry 0.431188 1.089 1.6099 1.22592 0.490851 3
reco:pandora2calonosce:ShowerCalorimetry 0.417674 1.07075 1.58685 1.20772 0.48704 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0225546 0.031038 0.0366074 0.0339521 0.00609586 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0217624 0.0291074 0.0345103 0.0310495 0.00538243 3
reco:pandora2Shower:LArPandoraShowerCreation 0.479619 1.20527 1.761 1.37521 0.536743 3
reco:pandora2Showercalo:ShowerCalorimetry 0.53581 1.40138 2.14806 1.52027 0.663544 3
reco:pandora2Showercalonosce:ShowerCalorimetry 0.524676 1.36159 2.07469 1.48542 0.638819 3
[art]:TriggerResults:TriggerResultInserter 2.3876e-05 5.30653e-05 9.9862e-05 3.5458e-05 3.34264e-05 3
end_path:out1:RootOutput 5.24e-06 1.62647e-05 3.7683e-05 5.871e-06 1.51472e-05 3
end_path:michelremoving:michelremoving 0.0158156 0.100817 0.16297 0.123667 0.0622103 3
end_path:michelremovinggnocchi:michelremoving 0.0155672 0.095458 0.158757 0.11205 0.0596228 3
end_path:calibanagnocchi:CalibAnaTree 6.6784 13.4945 17.6892 16.1159 4.86231 3
end_path:out1:RootOutput(write) 1.05116 1.34573 1.52903 1.45701 0.210356 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6784.26 MB
Peak resident set size usage (VmHWM): 4375.11 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_14_1757488773_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757490517.3486695, 'end_time': 1757490827.643516}