Jobsub ID 44175.9@dunegpschedd01.fnal.gov
| Jobsub ID | 44175.9@dunegpschedd01.fnal.gov | |
| Workflow ID | 2391 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-09-10 07:18:02 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-09-10 07:58:02 | |
| From worker node | Hostname | dunegli-45691-0-cmswn5006.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-10 07:19:11 | |
| Input files | ehn1-beam-np04:H4_v34b_1GeV_-27.7_002862_412718_0_20250614T003229.root | |
| Jobscript | Exit code | 0 |
| Real time | 38m (2297s) | |
| CPU time | 37m (2222s = 96%) | |
| Max RSS bytes | 4881403904 (4655 MiB) | |
| Outputting started | 2025-09-10 07:57:28 | |
| Output files | usertests:prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test/fnal/02391/1/001/prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.log | |
| Finished | 2025-09-10 07:58:02 | |
| Saved logs | justin-logs:44175.9-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
y depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
10-Sep-2025 07:51:37 UTC Initiating request to open input file "prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
10-Sep-2025 07:51:37 UTC Opened input file "prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 102243 traces, 102243 summary
Retagger: tagging trace set: gauss with 88354 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88354 traces tagged "gauss"
FrameSaver: q=2.59313e+06 n=1379833 tag=gauss
wclsFrameSaver: saving 102243 traces tagged "wiener"
FrameSaver: q=2.66891e+06 n=1354002 tag=wiener
10-Sep-2025 07:53:41 UTC Opened output file with pattern "prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 109686 traces, 109686 summary
Retagger: tagging trace set: gauss with 88732 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88732 traces tagged "gauss"
FrameSaver: q=2.52777e+06 n=1232618 tag=gauss
wclsFrameSaver: saving 109686 traces tagged "wiener"
FrameSaver: q=2.73434e+06 n=1188143 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 97709 traces, 97709 summary
Retagger: tagging trace set: gauss with 82431 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82431 traces tagged "gauss"
FrameSaver: q=2.37764e+06 n=1250344 tag=gauss
wclsFrameSaver: saving 97709 traces tagged "wiener"
FrameSaver: q=2.5497e+06 n=1207743 tag=wiener
10-Sep-2025 07:57:27 UTC Closed output file "prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root"
10-Sep-2025 07:57:27 UTC Closed input file "prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 105.657 111.438 122.968 105.689 8.15291 3
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000396963 0.00126913 0.00217007 0.00124036 0.000724155 3
reco:wclsdatahd:WireCellToolkit 25.4449 27.4021 28.6537 28.1076 1.40179 3
reco:gaushit:GausHitFinder 0.528814 0.622281 0.743149 0.59488 0.0896214 3
reco:nhitsfilter:NumberOfHitsFilter 0.000261413 0.000338725 0.000463051 0.000291711 8.87777e-05 3
reco:reco3d:SpacePointSolver 0.425181 0.470648 0.521174 0.46559 0.0393517 3
reco:hitpdune:DisambigFromSpacePoints 0.555134 0.614542 0.710641 0.577853 0.068582 3
reco:pandora:StandardPandora 11.1459 14.7287 18.4252 14.6149 2.97286 3
reco:pandoraWriter:StandardPandora 0.172673 0.188834 0.210635 0.183193 0.0160032 3
reco:pandoraTrack:LArPandoraTrackCreation 0.858374 0.930145 1.04703 0.885034 0.0833616 3
reco:pandoraShower:LArPandoraShowerCreation 1.45753 1.59441 1.66313 1.66257 0.0967867 3
reco:pandoracalo:Calorimetry 0.536736 0.579176 0.626133 0.574661 0.0366356 3
reco:pandoracalonosce:Calorimetry 0.526472 0.572392 0.619297 0.571408 0.037902 3
reco:pandoraShowercalo:ShowerCalorimetry 1.69794 1.80709 1.93309 1.79024 0.0967345 3
reco:pandoraShowercalonosce:ShowerCalorimetry 1.64572 1.72733 1.83598 1.7003 0.0799907 3
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0408509 0.0465525 0.056185 0.0426217 0.00684946 3
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0373003 0.0400905 0.0420893 0.0408818 0.00203358 3
reco:emtrkmichelid:EmTrackMichelId 22.8679 25.3797 30.3012 22.9699 3.48032 3
reco:opdec:Deconvolution 0.677182 0.71169 0.752521 0.705366 0.0310804 3
reco:ophitspe:OpHitFinderDeco 0.110284 0.111828 0.11272 0.11248 0.00109578 3
reco:opflash:OpFlashFinder 0.0856223 0.101422 0.115315 0.103327 0.0121967 3
reco:opslicer:OpSlicer 0.189514 0.199689 0.208773 0.200779 0.00790043 3
reco:crtreco:TwoCRTMatchingProducer 0.0052111 0.00558808 0.00579473 0.00575842 0.00026698 3
reco:crttag:SingleCRTMatchingProducer 0.00333641 0.00349093 0.00360821 0.00352816 0.000114044 3
reco:pandora2Track:LArPandoraTrackCreation 3.31853 3.59812 3.82297 3.65285 0.20954 3
reco:pandora2calo:ShowerCalorimetry 1.52117 1.62868 1.73804 1.62682 0.0885463 3
reco:pandora2calonosce:ShowerCalorimetry 1.50816 1.6023 1.70378 1.59498 0.0800308 3
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0381467 0.0408656 0.0451519 0.0392981 0.00306713 3
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0361317 0.0367949 0.0380607 0.0361922 0.000895424 3
reco:pandora2Shower:LArPandoraShowerCreation 1.51212 1.64808 1.75123 1.6809 0.100336 3
reco:pandora2Showercalo:ShowerCalorimetry 1.87428 1.96381 2.02112 1.99603 0.0641298 3
reco:pandora2Showercalonosce:ShowerCalorimetry 1.8504 1.92822 1.96865 1.96562 0.0550428 3
[art]:TriggerResults:TriggerResultInserter 1.9748e-05 4.43187e-05 8.9923e-05 2.3285e-05 3.22794e-05 3
end_path:out1:RootOutput 4.179e-06 1.3376e-05 2.9517e-05 6.432e-06 1.14504e-05 3
end_path:michelremoving:michelremoving 0.150064 0.28854 0.511469 0.204087 0.15917 3
end_path:michelremovinggnocchi:michelremoving 0.133841 0.273189 0.493217 0.192508 0.157416 3
end_path:calibanagnocchi:CalibAnaTree 17.3674 18.8424 21.4661 17.6938 1.86002 3
end_path:out1:RootOutput(write) 1.56931 1.68839 1.82434 1.67152 0.104798 3
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6938.62 MB
Peak resident set size usage (VmHWM): 4522.59 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2.root', 'tfile_out': 'prod_beam_p1GeV_protodunehd_1_44175_9_1757488756_gen_largeant_ionscint_pdext_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6_detsim1_detsim2_reco1_reco2_tfile.root', 'start_time': 1757490674.4131684, 'end_time': 1757491048.4277565}