justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47663.1@dunegpschedd01.fnal.gov

Jobsub ID47663.1@dunegpschedd01.fnal.gov
Workflow ID2675
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-17 17:17:34
SiteUS_PuertoRico
EntryCMSHTPC_T3_US_PuertoRico_UPRM
Last heartbeat2025-09-17 19:48:44
From worker nodeHostnamecompute-1-3.local
cpuinfoIntel(R) Xeon(R) CPU W3550 @ 3.07GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 17:19:01
Input filesusertests:prod_beam_p5GeV_protodunehd_1_39008_61_1757697938_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
JobscriptExit code0
Real time2h (8754s)
CPU time2h (8230s = 94%)
Max RSS bytes7608688640 (7256 MiB)
Outputting started2025-09-17 19:44:56
Output filesusertests:prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02675/1/001/prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.log
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/PDHD_MC_Prod_Test_stage2/fnal/02675/1/001/prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim.log
Finished2025-09-17 19:48:44
Saved logsjustin-logs:47663.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ummary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77086 traces tagged "gauss"
FrameSaver: q=2.33989e+06 n=1184072 tag=gauss
wclsFrameSaver: saving 97736 traces tagged "wiener"
FrameSaver: q=3.00201e+06 n=1138908 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 105044 traces, 105044 summary
Retagger: tagging trace set: gauss with 82321 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82321 traces tagged "gauss"
FrameSaver: q=2.7622e+06 n=1345878 tag=gauss
wclsFrameSaver: saving 105044 traces tagged "wiener"
FrameSaver: q=3.56474e+06 n=1317704 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 111828 traces, 111828 summary
Retagger: tagging trace set: gauss with 86403 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 86403 traces tagged "gauss"
FrameSaver: q=2.82154e+06 n=1396647 tag=gauss
wclsFrameSaver: saving 111828 traces tagged "wiener"
FrameSaver: q=3.5008e+06 n=1327631 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 99407 traces, 99407 summary
Retagger: tagging trace set: gauss with 79288 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 79288 traces tagged "gauss"
FrameSaver: q=2.41635e+06 n=1177049 tag=gauss
wclsFrameSaver: saving 99407 traces tagged "wiener"
FrameSaver: q=3.31565e+06 n=1152845 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 81724 traces, 81724 summary
Retagger: tagging trace set: gauss with 66947 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 66947 traces tagged "gauss"
FrameSaver: q=1.81798e+06 n=925962 tag=gauss
wclsFrameSaver: saving 81724 traces tagged "wiener"
FrameSaver: q=2.48005e+06 n=916779 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 80661 traces, 80661 summary
Retagger: tagging trace set: gauss with 67200 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 67200 traces tagged "gauss"
FrameSaver: q=1.94602e+06 n=1046506 tag=gauss
wclsFrameSaver: saving 80661 traces tagged "wiener"
FrameSaver: q=2.44591e+06 n=1010179 tag=wiener
17-Sep-2025 15:44:52 AST  Closed output file "prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.root"
17-Sep-2025 15:44:52 AST  Closed input file "prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            191.741       263.732       410.336       259.795       63.2007        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000731897   0.00575473     0.0092321     0.0053361    0.00295314       10     
reco:opdec:Deconvolution                             0.963885       1.15075       1.54498       1.06455       0.18704        10     
reco:ophitspe:OpHitFinderDeco                        0.241098      0.263998      0.367983      0.249443       0.03621        10     
reco:opflash:OpFlashFinder                           0.0666548     0.113283      0.203719      0.100735      0.0427743       10     
reco:opslicer:OpSlicer                               0.226288      0.336646      0.491667      0.307892      0.0789526       10     
reco:wclsdatahd:WireCellToolkit                       63.6535       74.6515       92.5174       73.4142       8.89755        10     
reco:gaushit:GausHitFinder                            0.72643       1.28673       1.78519       1.26223      0.309083        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000596252   0.000739761   0.000967482   0.000690933   0.00013085       10     
reco:reco3d:SpacePointSolver                         0.718168       1.38793       2.27367       1.2176       0.549509        10     
reco:hitpdune:DisambigFromSpacePoints                0.416264       1.51507       3.24623       1.42078      0.686916        10     
reco:pandora:StandardPandora                          24.3013       38.6372       68.0805       35.0281       13.0431        10     
reco:pandoraWriter:StandardPandora                   0.194493      0.311255      0.465707      0.321246      0.0736677       10     
reco:pandoraTrack:LArPandoraTrackCreation             1.21254       3.27456       8.03457       2.89676       1.91596        10     
reco:pandoraShower:LArPandoraShowerCreation           1.16495       3.28429       7.73956       3.12502       1.92217        10     
reco:pandoracalo:Calorimetry                         0.673589       1.6675        3.87119       1.45609      0.909816        10     
reco:pandoracalonosce:Calorimetry                    0.666852       1.64741       3.83218       1.44017      0.896545        10     
reco:pandoraShowercalo:ShowerCalorimetry              1.32913       3.47311       7.75262       3.04427       1.93474        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         1.28716       3.41927       7.50065       2.88109       1.88965        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0429197     0.0726596     0.0995817     0.0714554     0.0188952       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0432104     0.0724923     0.0951709     0.0719661     0.0181427       10     
reco:emtrkmichelid:EmTrackMichelId                    60.7689       95.4153       137.203       95.411        21.4851        10     
reco:crttag:SingleCRTMatchingProducer               0.00575631    0.00866383     0.0131108    0.00836656    0.00256488       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00446837    0.00738421     0.0110434    0.00732881    0.00215763       10     
reco:pandora2Track:LArPandoraTrackCreation            3.16319       8.89449       20.9235       8.15214       5.14414        10     
reco:pandora2calo:ShowerCalorimetry                   1.20935       3.17941       7.11498       2.74538       1.78735        10     
reco:pandora2calonosce:ShowerCalorimetry              1.16754        3.142        7.12527       2.75023       1.78127        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.042526      0.0695602     0.0926177     0.0710118     0.0165484       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.042123      0.0698674     0.0933399     0.0714222     0.0167177       10     
reco:pandora2Shower:LArPandoraShowerCreation          1.2823        3.82911       9.41422       3.69824       2.30109        10     
reco:pandora2Showercalo:ShowerCalorimetry             1.90324       4.81285       14.3001       3.78677       3.4834         10     
reco:pandora2Showercalonosce:ShowerCalorimetry        1.8751        4.72933       14.1273       3.71514       3.42924        10     
[art]:TriggerResults:TriggerResultInserter          2.0875e-05    2.68123e-05   6.6003e-05    2.16335e-05   1.32059e-05      10     
end_path:out1:RootOutput                             4.071e-06    5.7704e-06    1.7927e-05    4.3835e-06    4.06283e-06      10     
end_path:out1:RootOutput(write)                       2.13952       2.90396       5.64737       2.64071      0.971929        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6236.09 MB
  Peak resident set size usage (VmHWM): 3804.84 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.root', 'start_time': 1758135465.10547, 'end_time': 1758138295.2591307}
lsing
total 12G
-rw-r--r-- 1 dunepilot gridusers 5.8G Sep 17 15:44 prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.root
-rw-r--r-- 1 dunepilot gridusers 5.5G Sep 17 14:57 prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim.root
-rw-r--r-- 1 dunepilot gridusers  53M Sep 17 15:43 Pandora_Events.pndr
-rw-r--r-- 1 dunepilot gridusers 208K Sep 17 15:44 jobscript.log
-rw-r--r-- 1 dunepilot gridusers 196K Sep 17 15:44 mem.db
-rw-r--r-- 1 dunepilot gridusers  36K Sep 17 15:44 time.db
-rw-r--r-- 1 dunepilot gridusers  31K Sep 17 15:44 prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.log
-rw-r--r-- 1 dunepilot gridusers  13K Sep 17 15:44 prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim_reco1.err
-rw-r--r-- 1 dunepilot gridusers  13K Sep 17 14:57 prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim.log
-rw-r--r-- 1 dunepilot gridusers 4.5K Sep 17 14:57 prod_beam_p5GeV_protodunehd_1_47663_1_1758129557_detsim.err
-rw-r--r-- 1 dunepilot gridusers 3.5K Sep 17 15:44 Pandora_Geometry.xml
-rw-r--r-- 1 dunepilot gridusers  519 Sep 17 14:57 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 dunepilot gridusers  519 Sep 17 15:44 reco_protodunehd_hist.root
-rw-r--r-- 1 dunepilot gridusers  109 Sep 17 13:19 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers    0 Sep 17 15:02 ProtoDUNE.log
-rw-r--r-- 1 dunepilot gridusers    0 Sep 17 14:58 debugprod.log
disk usage
12G	.
justIN time: 2025-09-18 23:27:43 UTC       justIN version: 01.05.00