justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 20914.157@dunegpschedd01.fnal.gov

Jobsub ID20914.157@dunegpschedd01.fnal.gov
Workflow ID404
Stage ID1
User namemsiden@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-08-05 02:58:41
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-08-05 08:48:51
From worker nodeHostnamecn530.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-05 03:14:04
Input fileshd-protodune:np04hd_raw_run027087_0093_dataflow0_datawriter_0_20240614T153518.hdf5
JobscriptExit code0
Real time5h (19911s)
CPU time5h (19559s = 98%)
Max RSS bytes4799315968 (4576 MiB)
Outputting started2025-08-05 08:45:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/msiden/channel_map_test/fnal/00404/1/001/pdhd_processing_1_20914_157_1754363662_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/msiden/channel_map_test/fnal/00404/1/001/pdhd_processing_1_20914_157_1754363662_stage1_stage2_tfile.root
Finished2025-08-05 08:48:51
Saved logsjustin-logs:20914.157-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Saver: q=2.44195e+06 n=1147432 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 61059 traces, 61059 summary
Retagger: tagging trace set: gauss with 54936 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54936 traces tagged "gauss"
FrameSaver: q=1.3788e+06 n=755226 tag=gauss
wclsFrameSaver: saving 61059 traces tagged "wiener"
FrameSaver: q=1.37516e+06 n=759363 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67719 traces, 67719 summary
Retagger: tagging trace set: gauss with 62882 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62882 traces tagged "gauss"
FrameSaver: q=1.55078e+06 n=835882 tag=gauss
wclsFrameSaver: saving 67719 traces tagged "wiener"
FrameSaver: q=1.77324e+06 n=893941 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 69198 traces, 69198 summary
Retagger: tagging trace set: gauss with 61688 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61688 traces tagged "gauss"
FrameSaver: q=1.53442e+06 n=808960 tag=gauss
wclsFrameSaver: saving 69198 traces tagged "wiener"
FrameSaver: q=1.57821e+06 n=850189 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 62134 traces, 62134 summary
Retagger: tagging trace set: gauss with 53276 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53276 traces tagged "gauss"
FrameSaver: q=1.27324e+06 n=673907 tag=gauss
wclsFrameSaver: saving 62134 traces tagged "wiener"
FrameSaver: q=1.41302e+06 n=705556 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 84824 traces, 84824 summary
Retagger: tagging trace set: gauss with 72717 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72717 traces tagged "gauss"
FrameSaver: q=2.2017e+06 n=995523 tag=gauss
wclsFrameSaver: saving 84824 traces tagged "wiener"
FrameSaver: q=2.45558e+06 n=1064124 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 78662 traces, 78662 summary
Retagger: tagging trace set: gauss with 68185 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68185 traces tagged "gauss"
FrameSaver: q=1.77726e+06 n=877667 tag=gauss
wclsFrameSaver: saving 78662 traces tagged "wiener"
FrameSaver: q=1.92795e+06 n=929471 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 84493 traces, 84493 summary
Retagger: tagging trace set: gauss with 72234 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72234 traces tagged "gauss"
FrameSaver: q=2.05074e+06 n=976159 tag=gauss
wclsFrameSaver: saving 84493 traces tagged "wiener"
FrameSaver: q=2.2498e+06 n=1019968 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 90497 traces, 90497 summary
Retagger: tagging trace set: gauss with 78722 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 78722 traces tagged "gauss"
FrameSaver: q=2.45612e+06 n=1053514 tag=gauss
wclsFrameSaver: saving 90497 traces tagged "wiener"
FrameSaver: q=2.65218e+06 n=1112166 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66877 traces, 66877 summary
Retagger: tagging trace set: gauss with 61861 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61861 traces tagged "gauss"
FrameSaver: q=1.4787e+06 n=828738 tag=gauss
wclsFrameSaver: saving 66877 traces tagged "wiener"
FrameSaver: q=1.60678e+06 n=885822 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82361 traces, 82361 summary
Retagger: tagging trace set: gauss with 73771 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73771 traces tagged "gauss"
FrameSaver: q=2.20482e+06 n=1064847 tag=gauss
wclsFrameSaver: saving 82361 traces tagged "wiener"
FrameSaver: q=2.28243e+06 n=1102760 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77800 traces, 77800 summary
Retagger: tagging trace set: gauss with 67848 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 67848 traces tagged "gauss"
FrameSaver: q=1.7577e+06 n=935989 tag=gauss
wclsFrameSaver: saving 77800 traces tagged "wiener"
FrameSaver: q=1.86334e+06 n=937695 tag=wiener
05-Aug-2025 09:45:52 BST  Closed output file "pdhd_processing_1_20914_157_1754363662_stage1_stage2.root"
05-Aug-2025 09:45:52 BST  Closed input file "pdhd_processing_1_20914_157_1754363662_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              275.726       458.522       849.298       409.602       140.35         40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000721061   0.00418452    0.00949834    0.00332198    0.00238442       40     
produce:fembfilter:PDHDFEMBFilter                      0.803424      0.984293       1.48023      0.907374      0.197372        40     
produce:wclsdatahd:WireCellToolkit                      59.5386       69.0869       102.308       66.5993       9.99796        40     
produce:gaushit:GausHitFinder                          0.659262       1.17005       2.18095       1.08918      0.316376        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000417082   0.000619339   0.000920259   0.000603864   0.000125577      40     
produce:reco3d:SpacePointSolver                        0.358315       1.18053       3.5428       0.952001      0.640303        40     
produce:hitpdune:DisambigFromSpacePoints               0.431128      0.974469       2.70685      0.826617      0.481426        40     
produce:pandora:StandardPandora                         10.1687       28.6543       76.3431       25.4058       14.0407        40     
produce:pandoraWriter:StandardPandora                   0.19436      0.264837      0.462664      0.259132      0.0588731       40     
produce:pandoraTrack:LArPandoraTrackCreation            3.64919       8.56009       16.1889       7.87636       3.19582        40     
produce:pandoraShower:LArPandoraShowerCreation          4.36061       11.7941       24.9237       11.1144       5.45801        40     
produce:pandoracalo:Calorimetry                         1.38751       3.13631       6.10228       2.9382        1.11191        40     
produce:pandoracalonosce:Calorimetry                    1.38341       3.01574       5.67677       2.86801       1.02514        40     
produce:pandorapid:Chi2ParticleID                     0.00208067    0.00336559    0.00778221    0.00294534    0.00126766       40     
produce:pandoraShowercalo:ShowerCalorimetry             3.11693       9.00359       17.5399       8.25519       3.96644        40     
produce:pandoraShowercalonosce:ShowerCalorimetry        3.03837       8.87241       17.2817       8.30713       3.9139         40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.112409      0.198055      0.391585       0.18429      0.0549456       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0477685     0.0839436     0.182144      0.0816661     0.0238493       40     
produce:emtrkmichelid:EmTrackMichelId                   12.6839       20.6191       35.518        20.1411       4.72826        40     
[art]:TriggerResults:TriggerResultInserter            5.1524e-05    6.87565e-05   0.000169728   6.31615e-05   2.08078e-05      40     
end_path:out1:RootOutput                              1.0066e-05    1.96768e-05   3.2615e-05    1.8654e-05    4.2184e-06       40     
end_path:michelremoving:michelremoving                 0.0616783     0.215976      0.546116      0.176778      0.124708        40     
end_path:michelremovinggnocchi:michelremoving          0.0521463      0.21277      0.573028      0.173787      0.126729        40     
end_path:calibanagnocchi:CalibAnaTree                   140.526       288.472       634.819       258.635       111.043        40     
end_path:out1:RootOutput(write)                        0.761673       1.25853        2.295        1.23677      0.342025        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7709.41 MB
  Peak resident set size usage (VmHWM): 4799.32 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_20914_157_1754363662_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_20914_157_1754363662_stage1_stage2_tfile.root', 'start_time': 1754365110.4912145, 'end_time': 1754383555.434287}
justIN time: 2025-08-05 23:15:54 UTC       justIN version: 01.04.00