justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297167.24@dunegpschedd02.fnal.gov

Jobsub ID297167.24@dunegpschedd02.fnal.gov
Workflow ID12399
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-02 15:07:53
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce515
Last heartbeat2026-02-03 05:38:13
From worker nodeHostnameb9p35p0043.cern.ch
cpuinfoAMD EPYC 9655P 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 15:58:13
Input fileshd-protodune:np04hd_raw_run029917_0138_dataflow1_datawriter_0_20241011T180510.hdf5
JobscriptExit code0
Real time13h (49146s)
CPU time13h (48588s = 98%)
Max RSS bytes3402559488 (3244 MiB)
Outputting started2026-02-03 05:37:21
Output filesusertests:proc_bsmtrigger_protodunehd_1_297167_24_1770047901_reco.root
Finished2026-02-03 05:38:13
Saved logsjustin-logs:297167.24-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9758
wclsFrameSaver: no samples within desired window for channel 9758
wclsFrameSaver: no samples within desired window for channel 9845
wclsFrameSaver: no samples within desired window for channel 9964
wclsFrameSaver: no samples within desired window for channel 10140
FrameSaver: q=2.52115e+07 n=2423550 tag=wiener
03-Feb-2026 06:37:10 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297167_24_1770047901_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                           0.274913       2454.72       15477.1       232.378       4417.74        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           5.42e-05     8.14655e-05    0.0001616     7.922e-05    2.1505e-05       20     
produce:spillflag:PDHDSPSSpillFlagProducer           5.035e-05    7.22025e-05   0.00021905    6.4785e-05    3.51111e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0876036     0.162767      0.353628      0.153242      0.0530881       20     
produce:triggertypefilter:PDHDTriggerTypeFilter      3.913e-05    7.71465e-05   0.00028696    6.8885e-05    4.90004e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   5.04331       7.25054       23.5955       6.14262       4.15113        19     
produce:timingrawdecoder:PDHDTimingRawDecoder        0.0006275    0.00159795     0.0136169    0.00087793     0.0028421       19     
produce:fembfilter:PDHDFEMBFilter                    6.203e-05    0.000104473   0.00040311     9.225e-05    7.16534e-05      19     
produce:wclsdatahd:WireCellToolkit                    77.5985       88.8103       104.574       86.7217       7.56985        19     
produce:gaushit:GausHitFinder                        0.716156      0.998742       1.99084      0.908848      0.309873        19     
produce:reco3d:SpacePointSolver                       2.11683       29.7444       152.094       7.97613       42.9644        19     
produce:hitpdune:DisambigFromSpacePoints             0.759483       3.00546       12.934        1.72061       2.90386        19     
produce:nhitsfilter:NumberOfHitsFilter              0.00020365    0.000324104   0.00066133    0.00029565    0.00011024       19     
produce:pandora:StandardPandora                       26.6651       2412.92       15087.1       123.555       4438.76        19     
produce:pandoraWriter:StandardPandora                0.168241       0.3625        0.7889       0.269594      0.172726        19     
produce:pandoraTrack:LArPandoraTrackCreation          2.28158       10.3349       56.4836       5.49677       12.3912        19     
produce:pandoraShower:LArPandoraShowerCreation        1.98935       7.56551       31.9684       5.73644       6.89362        19     
produce:pandoracalo:Calorimetry                       1.11313       3.75414       21.1055       2.33521       4.55276        19     
produce:pandoracalonosce:Calorimetry                  0.97157       3.49751       15.7062       2.29814       3.42529        19     
produce:pandorapid:Chi2ParticleID                   0.00161015    0.00290259    0.00526527    0.00265908    0.00109563       19     
produce:pandoraShowercalo:ShowerCalorimetry           1.70826       5.37119       16.7166       3.44338       3.72085        19     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.6981        4.95612       16.626        3.84367       3.42253        19     
[art]:TriggerResults:TriggerResultInserter           2.48e-05     5.0258e-05    0.00016115    4.4895e-05    2.64479e-05      20     
end_path:out1:RootOutput                             1.752e-05    4.77535e-05   0.00035774     3.069e-05    7.1486e-05       20     
end_path:out1:RootOutput(write)                      2.449e-05      4.46562       6.86748       4.37279       1.48475        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5737.16 MB
  Peak resident set size usage (VmHWM): 3402.56 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297167_24_1770047901_reco.root', 'start_time': 1770047901.5593314, 'end_time': 1770097031.1140444}
justIN time: 2026-02-04 12:55:49 UTC       justIN version: 01.06.00