justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.75@dunegpschedd02.fnal.gov

Jobsub ID297754.75@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce510
Last heartbeat2026-02-04 01:30:08
From worker nodeHostnameb9p34p1010.cern.ch
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:50:23
Input fileshd-protodune:np04hd_raw_run029917_0043_dataflow0_datawriter_0_20241011T162257.hdf5
JobscriptExit code0
Real time9h (34727s)
CPU time9h (34084s = 98%)
Max RSS bytes3489947648 (3328 MiB)
Outputting started2026-02-04 01:29:10
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_75_1770133836_reco.root
Finished2026-02-04 01:30:08
Saved logsjustin-logs:297754.75-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9965
wclsFrameSaver: no samples within desired window for channel 9982
wclsFrameSaver: no samples within desired window for channel 10030
wclsFrameSaver: no samples within desired window for channel 10088
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
FrameSaver: q=5.2418e+06 n=1968155 tag=wiener
04-Feb-2026 02:29:05 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_75_1770133836_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            151.987       1650.29       23927.4       183.703       5132.32        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                          7.7525e-05    0.000111394   0.000188711   0.000100279   2.71936e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer          5.8507e-05    9.5157e-05     0.0001947    8.8943e-05    2.69936e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0653786     0.143851      0.864787      0.100364      0.164179        21     
produce:triggertypefilter:PDHDTriggerTypeFilter     7.8276e-05    0.000122632   0.000479434   0.000100259   8.25917e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   4.85459       5.4531        7.07959       5.35184      0.530508        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000888704   0.00108084    0.00200904    0.00100065    0.000244036      21     
produce:fembfilter:PDHDFEMBFilter                   8.6449e-05    0.000133576   0.000459294   0.000117585   7.42076e-05      21     
produce:wclsdatahd:WireCellToolkit                    91.2838       101.236       113.413       102.491       6.00193        21     
produce:gaushit:GausHitFinder                        0.587869      0.965677       1.9321       0.793798      0.383693        21     
produce:reco3d:SpacePointSolver                       1.31153       14.2622       147.513       3.44016       32.4348        21     
produce:hitpdune:DisambigFromSpacePoints             0.648615       2.17175       8.55611       1.17931       2.1444         21     
produce:nhitsfilter:NumberOfHitsFilter              0.000209001   0.000335598   0.000703849   0.000296832   0.000117626      21     
produce:pandora:StandardPandora                       20.5135       1491.69       23672.6       51.8533       5099.18        21     
produce:pandoraWriter:StandardPandora                0.173607      0.301497       0.71807      0.265234      0.142079        21     
produce:pandoraTrack:LArPandoraTrackCreation          1.61292       7.79011       72.0647       3.65424       14.797         21     
produce:pandoraShower:LArPandoraShowerCreation         1.472        6.48124       52.3487       3.7306        10.5878        21     
produce:pandoracalo:Calorimetry                      0.686186       3.01605       26.0697       1.75229       5.26246        21     
produce:pandoracalonosce:Calorimetry                  0.70174       2.96409       25.8597       1.6898        5.2334         21     
produce:pandorapid:Chi2ParticleID                    0.0018386    0.00308625    0.00889939     0.002714     0.00148809       21     
produce:pandoraShowercalo:ShowerCalorimetry           1.34208       4.53982       29.1387       3.02203       5.68931        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.32185        4.401        27.5362       3.02865       5.35951        21     
[art]:TriggerResults:TriggerResultInserter           5.406e-05    7.72482e-05   0.000168591   6.9393e-05    2.55661e-05      21     
end_path:out1:RootOutput                            3.0335e-05     6.657e-05    0.000455238   4.7401e-05    8.72885e-05      21     
end_path:out1:RootOutput(write)                       3.59317       4.45635       6.67374       4.30153      0.696254        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5612.23 MB
  Peak resident set size usage (VmHWM): 3489.95 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_75_1770133836_reco.root', 'start_time': 1770133836.3919349, 'end_time': 1770168546.6155467}
justIN time: 2026-02-04 07:03:22 UTC       justIN version: 01.06.00