justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.16@dunegpschedd02.fnal.gov

Jobsub ID297754.16@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-04 01:28:05
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:47:21
Input fileshd-protodune:np04hd_raw_run029917_0154_dataflow0_datawriter_0_20241011T182320.hdf5
JobscriptExit code0
Real time9h (34767s)
CPU time9h (34005s = 97%)
Max RSS bytes3963490304 (3779 MiB)
Outputting started2026-02-04 01:26:49
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_16_1770133653_reco.root
Finished2026-02-04 01:28:05
Saved logsjustin-logs:297754.16-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

red window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10216
wclsFrameSaver: no samples within desired window for channel 10217
wclsFrameSaver: no samples within desired window for channel 10218
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=3.75958e+06 n=1710842 tag=wiener
04-Feb-2026 02:26:41 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_16_1770133653_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            239.011       1733.83       14689.5       543.991       3456.26        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           4.893e-05    0.000112596   0.00016269    0.000109155   2.8106e-05       20     
produce:spillflag:PDHDSPSSpillFlagProducer           3.596e-05    7.52251e-05   0.00024422    6.6295e-05    4.20079e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0534785     0.120783      0.191115      0.117528      0.0269229       20     
produce:triggertypefilter:PDHDTriggerTypeFilter      3.88e-05     0.000116041   0.000422669   8.26155e-05   8.78509e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   5.48248       6.1269        7.18832       6.0443       0.455916        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000755613   0.000960009   0.00147693    0.000914372   0.000159979      20     
produce:fembfilter:PDHDFEMBFilter                    7.542e-05     0.0001287    0.00044025    0.00010082    7.90382e-05      20     
produce:wclsdatahd:WireCellToolkit                    160.816       207.871       278.241       198.794       30.851         20     
produce:gaushit:GausHitFinder                        0.836742       1.35841       3.72197       1.1353       0.661116        20     
produce:reco3d:SpacePointSolver                       2.25853       54.7423       360.422       14.7079       91.4955        20     
produce:hitpdune:DisambigFromSpacePoints              1.40135       5.62782       18.1751       4.06607        4.283         20     
produce:nhitsfilter:NumberOfHitsFilter              0.000352121   0.000592669    0.0017409    0.000476669   0.000300061      20     
[art]:TriggerResults:TriggerResultInserter           1.987e-05    5.8462e-05    0.000422129    3.972e-05    8.40212e-05      20     
end_path:out1:RootOutput                            1.8701e-05    6.38626e-05   0.000665669   3.2395e-05    0.000138167      20     
end_path:out1:RootOutput(write)                       5.4e-05       5.25412       8.30073       5.27031       1.59743        20     
produce:pandora:StandardPandora                       43.7117       1495.71        14193        252.084       3477.47        19     
produce:pandoraWriter:StandardPandora                0.212853      0.341441      0.624871      0.306851      0.108199        19     
produce:pandoraTrack:LArPandoraTrackCreation          3.07167       7.87345       17.169        6.1142        3.64848        19     
produce:pandoraShower:LArPandoraShowerCreation        3.73725       6.99834       12.5226       6.39806       2.38163        19     
produce:pandoracalo:Calorimetry                       1.39689       3.3589        10.555        2.83492       1.95499        19     
produce:pandoracalonosce:Calorimetry                  1.34441       3.29258       9.05305       2.77111       1.68869        19     
produce:pandorapid:Chi2ParticleID                   0.00224918    0.00360803    0.00678363    0.00360519    0.00108673       19     
produce:pandoraShowercalo:ShowerCalorimetry           3.39365       5.54139       9.54486       5.30084       1.42438        19     
produce:pandoraShowercalonosce:ShowerCalorimetry      3.33818       5.39386       7.62461       5.40955       1.05053        19     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5868.09 MB
  Peak resident set size usage (VmHWM): 3963.49 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_16_1770133653_reco.root', 'start_time': 1770133653.6483402, 'end_time': 1770168402.7052257}
justIN time: 2026-02-04 07:03:41 UTC       justIN version: 01.06.00