justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 288764.0@dunegpschedd02.fnal.gov

Jobsub ID288764.0@dunegpschedd02.fnal.gov
Workflow ID12124
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-20 15:24:46
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2026-01-21 04:39:38
From worker nodeHostnameb9p08p0597.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-20 15:25:24
Input fileshd-protodune:np04hd_raw_run029917_0146_dataflow1_datawriter_0_20241011T181350.hdf5
JobscriptExit code0
Real time13h (47560s)
CPU time12h (46579s = 97%)
Max RSS bytes3958960128 (3775 MiB)
Outputting started2026-01-21 04:38:06
Output filesusertests:proc_bsmtrigger_protodunehd_1_288764_0_1768922734_reco.root
Finished2026-01-21 04:39:38
Saved logsjustin-logs:288764.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

desired window for channel 10177
wclsFrameSaver: no samples within desired window for channel 10178
wclsFrameSaver: no samples within desired window for channel 10178
wclsFrameSaver: no samples within desired window for channel 10179
wclsFrameSaver: no samples within desired window for channel 10179
wclsFrameSaver: no samples within desired window for channel 10180
wclsFrameSaver: no samples within desired window for channel 10180
wclsFrameSaver: no samples within desired window for channel 10181
wclsFrameSaver: no samples within desired window for channel 10181
wclsFrameSaver: no samples within desired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10192
wclsFrameSaver: no samples within desired window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10216
wclsFrameSaver: no samples within desired window for channel 10217
wclsFrameSaver: no samples within desired window for channel 10218
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=4.2838e+06 n=1682549 tag=wiener
21-Jan-2026 05:37:57 CET  Closed output file "proc_bsmtrigger_protodunehd_1_288764_0_1768922734_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            190.944       2262.09       40320.4       321.709       8511.72        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           5.417e-05    9.03507e-05   0.000230873   7.0261e-05    4.57574e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer          3.3221e-05    8.14582e-05   0.000445756   6.2971e-05    8.43953e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0335783     0.054113      0.0670517     0.0572287    0.00909834       21     
produce:triggertypefilter:PDHDTriggerTypeFilter      4.242e-05    0.000115462   0.000412086   6.6351e-05    9.88694e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   3.71342       5.14845       7.10437       5.05945      0.769778        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000669139   0.00129348    0.00387741    0.000964033   0.000950113      21     
produce:fembfilter:PDHDFEMBFilter                   7.2871e-05    0.000118087   0.000341374   0.000105742   5.49922e-05      21     
produce:wclsdatahd:WireCellToolkit                    124.67        166.958       228.139       149.382       31.1912        21     
produce:gaushit:GausHitFinder                        0.629626       1.13858       1.83222      0.998453      0.401364        21     
produce:reco3d:SpacePointSolver                       1.06795       17.5895       127.378       4.6694        32.7714        21     
produce:hitpdune:DisambigFromSpacePoints              0.90232       2.97869       9.35149       2.39349       1.89356        21     
produce:nhitsfilter:NumberOfHitsFilter              0.000318105   0.000513023   0.00101099    0.000490307   0.000152594      21     
produce:pandora:StandardPandora                       26.5936       2039.95        39992        91.7122       8487.82        21     
produce:pandoraWriter:StandardPandora                0.154431      0.298304      0.705905      0.285506      0.119613        21     
produce:pandoraTrack:LArPandoraTrackCreation          1.98446       5.3167        23.6825       4.43729       4.39879        21     
produce:pandoraShower:LArPandoraShowerCreation        1.77126       4.63032       11.8556       4.69772       2.15183        21     
produce:pandoracalo:Calorimetry                       0.85378       2.2724        9.84852       1.94372       1.81951        21     
produce:pandoracalonosce:Calorimetry                 0.851341       2.20616       9.56001       1.88747       1.75527        21     
produce:pandorapid:Chi2ParticleID                   0.00195241    0.00362609    0.00796789     0.0030728    0.00147199       21     
produce:pandoraShowercalo:ShowerCalorimetry           1.70791       4.05617       10.0124       4.29065       1.83676        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.6852        3.97806       9.42772       4.11579       1.73018        21     
[art]:TriggerResults:TriggerResultInserter           3.154e-05    5.27135e-05   0.000137762    4.866e-05    2.29148e-05      21     
end_path:out1:RootOutput                             3.026e-05    6.2267e-05    0.000478887   4.0771e-05    9.35255e-05      21     
end_path:out1:RootOutput(write)                       3.63995       4.96579       8.27589       4.22448       1.22257        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5865.8 MB
  Peak resident set size usage (VmHWM): 3958.96 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_288764_0_1768922734_reco.root', 'start_time': 1768922734.892859, 'end_time': 1768970278.7370908}
justIN time: 2026-02-05 15:35:18 UTC       justIN version: 01.06.00