justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.25@dunegpschedd02.fnal.gov

Jobsub ID297754.25@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-04 00:31:08
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:46:51
Input fileshd-protodune:np04hd_raw_run029917_0029_dataflow0_datawriter_0_20241011T160705.hdf5
JobscriptExit code0
Real time8h (31365s)
CPU time8h (30608s = 97%)
Max RSS bytes3550502912 (3386 MiB)
Outputting started2026-02-04 00:29:37
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_25_1770133623_reco.root
Finished2026-02-04 00:31:08
Saved logsjustin-logs:297754.25-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10192
wclsFrameSaver: no samples within desired window for channel 10192
wclsFrameSaver: no samples within desired window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10216
wclsFrameSaver: no samples within desired window for channel 10217
wclsFrameSaver: no samples within desired window for channel 10218
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=4.72659e+06 n=1543660 tag=wiener
04-Feb-2026 01:29:30 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_25_1770133623_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            303.444       1487.73       21761.6       406.55        4542.18        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           5.732e-05    0.00011913    0.000277309   0.000103841   5.23874e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer           3.69e-05     7.8669e-05    0.00032798     6.379e-05    5.9669e-05       21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0756441     0.103773      0.144592      0.101297      0.0173157       21     
produce:triggertypefilter:PDHDTriggerTypeFilter      4.521e-05    9.16795e-05   0.00036407     7.882e-05    6.47971e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   5.73255       6.27071       6.84184       6.1935       0.278068        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000710919   0.000937048   0.00125471    0.000926879    0.000133        21     
produce:fembfilter:PDHDFEMBFilter                    8.806e-05    0.000132186   0.00041341    0.00011512    6.72047e-05      21     
produce:wclsdatahd:WireCellToolkit                    151.672       193.411       232.437       196.455       18.5162        21     
produce:gaushit:GausHitFinder                        0.875001       1.52271       2.33225       1.48945      0.417809        21     
produce:reco3d:SpacePointSolver                       1.05252        8.054        51.1536       3.49991       11.5778        21     
produce:hitpdune:DisambigFromSpacePoints              1.74173       4.98821       22.246        3.08993       5.21731        21     
produce:nhitsfilter:NumberOfHitsFilter              0.000451269   0.000620526   0.00116093    0.00056864    0.000170858      21     
produce:pandora:StandardPandora                       75.8974       1230.74       21424.6       141.359       4522.78        21     
produce:pandoraWriter:StandardPandora                0.230872       0.3919       0.785523      0.366812      0.122656        21     
produce:pandoraTrack:LArPandoraTrackCreation          3.35694       8.69471       25.8284       7.57321       4.7963         21     
produce:pandoraShower:LArPandoraShowerCreation        2.94657       7.33233       16.9531       6.59157       3.97165        21     
produce:pandoracalo:Calorimetry                       1.7501        3.79397       9.11687       3.17183       2.07827        21     
produce:pandoracalonosce:Calorimetry                  1.64006       3.7425        9.98635       3.02951       2.22719        21     
produce:pandorapid:Chi2ParticleID                   0.00270306    0.00469565    0.00788219     0.0052108    0.00148911       21     
produce:pandoraShowercalo:ShowerCalorimetry           2.5898        6.26922       15.3456       5.21964       3.73863        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      2.62558       6.19782       15.3515       4.70805       3.68956        21     
[art]:TriggerResults:TriggerResultInserter           2.784e-05    5.20438e-05   0.00014356     4.619e-05    2.33769e-05      21     
end_path:out1:RootOutput                             2.605e-05    5.17341e-05   0.000354969    3.443e-05    6.83553e-05      21     
end_path:out1:RootOutput(write)                       4.24825       5.63188       8.21854       5.40122       1.07534        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5469.61 MB
  Peak resident set size usage (VmHWM): 3550.5 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_25_1770133623_reco.root', 'start_time': 1770133623.4370322, 'end_time': 1770164971.4500036}
justIN time: 2026-02-04 07:44:31 UTC       justIN version: 01.06.00