justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.18@dunegpschedd02.fnal.gov

Jobsub ID297754.18@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-04 02:39:35
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:46:38
Input fileshd-protodune:np04hd_raw_run029917_0132_dataflow1_datawriter_0_20241011T175821.hdf5
JobscriptExit code0
Real time10h (39118s)
CPU time10h (38201s = 97%)
Max RSS bytes3596189696 (3429 MiB)
Outputting started2026-02-04 02:38:37
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_18_1770133611_reco.root
Finished2026-02-04 02:39:35
Saved logsjustin-logs:297754.18-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10192
wclsFrameSaver: no samples within desired window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10216
wclsFrameSaver: no samples within desired window for channel 10217
wclsFrameSaver: no samples within desired window for channel 10218
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=5.48276e+06 n=1894915 tag=wiener
04-Feb-2026 03:38:32 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_18_1770133611_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            229.923       1856.57       28164.8       301.836       5935.65        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           4.875e-05    9.45626e-05   0.00036513    7.9061e-05    6.45251e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer           2.656e-05    6.86434e-05   0.000389769    4.974e-05    7.40831e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0898934      0.13718      0.285609      0.117589      0.0455303       21     
produce:triggertypefilter:PDHDTriggerTypeFilter      4.737e-05    8.73768e-05   0.00046354     6.689e-05    8.49954e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   5.56628       6.9682        9.66251       6.86118      0.955526        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000772573   0.00464659     0.0315459    0.00118056     0.0067176       21     
produce:fembfilter:PDHDFEMBFilter                   6.2081e-05    0.000111945   0.000458349   0.00010477    8.03079e-05      21     
produce:wclsdatahd:WireCellToolkit                    97.2388       139.43        160.82        141.359       16.5351        21     
produce:gaushit:GausHitFinder                        0.782752       1.15041       2.50864       1.01976      0.374273        21     
produce:reco3d:SpacePointSolver                       1.03661       6.35852       61.526        2.72979       12.6896        21     
produce:hitpdune:DisambigFromSpacePoints              1.36197       2.88793       7.25118       2.32495       1.59828        21     
produce:nhitsfilter:NumberOfHitsFilter              0.000337531   0.000538144   0.00102124    0.000499892   0.000141858      21     
produce:pandora:StandardPandora                       71.3705       1670.66       27865.1       112.152       5909.91        21     
produce:pandoraWriter:StandardPandora                0.206851       0.29851      0.483724      0.288518      0.0658095       21     
produce:pandoraTrack:LArPandoraTrackCreation          2.08921        5.813        20.1881       4.67363       4.03817        21     
produce:pandoraShower:LArPandoraShowerCreation        1.77082       4.87652       14.4377       4.12157       2.83025        21     
produce:pandoracalo:Calorimetry                       1.15702       2.44107       8.14366       1.94504       1.51807        21     
produce:pandoracalonosce:Calorimetry                  1.03432       2.43776       8.42677       1.92239       1.6043         21     
produce:pandorapid:Chi2ParticleID                   0.00206154    0.00356666    0.00586973    0.00348912    0.000938709      21     
produce:pandoraShowercalo:ShowerCalorimetry           1.3582        4.12066       12.5679       3.47469       2.33922        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.5224        3.89159       11.5471       3.56117       2.11649        21     
[art]:TriggerResults:TriggerResultInserter           2.43e-05     4.3495e-05    0.000143411   3.5371e-05    2.54942e-05      21     
end_path:out1:RootOutput                             1.935e-05    6.93692e-05   0.000702023    2.87e-05     0.000147787      21     
end_path:out1:RootOutput(write)                       3.76411       4.58902       5.99878       4.52715      0.581911        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5563.26 MB
  Peak resident set size usage (VmHWM): 3596.19 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_18_1770133611_reco.root', 'start_time': 1770133611.105132, 'end_time': 1770172712.8520865}
justIN time: 2026-02-04 04:28:46 UTC       justIN version: 01.06.00