justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.74@dunegpschedd02.fnal.gov

Jobsub ID297754.74@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce515
Last heartbeat2026-02-04 01:38:42
From worker nodeHostnameb9p12p0201.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:50:15
Input fileshd-protodune:np04hd_raw_run029917_0019_dataflow0_datawriter_0_20241011T155544.hdf5
JobscriptExit code0
Real time9h (35237s)
CPU time9h (34439s = 97%)
Max RSS bytes3660689408 (3491 MiB)
Outputting started2026-02-04 01:37:33
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_74_1770133826_reco.root
Finished2026-02-04 01:38:42
Saved logsjustin-logs:297754.74-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ired window for channel 10176
wclsFrameSaver: no samples within desired window for channel 10176
wclsFrameSaver: no samples within desired window for channel 10177
wclsFrameSaver: no samples within desired window for channel 10177
wclsFrameSaver: no samples within desired window for channel 10178
wclsFrameSaver: no samples within desired window for channel 10178
wclsFrameSaver: no samples within desired window for channel 10179
wclsFrameSaver: no samples within desired window for channel 10179
wclsFrameSaver: no samples within desired window for channel 10180
wclsFrameSaver: no samples within desired window for channel 10180
wclsFrameSaver: no samples within desired window for channel 10181
wclsFrameSaver: no samples within desired window for channel 10181
wclsFrameSaver: no samples within desired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10192
wclsFrameSaver: no samples within desired window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10216
wclsFrameSaver: no samples within desired window for channel 10217
wclsFrameSaver: no samples within desired window for channel 10218
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=3.89013e+06 n=1474095 tag=wiener
04-Feb-2026 02:37:26 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_74_1770133826_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            187.263       1672.07       29335.4       236.28        6187.63        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           5.982e-05    8.60727e-05   0.000231581    7.742e-05    3.61353e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer           2.805e-05    5.82172e-05   0.000298361    4.32e-05     5.58022e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0708226     0.119712      0.207696      0.116035      0.0296193       21     
produce:triggertypefilter:PDHDTriggerTypeFilter     3.7091e-05    8.23986e-05   0.000458812    5.984e-05    8.57917e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   4.43163       4.97918       6.1038        4.96222      0.348415        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000539451   0.000825106   0.00197221    0.000733772   0.000298254      21     
produce:fembfilter:PDHDFEMBFilter                    5.751e-05    9.57074e-05   0.000467772    7.276e-05    8.46975e-05      21     
produce:wclsdatahd:WireCellToolkit                    126.114       138.273       147.899       139.471       5.67093        21     
produce:gaushit:GausHitFinder                        0.599814      0.909967       1.70748      0.854895      0.257855        21     
produce:reco3d:SpacePointSolver                       1.66177       12.3822       74.9857       5.54971       17.1568        21     
produce:hitpdune:DisambigFromSpacePoints             0.709293       2.32234       8.33915       1.58299       1.88934        21     
produce:nhitsfilter:NumberOfHitsFilter              0.000282751   0.000421987   0.000926314   0.000379221   0.000140632      21     
produce:pandora:StandardPandora                       23.3647       1488.21       29056.2       58.317        6165.99        21     
produce:pandoraWriter:StandardPandora                0.166353      0.233027      0.415218       0.21414      0.0585394       21     
produce:pandoraTrack:LArPandoraTrackCreation          1.73661       4.95523       20.5807       3.47236       4.63282        21     
produce:pandoraShower:LArPandoraShowerCreation        1.85214       4.05947       16.0606       3.57896       2.93803        21     
produce:pandoracalo:Calorimetry                      0.761071       2.0669        9.76171       1.66352       1.88403        21     
produce:pandoracalonosce:Calorimetry                 0.758641       2.01033       9.07807       1.63685       1.75104        21     
produce:pandorapid:Chi2ParticleID                   0.00191734    0.00279439    0.00637119    0.00242449    0.00102383       21     
produce:pandoraShowercalo:ShowerCalorimetry           1.53558       3.62871       13.774        2.95179       2.59319        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.52003       3.5909        14.105        2.9109        2.65744        21     
[art]:TriggerResults:TriggerResultInserter           2.636e-05    4.52617e-05   0.000165571    3.462e-05    3.10144e-05      21     
end_path:out1:RootOutput                             1.864e-05    5.00778e-05   0.000465491    2.526e-05    9.34667e-05      21     
end_path:out1:RootOutput(write)                       3.4707        3.93914       5.37072       3.77625      0.497038        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5609.59 MB
  Peak resident set size usage (VmHWM): 3660.69 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_74_1770133826_reco.root', 'start_time': 1770133826.8153079, 'end_time': 1770169047.796601}
justIN time: 2026-02-04 07:06:18 UTC       justIN version: 01.06.00