justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.9@dunegpschedd02.fnal.gov

Jobsub ID297754.9@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-04 00:48:22
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:46:29
Input fileshd-protodune:np04hd_raw_run029917_0124_dataflow0_datawriter_0_20241011T174906.hdf5
JobscriptExit code0
Real time9h (32427s)
CPU time8h (31568s = 97%)
Max RSS bytes3937751040 (3755 MiB)
Outputting started2026-02-04 00:46:57
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_9_1770133611_reco.root
Finished2026-02-04 00:48:22
Saved logsjustin-logs:297754.9-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

esired window for channel 10172
wclsFrameSaver: no samples within desired window for channel 10173
wclsFrameSaver: no samples within desired window for channel 10173
wclsFrameSaver: no samples within desired window for channel 10174
wclsFrameSaver: no samples within desired window for channel 10174
wclsFrameSaver: no samples within desired window for channel 10175
wclsFrameSaver: no samples within desired window for channel 10175
wclsFrameSaver: no samples within desired window for channel 10176
wclsFrameSaver: no samples within desired window for channel 10176
wclsFrameSaver: no samples within desired window for channel 10177
wclsFrameSaver: no samples within desired window for channel 10177
wclsFrameSaver: no samples within desired window for channel 10178
wclsFrameSaver: no samples within desired window for channel 10178
wclsFrameSaver: no samples within desired window for channel 10179
wclsFrameSaver: no samples within desired window for channel 10179
wclsFrameSaver: no samples within desired window for channel 10180
wclsFrameSaver: no samples within desired window for channel 10181
wclsFrameSaver: no samples within desired window for channel 10182
wclsFrameSaver: no samples within desired window for channel 10183
wclsFrameSaver: no samples within desired window for channel 10184
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10185
wclsFrameSaver: no samples within desired window for channel 10186
wclsFrameSaver: no samples within desired window for channel 10187
wclsFrameSaver: no samples within desired window for channel 10188
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10189
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10190
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10191
wclsFrameSaver: no samples within desired window for channel 10192
wclsFrameSaver: no samples within desired window for channel 10193
wclsFrameSaver: no samples within desired window for channel 10194
wclsFrameSaver: no samples within desired window for channel 10195
wclsFrameSaver: no samples within desired window for channel 10196
wclsFrameSaver: no samples within desired window for channel 10197
wclsFrameSaver: no samples within desired window for channel 10198
wclsFrameSaver: no samples within desired window for channel 10199
wclsFrameSaver: no samples within desired window for channel 10200
wclsFrameSaver: no samples within desired window for channel 10201
wclsFrameSaver: no samples within desired window for channel 10202
wclsFrameSaver: no samples within desired window for channel 10203
wclsFrameSaver: no samples within desired window for channel 10204
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10206
wclsFrameSaver: no samples within desired window for channel 10207
wclsFrameSaver: no samples within desired window for channel 10208
wclsFrameSaver: no samples within desired window for channel 10209
wclsFrameSaver: no samples within desired window for channel 10210
wclsFrameSaver: no samples within desired window for channel 10211
wclsFrameSaver: no samples within desired window for channel 10212
wclsFrameSaver: no samples within desired window for channel 10213
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10216
wclsFrameSaver: no samples within desired window for channel 10217
wclsFrameSaver: no samples within desired window for channel 10218
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=5.10661e+06 n=1792824 tag=wiener
04-Feb-2026 01:46:51 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_9_1770133611_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                           0.269481       1614.32       12658.6       405.805       3403.62        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                          5.7531e-05    0.000117634   0.00020374    0.000109375   4.16835e-05      20     
produce:spillflag:PDHDSPSSpillFlagProducer           4.334e-05    7.5551e-05    0.00028221    6.2985e-05    5.03402e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.094652       0.29138       2.45632      0.153645      0.507288        20     
produce:triggertypefilter:PDHDTriggerTypeFilter      4.841e-05    9.31675e-05   0.00046502    7.2915e-05    8.68225e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   7.42166       10.0264       17.5167       9.86553       2.25309        18     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000725762    0.0116591     0.129427     0.00100885     0.0299041       18     
produce:fembfilter:PDHDFEMBFilter                   8.6581e-05    0.000133105   0.000466379   0.00011171    8.30773e-05      18     
produce:wclsdatahd:WireCellToolkit                    166.577       201.285       250.067       201.495       20.7535        18     
produce:gaushit:GausHitFinder                        0.788196       1.34285       3.05867       1.26252       0.52858        18     
produce:reco3d:SpacePointSolver                       1.42918       33.665        212.382       6.05762       59.2117        18     
produce:hitpdune:DisambigFromSpacePoints             0.720063       4.75132       31.8362       2.67847       6.84465        18     
produce:nhitsfilter:NumberOfHitsFilter              0.000359271   0.000592435   0.00100381    0.000584464   0.00014827       18     
produce:pandora:StandardPandora                       33.1458       1500.41       12143.5       194.105        3500          18     
produce:pandoraWriter:StandardPandora                0.198513      0.320633      0.608691      0.285772      0.107319        18     
produce:pandoraTrack:LArPandoraTrackCreation          2.12011       8.5806        36.0712       5.49147       8.71384        18     
produce:pandoraShower:LArPandoraShowerCreation        2.07873       7.42782       27.8996       5.08995       6.27029        18     
produce:pandoracalo:Calorimetry                      0.814679       3.31932       13.1659       2.32681       2.95617        18     
produce:pandoracalonosce:Calorimetry                 0.880445       3.4135        13.1088       2.27796       3.15543        18     
produce:pandorapid:Chi2ParticleID                   0.00200797    0.00373337    0.00722811    0.00298379    0.00154879       18     
produce:pandoraShowercalo:ShowerCalorimetry           1.49674       6.44969       24.7207       4.67017       5.46199        18     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.34064       6.31241       25.0635       4.83931       5.38824        18     
[art]:TriggerResults:TriggerResultInserter           2.063e-05    4.8473e-05    0.00011103    4.6495e-05    2.18577e-05      20     
end_path:out1:RootOutput                             1.455e-05    5.1727e-05     0.0003559     3.93e-05     7.11635e-05      20     
end_path:out1:RootOutput(write)                      1.262e-05      4.96078       7.51167       5.23142       1.96923        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5882.97 MB
  Peak resident set size usage (VmHWM): 3937.75 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_9_1770133611_reco.root', 'start_time': 1770133611.1053333, 'end_time': 1770166012.625464}
justIN time: 2026-02-04 06:06:42 UTC       justIN version: 01.06.00