justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.102@dunegpschedd02.fnal.gov

Jobsub ID297754.102@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2026-02-04 01:48:05
From worker nodeHostnameb9p10p7838.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:55:25
Input fileshd-protodune:np04hd_raw_run029917_0121_dataflow1_datawriter_0_20241011T174544.hdf5
JobscriptExit code0
Real time9h (35478s)
CPU time9h (34720s = 97%)
Max RSS bytes4341157888 (4140 MiB)
Outputting started2026-02-04 01:46:44
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_102_1770134138_reco.root
Finished2026-02-04 01:48:05
Saved logsjustin-logs:297754.102-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

red window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=4.41768e+06 n=2246744 tag=wiener
04-Feb-2026 02:46:36 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_102_1770134138_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            324.442       1770.31       14601.8       595.176       3409.51        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           8.077e-05    0.000159948   0.000300781   0.000150971   5.2527e-05       20     
produce:spillflag:PDHDSPSSpillFlagProducer          5.5291e-05    9.33529e-05    0.0003326     7.576e-05    5.88644e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0732801      0.12495      0.186828       0.11896      0.0280204       20     
produce:triggertypefilter:PDHDTriggerTypeFilter      5.834e-05    0.000110201   0.000438552    8.712e-05    7.82798e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   5.4179        6.49859       8.76618       6.41771      0.801166        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000816174   0.00106297    0.00172038    0.000976825   0.000240584      20     
produce:fembfilter:PDHDFEMBFilter                    8.154e-05    0.000126018   0.000387881   0.000104555   6.46798e-05      20     
produce:wclsdatahd:WireCellToolkit                    199.27        245.444       304.472       243.473       25.6025        20     
produce:gaushit:GausHitFinder                        0.925077       1.43045       2.67336       1.37972      0.386724        20     
produce:reco3d:SpacePointSolver                       3.02968       22.5608       185.011       7.84681       39.6925        20     
produce:hitpdune:DisambigFromSpacePoints              2.29402       5.08821       13.385         4.008        3.18167        20     
produce:nhitsfilter:NumberOfHitsFilter              0.00039572    0.000670278   0.00228879    0.000578335   0.000398427      20     
produce:pandora:StandardPandora                       54.0108       1437.1        14187.2       225.189       3381.25        20     
produce:pandoraWriter:StandardPandora                 0.22082      0.366387      0.546293      0.344215      0.0885754       20     
produce:pandoraTrack:LArPandoraTrackCreation          4.36705       11.4694       31.8658       9.03457       7.01084        20     
produce:pandoraShower:LArPandoraShowerCreation        5.04276       9.94735       23.5121       7.42036       4.86271        20     
produce:pandoracalo:Calorimetry                       2.22577       4.34316       11.9775       3.7504        2.38948        20     
produce:pandoracalonosce:Calorimetry                  1.75168       4.21185       12.736        3.37666       2.56297        20     
produce:pandorapid:Chi2ParticleID                   0.00219248    0.00416142    0.00924967     0.0037588    0.00176512       20     
produce:pandoraShowercalo:ShowerCalorimetry           4.12879       7.5246        17.2748       6.35504       3.5652         20     
produce:pandoraShowercalonosce:ShowerCalorimetry      3.68561       7.77572       18.8857       6.22004       4.23794        20     
[art]:TriggerResults:TriggerResultInserter           2.651e-05    6.73833e-05   0.00012214    6.2165e-05    2.36586e-05      20     
end_path:out1:RootOutput                             2.273e-05    6.61139e-05   0.000345891   4.5645e-05    7.20738e-05      20     
end_path:out1:RootOutput(write)                       3.97723       5.72121       7.93072       5.20255       1.17316        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6232.84 MB
  Peak resident set size usage (VmHWM): 4341.16 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_102_1770134138_reco.root', 'start_time': 1770134138.967339, 'end_time': 1770169598.462136}
justIN time: 2026-02-04 12:02:02 UTC       justIN version: 01.06.00