justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.77@dunegpschedd02.fnal.gov

Jobsub ID297754.77@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2026-02-04 00:35:52
From worker nodeHostnameb9p06p2461.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:50:03
Input fileshd-protodune:np04hd_raw_run029917_0001_dataflow0_datawriter_0_20241011T153619.hdf5
JobscriptExit code0
Real time8h (31478s)
CPU time8h (30663s = 97%)
Max RSS bytes3689934848 (3518 MiB)
Outputting started2026-02-04 00:34:42
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_77_1770133816_reco.root
Finished2026-02-04 00:35:52
Saved logsjustin-logs:297754.77-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

clsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9730
wclsFrameSaver: no samples within desired window for channel 9731
wclsFrameSaver: no samples within desired window for channel 9732
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9769
wclsFrameSaver: no samples within desired window for channel 9770
wclsFrameSaver: no samples within desired window for channel 9770
wclsFrameSaver: no samples within desired window for channel 9859
wclsFrameSaver: no samples within desired window for channel 10107
wclsFrameSaver: no samples within desired window for channel 10221
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10223
wclsFrameSaver: no samples within desired window for channel 10224
wclsFrameSaver: no samples within desired window for channel 10225
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10226
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10227
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10231
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10233
FrameSaver: q=5.17644e+06 n=1855478 tag=wiener
04-Feb-2026 01:34:36 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_77_1770133816_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            154.484       1568.5        11926.7       495.242       2698.34        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                          5.8871e-05    0.000106728   0.000167912   0.000109001   2.88234e-05      20     
produce:spillflag:PDHDSPSSpillFlagProducer           2.728e-05    6.43358e-05   0.000209532   6.17855e-05   3.64766e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0860937      0.12553      0.161754      0.119484      0.0212752       20     
produce:triggertypefilter:PDHDTriggerTypeFilter      4.038e-05    8.64249e-05   0.000453545   6.91955e-05   8.52131e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   4.76008       6.18372       7.07214        6.288       0.535153        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000534856   0.000826873   0.00153875    0.000780439   0.000192706      20     
produce:fembfilter:PDHDFEMBFilter                   6.2531e-05    0.000109622   0.000443205   8.9706e-05    8.13706e-05      20     
produce:wclsdatahd:WireCellToolkit                    98.7237       127.71        160.493       126.979       17.2259        20     
produce:gaushit:GausHitFinder                        0.597561       1.22103       1.96166       1.19693      0.360461        20     
produce:reco3d:SpacePointSolver                       1.21455       18.3067       151.383       9.3285        31.7365        20     
produce:hitpdune:DisambigFromSpacePoints             0.630152       3.61708       11.4184       2.46097       2.62095        20     
produce:nhitsfilter:NumberOfHitsFilter              0.000269013   0.000516293   0.000735378   0.000488725   0.00012943       20     
produce:pandora:StandardPandora                       20.7308       1379.14       11716.1       307.233       2680.01        20     
produce:pandoraWriter:StandardPandora                0.124422      0.300463      0.578406      0.262544       0.11153        20     
produce:pandoraTrack:LArPandoraTrackCreation          1.48378       6.19713       21.6322       4.42076       4.60361        20     
produce:pandoraShower:LArPandoraShowerCreation        1.86161       5.19442       12.0147       4.25048       2.75689        20     
produce:pandoracalo:Calorimetry                       1.06216       2.98096       9.94864       2.29303       2.04383        20     
produce:pandoracalonosce:Calorimetry                  1.10084       2.84104       10.1651       2.28608       1.98406        20     
produce:pandorapid:Chi2ParticleID                    0.0019199    0.00335329    0.00541606     0.0034283    0.00102275       20     
produce:pandoraShowercalo:ShowerCalorimetry           1.80041       4.63121       11.991        4.02985       2.35882        20     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.90514       4.50601       10.573        4.14378       2.08185        20     
[art]:TriggerResults:TriggerResultInserter           2.223e-05    4.07526e-05   0.000119041   3.3286e-05    2.15042e-05      20     
end_path:out1:RootOutput                             1.977e-05    6.33271e-05   0.000406744   3.0865e-05    9.53848e-05      20     
end_path:out1:RootOutput(write)                       3.82883       5.23557       8.20088       5.12098       1.12612        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5591.64 MB
  Peak resident set size usage (VmHWM): 3689.93 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_77_1770133816_reco.root', 'start_time': 1770133816.4470701, 'end_time': 1770165277.5473094}
justIN time: 2026-02-04 06:06:44 UTC       justIN version: 01.06.00