justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.32@dunegpschedd02.fnal.gov

Jobsub ID297754.32@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-03 21:58:24
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:47:03
Input fileshd-protodune:np04hd_raw_run029917_0099_dataflow1_datawriter_0_20241011T172239.hdf5
JobscriptExit code0
Real time6h (22210s)
CPU time5h (21587s = 97%)
Max RSS bytes3674431488 (3504 MiB)
Outputting started2026-02-03 21:57:15
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_32_1770133635_reco.root
Finished2026-02-03 21:58:24
Saved logsjustin-logs:297754.32-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9795
wclsFrameSaver: no samples within desired window for channel 9796
wclsFrameSaver: no samples within desired window for channel 9796
wclsFrameSaver: no samples within desired window for channel 9796
wclsFrameSaver: no samples within desired window for channel 9866
wclsFrameSaver: no samples within desired window for channel 9882
wclsFrameSaver: no samples within desired window for channel 9888
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=3.86331e+06 n=1462227 tag=wiener
03-Feb-2026 22:57:08 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_32_1770133635_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            181.526       1105.1        7758.64       361.126       1787.99        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           7.18e-05     0.000147288   0.00032664    0.000126469   6.12908e-05      20     
produce:spillflag:PDHDSPSSpillFlagProducer           3.925e-05    7.52714e-05   0.000358719   5.95045e-05   6.68735e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.107664      0.242278       2.31307      0.126454      0.475753        20     
produce:triggertypefilter:PDHDTriggerTypeFilter     4.7641e-05    9.03069e-05   0.000445289    6.477e-05    8.41565e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   5.98621       6.81331       7.73128       6.86629      0.506755        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000508572   0.000907111   0.00142928    0.000886436   0.00016767       20     
produce:fembfilter:PDHDFEMBFilter                   6.9401e-05    0.000122679   0.000467239   0.000100505   8.20039e-05      20     
produce:wclsdatahd:WireCellToolkit                    115.378       138.621       173.821       139.018        11.87         20     
produce:gaushit:GausHitFinder                        0.716467       1.33479       2.00792       1.34936      0.404565        20     
produce:reco3d:SpacePointSolver                       1.77801       17.474        212.618       5.6587        45.006         20     
produce:hitpdune:DisambigFromSpacePoints             0.583329       3.64372       12.6562       3.18548       2.53273        20     
produce:nhitsfilter:NumberOfHitsFilter              0.00032769    0.000512178   0.00073113    0.000483956   0.000117371      20     
produce:pandora:StandardPandora                       22.3737       903.889       7545.82       173.52        1759.78        20     
produce:pandoraWriter:StandardPandora                0.153796      0.282936      0.493475      0.265246      0.094837        20     
produce:pandoraTrack:LArPandoraTrackCreation          1.58158       6.22227       15.0617       5.85831       3.30428        20     
produce:pandoraShower:LArPandoraShowerCreation        1.57302       5.08712       9.12535       4.81482       2.26375        20     
produce:pandoracalo:Calorimetry                      0.695082       3.04375       6.42736       2.91138       1.43575        20     
produce:pandoracalonosce:Calorimetry                 0.696967       2.97097       6.24929       2.9028        1.37986        20     
produce:pandorapid:Chi2ParticleID                   0.00198491    0.00392593    0.00691694     0.0038662     0.0011407       20     
produce:pandoraShowercalo:ShowerCalorimetry           1.65955       4.95515       9.31846       4.64374       2.11526        20     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.48241       4.68772       8.14158       4.40365       1.94458        20     
[art]:TriggerResults:TriggerResultInserter           2.194e-05    4.42089e-05   0.000140079   3.9195e-05    2.43011e-05      20     
end_path:out1:RootOutput                             1.578e-05    4.64175e-05   0.00040757     2.779e-05    8.30595e-05      20     
end_path:out1:RootOutput(write)                       4.13045       5.52447       7.34566       5.49947       0.92413        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5633.82 MB
  Peak resident set size usage (VmHWM): 3674.43 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_32_1770133635_reco.root', 'start_time': 1770133635.7905996, 'end_time': 1770155830.0061042}
justIN time: 2026-02-04 06:06:41 UTC       justIN version: 01.06.00