justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.70@dunegpschedd02.fnal.gov

Jobsub ID297754.70@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2026-02-04 00:54:05
From worker nodeHostnameb9p06p2461.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:50:08
Input fileshd-protodune:np04hd_raw_run029917_0003_dataflow0_datawriter_0_20241011T153842.hdf5
JobscriptExit code0
Real time9h (32549s)
CPU time8h (31744s = 97%)
Max RSS bytes3551657984 (3387 MiB)
Outputting started2026-02-04 00:52:38
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_70_1770133823_reco.root
Finished2026-02-04 00:54:05
Saved logsjustin-logs:297754.70-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

hannel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9750
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9758
wclsFrameSaver: no samples within desired window for channel 9758
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9812
wclsFrameSaver: no samples within desired window for channel 9967
wclsFrameSaver: no samples within desired window for channel 10029
wclsFrameSaver: no samples within desired window for channel 10037
wclsFrameSaver: no samples within desired window for channel 10064
wclsFrameSaver: no samples within desired window for channel 10064
wclsFrameSaver: no samples within desired window for channel 10065
wclsFrameSaver: no samples within desired window for channel 10065
wclsFrameSaver: no samples within desired window for channel 10066
wclsFrameSaver: no samples within desired window for channel 10067
wclsFrameSaver: no samples within desired window for channel 10067
wclsFrameSaver: no samples within desired window for channel 10068
wclsFrameSaver: no samples within desired window for channel 10069
wclsFrameSaver: no samples within desired window for channel 10069
wclsFrameSaver: no samples within desired window for channel 10070
wclsFrameSaver: no samples within desired window for channel 10222
wclsFrameSaver: no samples within desired window for channel 10232
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10234
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10235
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=2.46907e+06 n=1174684 tag=wiener
04-Feb-2026 01:52:32 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_70_1770133823_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                           0.202061       1545.07        11380        261.859       2984.73        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                          5.4781e-05    0.000107614   0.000168642   0.000105191   3.20293e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer           2.939e-05    6.9663e-05    0.000232842   6.1981e-05    4.11259e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.075877      0.129728      0.256736      0.117614      0.0422503       21     
produce:triggertypefilter:PDHDTriggerTypeFilter      4.257e-05    7.92283e-05   0.000422084    6.031e-05    7.82923e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   5.40388       6.1264        7.00187       6.10315      0.420317        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000689427   0.000995316   0.00230422    0.000863119   0.000374278      20     
produce:fembfilter:PDHDFEMBFilter                   8.1171e-05    0.000125247   0.000543966   0.000100401   9.78897e-05      20     
produce:wclsdatahd:WireCellToolkit                    102.16        125.52        155.585       125.302       12.6484        20     
produce:gaushit:GausHitFinder                        0.589899       1.17181       2.09386       1.15976      0.310172        20     
produce:reco3d:SpacePointSolver                       1.26858       6.33802       17.1053       5.6845        4.84398        20     
produce:hitpdune:DisambigFromSpacePoints             0.656558       3.02304       9.29303       2.48865       2.01154        20     
produce:nhitsfilter:NumberOfHitsFilter              0.000294964   0.000500852   0.000841769   0.00047902    0.000124216      20     
produce:pandora:StandardPandora                       21.1233       1449.87       11200.6       109.707       3029.52        20     
produce:pandoraWriter:StandardPandora                0.152362      0.283441      0.557849      0.252167      0.101028        20     
produce:pandoraTrack:LArPandoraTrackCreation          1.75462       5.2069        12.5206       4.48427       2.71472        20     
produce:pandoraShower:LArPandoraShowerCreation        1.80955       4.81748       10.6864       4.35893       2.28462        20     
produce:pandoracalo:Calorimetry                      0.784062       2.71069       6.37321       2.19401       1.47911        20     
produce:pandoracalonosce:Calorimetry                 0.680453       2.63174       6.01899       2.15638       1.45044        20     
produce:pandorapid:Chi2ParticleID                   0.00195429    0.00326479    0.00624391     0.0028795    0.00116032       20     
produce:pandoraShowercalo:ShowerCalorimetry           1.56815       4.56178       8.55565       4.35888       1.96512        20     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.57423       4.41253       8.07756       3.93587       1.89608        20     
[art]:TriggerResults:TriggerResultInserter           2.569e-05    5.17111e-05   0.000169832    4.343e-05    3.18848e-05      21     
end_path:out1:RootOutput                             1.406e-05    4.96891e-05   0.000447495    2.969e-05    8.92247e-05      21     
end_path:out1:RootOutput(write)                      7.85e-06       4.98869       8.34597       4.85496       1.5408         21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5469.75 MB
  Peak resident set size usage (VmHWM): 3551.66 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_70_1770133823_reco.root', 'start_time': 1770133823.2218158, 'end_time': 1770166353.3658283}
justIN time: 2026-02-04 06:07:57 UTC       justIN version: 01.06.00