justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.28@dunegpschedd02.fnal.gov

Jobsub ID297754.28@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-03 20:10:58
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:46:35
Input fileshd-protodune:np04hd_raw_run029917_0114_dataflow0_datawriter_0_20241011T173846.hdf5
JobscriptExit code0
Real time4h (15778s)
CPU time4h (15271s = 96%)
Max RSS bytes3659489280 (3489 MiB)
Outputting started2026-02-03 20:09:34
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_28_1770133611_reco.root
Finished2026-02-03 20:10:58
Saved logsjustin-logs:297754.28-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9760
wclsFrameSaver: no samples within desired window for channel 9761
wclsFrameSaver: no samples within desired window for channel 9761
wclsFrameSaver: no samples within desired window for channel 9762
wclsFrameSaver: no samples within desired window for channel 9762
wclsFrameSaver: no samples within desired window for channel 9763
wclsFrameSaver: no samples within desired window for channel 9763
wclsFrameSaver: no samples within desired window for channel 9764
wclsFrameSaver: no samples within desired window for channel 9764
wclsFrameSaver: no samples within desired window for channel 9765
wclsFrameSaver: no samples within desired window for channel 9765
wclsFrameSaver: no samples within desired window for channel 9766
wclsFrameSaver: no samples within desired window for channel 9766
wclsFrameSaver: no samples within desired window for channel 9767
wclsFrameSaver: no samples within desired window for channel 9767
wclsFrameSaver: no samples within desired window for channel 9768
wclsFrameSaver: no samples within desired window for channel 9768
wclsFrameSaver: no samples within desired window for channel 9769
wclsFrameSaver: no samples within desired window for channel 9770
wclsFrameSaver: no samples within desired window for channel 9771
wclsFrameSaver: no samples within desired window for channel 9771
wclsFrameSaver: no samples within desired window for channel 9772
wclsFrameSaver: no samples within desired window for channel 9773
wclsFrameSaver: no samples within desired window for channel 9773
wclsFrameSaver: no samples within desired window for channel 9774
wclsFrameSaver: no samples within desired window for channel 9775
wclsFrameSaver: no samples within desired window for channel 9776
wclsFrameSaver: no samples within desired window for channel 9777
wclsFrameSaver: no samples within desired window for channel 9778
wclsFrameSaver: no samples within desired window for channel 9778
wclsFrameSaver: no samples within desired window for channel 9779
wclsFrameSaver: no samples within desired window for channel 9779
wclsFrameSaver: no samples within desired window for channel 9780
wclsFrameSaver: no samples within desired window for channel 9780
wclsFrameSaver: no samples within desired window for channel 9780
wclsFrameSaver: no samples within desired window for channel 9781
wclsFrameSaver: no samples within desired window for channel 9781
wclsFrameSaver: no samples within desired window for channel 9783
wclsFrameSaver: no samples within desired window for channel 9783
wclsFrameSaver: no samples within desired window for channel 9784
wclsFrameSaver: no samples within desired window for channel 9826
wclsFrameSaver: no samples within desired window for channel 9827
wclsFrameSaver: no samples within desired window for channel 9937
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
FrameSaver: q=2.52812e+06 n=1176053 tag=wiener
03-Feb-2026 21:09:27 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_28_1770133611_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            198.55        782.17        5554.25       293.901       1179.29        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                          5.5529e-05    0.000116895   0.00023961    9.48195e-05   5.43232e-05      20     
produce:spillflag:PDHDSPSSpillFlagProducer           3.536e-05    7.71678e-05   0.00027077    5.7629e-05    5.34541e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0594771     0.118971      0.168022      0.120157      0.0291345       20     
produce:triggertypefilter:PDHDTriggerTypeFilter     4.9789e-05    8.86118e-05   0.00047013    6.57295e-05   8.87033e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   5.25085       6.06394        7.215         6.146       0.442823        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000750589   0.000880462   0.00110692    0.000826243   0.000113097      20     
produce:fembfilter:PDHDFEMBFilter                    7.472e-05    0.000108033    0.0003402    9.1615e-05    5.60074e-05      20     
produce:wclsdatahd:WireCellToolkit                    123.227       141.995       164.299       142.694       9.89115        20     
produce:gaushit:GausHitFinder                        0.735717       1.17372       1.82441       1.16082      0.283502        20     
produce:reco3d:SpacePointSolver                       1.46932       11.7309       61.9973       6.87416       13.8916        20     
produce:hitpdune:DisambigFromSpacePoints              1.12796       2.91147       7.31588       2.72913       1.65844        20     
produce:nhitsfilter:NumberOfHitsFilter              0.000325169   0.000482245   0.000762149   0.000446239   0.000112217      20     
produce:pandora:StandardPandora                       38.5265       585.028       5244.45       111.818       1152.82        20     
produce:pandoraWriter:StandardPandora                0.181636      0.274583      0.454604      0.270736      0.0653618       20     
produce:pandoraTrack:LArPandoraTrackCreation          2.43328       6.58225       27.8605       4.45708       5.82478        20     
produce:pandoraShower:LArPandoraShowerCreation        2.25413       5.10317       13.4191       4.16933       2.68752        20     
produce:pandoracalo:Calorimetry                       1.32192       3.03895       10.9039       2.47492       2.27692        20     
produce:pandoracalonosce:Calorimetry                  1.31391       3.02139       12.8388       2.24249       2.59512        20     
produce:pandorapid:Chi2ParticleID                   0.00205131    0.00333817    0.00583755    0.00308461    0.000941017      20     
produce:pandoraShowercalo:ShowerCalorimetry           1.83025       4.69219       10.0321       3.95343       2.33035        20     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.68613       4.58364       9.71164       3.92021       2.15562        20     
[art]:TriggerResults:TriggerResultInserter           2.573e-05    3.97754e-05    9.657e-05     3.646e-05    1.48325e-05      20     
end_path:out1:RootOutput                             1.954e-05    4.02914e-05   0.00031314     2.525e-05    6.28415e-05      20     
end_path:out1:RootOutput(write)                       4.45371       5.52413       7.99233       5.29668       0.82819        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5579.56 MB
  Peak resident set size usage (VmHWM): 3659.49 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_28_1770133611_reco.root', 'start_time': 1770133611.1051922, 'end_time': 1770149368.3607433}
justIN time: 2026-02-04 06:07:54 UTC       justIN version: 01.06.00