justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.6@dunegpschedd02.fnal.gov

Jobsub ID297754.6@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2026-02-03 22:51:31
From worker nodeHostnameb9p02p3983.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:46:40
Input fileshd-protodune:np04hd_raw_run029917_0141_dataflow1_datawriter_0_20241011T180813.hdf5
JobscriptExit code0
Real time7h (25418s)
CPU time6h (24662s = 97%)
Max RSS bytes3730907136 (3558 MiB)
Outputting started2026-02-03 22:50:19
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_6_1770133612_reco.root
Finished2026-02-03 22:51:31
Saved logsjustin-logs:297754.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9751
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9756
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9757
wclsFrameSaver: no samples within desired window for channel 9758
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9810
wclsFrameSaver: no samples within desired window for channel 9810
wclsFrameSaver: no samples within desired window for channel 9810
wclsFrameSaver: no samples within desired window for channel 9811
wclsFrameSaver: no samples within desired window for channel 9811
wclsFrameSaver: no samples within desired window for channel 9812
wclsFrameSaver: no samples within desired window for channel 9812
wclsFrameSaver: no samples within desired window for channel 9812
wclsFrameSaver: no samples within desired window for channel 9813
wclsFrameSaver: no samples within desired window for channel 9813
wclsFrameSaver: no samples within desired window for channel 9813
wclsFrameSaver: no samples within desired window for channel 9813
wclsFrameSaver: no samples within desired window for channel 9814
wclsFrameSaver: no samples within desired window for channel 9814
wclsFrameSaver: no samples within desired window for channel 9815
wclsFrameSaver: no samples within desired window for channel 9816
wclsFrameSaver: no samples within desired window for channel 10102
wclsFrameSaver: no samples within desired window for channel 10236
wclsFrameSaver: no samples within desired window for channel 10237
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10238
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
FrameSaver: q=1.99791e+07 n=1968207 tag=wiener
03-Feb-2026 23:50:12 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_6_1770133612_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            191.65        1203.63       14315.5       336.451       2985.3         21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           7.593e-05    0.000113971   0.00017616    0.00011327    2.52864e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer           4.189e-05    6.77047e-05   0.00025321    5.6779e-05    4.35913e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.101656      0.150924      0.440655       0.12059      0.076127        21     
produce:triggertypefilter:PDHDTriggerTypeFilter      5.079e-05    0.000100329   0.000503789    7.31e-05     0.000102887      21     
produce:tpcrawdecoder:PDHDTPCReader                   5.31312       7.68707       38.1798       6.3202        6.82771        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.00057164    0.000792923   0.00112624    0.000797598   0.00011961       21     
produce:fembfilter:PDHDFEMBFilter                    6.942e-05    0.000107871    0.0004622     8.787e-05    8.00627e-05      21     
produce:wclsdatahd:WireCellToolkit                    117.139       134.045       149.853       133.699       9.21207        21     
produce:gaushit:GausHitFinder                        0.650158       1.20325       1.96163       1.18581      0.341894        21     
produce:reco3d:SpacePointSolver                       1.64498       18.0397       125.441       4.35114       32.4633        21     
produce:hitpdune:DisambigFromSpacePoints             0.792603       3.42457       10.2169       3.05113       2.68442        21     
produce:nhitsfilter:NumberOfHitsFilter              0.00033799    0.000508336   0.000726729   0.000486349   0.000107465      21     
produce:pandora:StandardPandora                       34.961        1012.16        14112        140.863       2978.48        21     
produce:pandoraWriter:StandardPandora                 0.15405      0.277058      0.404903      0.274959      0.0722344       21     
produce:pandoraTrack:LArPandoraTrackCreation          1.40306       4.28283       7.42216       4.20761       1.77107        21     
produce:pandoraShower:LArPandoraShowerCreation        1.71368       4.48412       9.73864       3.75371       2.26548        21     
produce:pandoracalo:Calorimetry                      0.895827       2.06892       3.66625       2.1601       0.837038        21     
produce:pandoracalonosce:Calorimetry                 0.856871       2.02262       3.66315       2.19977      0.782624        21     
produce:pandorapid:Chi2ParticleID                   0.00213938    0.00289272    0.00464026    0.00275173    0.000637033      21     
produce:pandoraShowercalo:ShowerCalorimetry           1.82298       4.21621       9.0684        4.11171       1.90191        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      1.52053       3.9473        7.79722       3.60297       1.73864        21     
[art]:TriggerResults:TriggerResultInserter           2.744e-05    4.42551e-05   9.4429e-05     4.02e-05     1.59841e-05      21     
end_path:out1:RootOutput                             1.933e-05    4.14537e-05   0.000292709   2.8209e-05    5.65292e-05      21     
end_path:out1:RootOutput(write)                       4.3805        5.34844       6.30496       5.43414      0.490299        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5646.93 MB
  Peak resident set size usage (VmHWM): 3730.91 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_6_1770133612_reco.root', 'start_time': 1770133612.2148218, 'end_time': 1770159014.138444}
justIN time: 2026-02-04 07:37:50 UTC       justIN version: 01.06.00