justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297754.78@dunegpschedd02.fnal.gov

Jobsub ID297754.78@dunegpschedd02.fnal.gov
Workflow ID12687
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-03 15:44:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce515
Last heartbeat2026-02-04 02:22:18
From worker nodeHostnameb9p12p0201.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 15:50:36
Input fileshd-protodune:np04hd_raw_run029917_0063_dataflow1_datawriter_0_20241011T164425.hdf5
JobscriptExit code0
Real time10h (37835s)
CPU time10h (36950s = 97%)
Max RSS bytes3519471616 (3356 MiB)
Outputting started2026-02-04 02:21:12
Output filesusertests:proc_bsmtrigger_protodunehd_1_297754_78_1770133847_reco.root
Finished2026-02-04 02:22:18
Saved logsjustin-logs:297754.78-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9719
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9752
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9754
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9755
wclsFrameSaver: no samples within desired window for channel 9759
wclsFrameSaver: no samples within desired window for channel 9878
wclsFrameSaver: no samples within desired window for channel 10051
wclsFrameSaver: no samples within desired window for channel 10053
wclsFrameSaver: no samples within desired window for channel 10057
wclsFrameSaver: no samples within desired window for channel 10171
wclsFrameSaver: no samples within desired window for channel 10172
wclsFrameSaver: no samples within desired window for channel 10173
wclsFrameSaver: no samples within desired window for channel 10173
wclsFrameSaver: no samples within desired window for channel 10174
wclsFrameSaver: no samples within desired window for channel 10174
wclsFrameSaver: no samples within desired window for channel 10175
wclsFrameSaver: no samples within desired window for channel 10175
wclsFrameSaver: no samples within desired window for channel 10176
wclsFrameSaver: no samples within desired window for channel 10177
FrameSaver: q=3.95705e+06 n=1594406 tag=wiener
04-Feb-2026 03:21:07 CET  Closed output file "proc_bsmtrigger_protodunehd_1_297754_78_1770133847_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            154.217       1886.66       28542.3       349.691       6126.47        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                           5.047e-05    9.03933e-05   0.000174601    7.528e-05    3.73863e-05      20     
produce:spillflag:PDHDSPSSpillFlagProducer           3.285e-05    6.04201e-05   0.00022363    5.52005e-05   4.01283e-05      20     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0894293     0.150193      0.514382      0.133461      0.0866866       20     
produce:triggertypefilter:PDHDTriggerTypeFilter      3.671e-05    7.33712e-05   0.000425031    5.625e-05    8.17622e-05      20     
produce:tpcrawdecoder:PDHDTPCReader                   4.16715       5.61693       7.24704       5.58296      0.711162        20     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000473551   0.00104123    0.00677717    0.000728947   0.00132833       20     
produce:fembfilter:PDHDFEMBFilter                    5.479e-05    9.50296e-05   0.000360951   7.9245e-05    6.37497e-05      20     
produce:wclsdatahd:WireCellToolkit                    95.522        110.443       158.507       100.762       16.882         20     
produce:gaushit:GausHitFinder                        0.685185       1.05721       1.68196      0.971112      0.267465        20     
produce:reco3d:SpacePointSolver                       0.90948       19.5429       111.667       5.63684       30.1498        20     
produce:hitpdune:DisambigFromSpacePoints             0.838479       2.87431       7.86536       3.12358       1.58786        20     
produce:nhitsfilter:NumberOfHitsFilter              0.000310891   0.000492544   0.000732353   0.000484827   0.000104982      20     
produce:pandora:StandardPandora                       29.1378       1718.19       28316.6       193.375       6112.18        20     
produce:pandoraWriter:StandardPandora                0.161255      0.264525      0.414477      0.268534      0.0665352       20     
produce:pandoraTrack:LArPandoraTrackCreation          2.25954       5.13563       11.2595       4.25219       2.59193        20     
produce:pandoraShower:LArPandoraShowerCreation        2.21641       4.67081       10.1603       4.02317       1.99115        20     
produce:pandoracalo:Calorimetry                       1.19995       2.46482       5.06822       2.08805       1.15487        20     
produce:pandoracalonosce:Calorimetry                  1.18496       2.41262       4.81309       1.98429       1.08342        20     
produce:pandorapid:Chi2ParticleID                   0.00174651    0.00294148    0.00529307    0.00277153    0.000845525      20     
produce:pandoraShowercalo:ShowerCalorimetry           2.47137       4.48343       8.00867       4.22449       1.51688        20     
produce:pandoraShowercalonosce:ShowerCalorimetry      2.43513       4.57634       9.01245       4.15828       1.76186        20     
[art]:TriggerResults:TriggerResultInserter           2.248e-05    3.71661e-05   0.00013103    3.02005e-05   2.31208e-05      20     
end_path:out1:RootOutput                            2.0821e-05    5.05427e-05   0.000395431   2.7995e-05    7.99437e-05      20     
end_path:out1:RootOutput(write)                       3.67277       4.50644       6.89432       4.40397      0.718494        20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5603.92 MB
  Peak resident set size usage (VmHWM): 3519.47 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_297754_78_1770133847_reco.root', 'start_time': 1770133847.7191625, 'end_time': 1770171668.0991356}
justIN time: 2026-02-04 07:06:25 UTC       justIN version: 01.06.00