justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255286.1@dunegpschedd01.fnal.gov

Jobsub ID255286.1@dunegpschedd01.fnal.gov
Workflow ID10454
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 10:41:30
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce508
Last heartbeat2025-11-23 03:47:14
From worker nodeHostnameb9p10p5491.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 10:42:52
Input fileshd-protodune:np04hd_raw_run029917_0148_dataflow0_datawriter_0_20241011T181642.hdf5
JobscriptExit code0
Real time17h (61424s)
CPU time16h (60193s = 97%)
Max RSS bytes3734994944 (3561 MiB)
Outputting started2025-11-23 03:46:37
Output files
Finished2025-11-23 03:47:14
Saved logsjustin-logs:255286.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

mples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9580
wclsFrameSaver: no samples within desired window for channel 9581
wclsFrameSaver: no samples within desired window for channel 9581
wclsFrameSaver: no samples within desired window for channel 9582
wclsFrameSaver: no samples within desired window for channel 9582
wclsFrameSaver: no samples within desired window for channel 9583
wclsFrameSaver: no samples within desired window for channel 9583
wclsFrameSaver: no samples within desired window for channel 9584
wclsFrameSaver: no samples within desired window for channel 9584
wclsFrameSaver: no samples within desired window for channel 9584
wclsFrameSaver: no samples within desired window for channel 9584
wclsFrameSaver: no samples within desired window for channel 9585
wclsFrameSaver: no samples within desired window for channel 9585
wclsFrameSaver: no samples within desired window for channel 9585
wclsFrameSaver: no samples within desired window for channel 9585
wclsFrameSaver: no samples within desired window for channel 9586
wclsFrameSaver: no samples within desired window for channel 9586
wclsFrameSaver: no samples within desired window for channel 9587
wclsFrameSaver: no samples within desired window for channel 9587
wclsFrameSaver: no samples within desired window for channel 9588
wclsFrameSaver: no samples within desired window for channel 9588
wclsFrameSaver: no samples within desired window for channel 9588
wclsFrameSaver: no samples within desired window for channel 9589
wclsFrameSaver: no samples within desired window for channel 9589
wclsFrameSaver: no samples within desired window for channel 9589
wclsFrameSaver: no samples within desired window for channel 9590
wclsFrameSaver: no samples within desired window for channel 9590
wclsFrameSaver: no samples within desired window for channel 9591
wclsFrameSaver: no samples within desired window for channel 9591
wclsFrameSaver: no samples within desired window for channel 9591
wclsFrameSaver: no samples within desired window for channel 9591
wclsFrameSaver: no samples within desired window for channel 9592
wclsFrameSaver: no samples within desired window for channel 9592
wclsFrameSaver: no samples within desired window for channel 9592
wclsFrameSaver: no samples within desired window for channel 9593
wclsFrameSaver: no samples within desired window for channel 9593
wclsFrameSaver: no samples within desired window for channel 9593
wclsFrameSaver: no samples within desired window for channel 9594
wclsFrameSaver: no samples within desired window for channel 9594
wclsFrameSaver: no samples within desired window for channel 9595
wclsFrameSaver: no samples within desired window for channel 9596
wclsFrameSaver: no samples within desired window for channel 9596
wclsFrameSaver: no samples within desired window for channel 9596
wclsFrameSaver: no samples within desired window for channel 9596
wclsFrameSaver: no samples within desired window for channel 9597
wclsFrameSaver: no samples within desired window for channel 9597
wclsFrameSaver: no samples within desired window for channel 9597
wclsFrameSaver: no samples within desired window for channel 9597
wclsFrameSaver: no samples within desired window for channel 9598
wclsFrameSaver: no samples within desired window for channel 9598
wclsFrameSaver: no samples within desired window for channel 9598
wclsFrameSaver: no samples within desired window for channel 9598
wclsFrameSaver: no samples within desired window for channel 9598
wclsFrameSaver: no samples within desired window for channel 9599
wclsFrameSaver: no samples within desired window for channel 9599
wclsFrameSaver: no samples within desired window for channel 9600
wclsFrameSaver: no samples within desired window for channel 9600
wclsFrameSaver: no samples within desired window for channel 9601
wclsFrameSaver: no samples within desired window for channel 9602
wclsFrameSaver: no samples within desired window for channel 9602
wclsFrameSaver: no samples within desired window for channel 9602
wclsFrameSaver: no samples within desired window for channel 9603
wclsFrameSaver: no samples within desired window for channel 9604
wclsFrameSaver: no samples within desired window for channel 9615
wclsFrameSaver: no samples within desired window for channel 9618
wclsFrameSaver: no samples within desired window for channel 9635
wclsFrameSaver: no samples within desired window for channel 9650
wclsFrameSaver: no samples within desired window for channel 9657
wclsFrameSaver: no samples within desired window for channel 9661
wclsFrameSaver: no samples within desired window for channel 9663
wclsFrameSaver: no samples within desired window for channel 9675
wclsFrameSaver: no samples within desired window for channel 9679
wclsFrameSaver: no samples within desired window for channel 9680
wclsFrameSaver: no samples within desired window for channel 9681
wclsFrameSaver: no samples within desired window for channel 9694
wclsFrameSaver: no samples within desired window for channel 9698
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9776
FrameSaver: q=4.21432e+06 n=1898251 tag=wiener
23-Nov-2025 04:46:30 CET  Closed output file "proc_bsmtrigger_protodunehd_1_255286_1_1763808192_reco.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            170.501       2918.79       43664.1       290.217       9439.61        21     
--------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                          4.9541e-05    0.000101591   0.000301833   8.9011e-05    5.53471e-05      21     
produce:spillflag:PDHDSPSSpillFlagProducer           2.926e-05    6.85472e-05   0.000355564    4.451e-05    6.80794e-05      21     
produce:triggerrawdecoder:PDHDTriggerReader3         0.0543095      0.17651       1.13111      0.129414      0.216715        21     
produce:triggertypefilter:PDHDTriggerTypeFilter      2.968e-05    6.84423e-05   0.000363014    4.947e-05    6.74389e-05      21     
produce:tpcrawdecoder:PDHDTPCReader                   4.36878       5.55146       8.05211       5.54269      0.681938        21     
produce:timingrawdecoder:PDHDTimingRawDecoder       0.000486575   0.000819828   0.00100881    0.000879268   0.000139535      21     
produce:fembfilter:PDHDFEMBFilter                   6.2161e-05    9.78839e-05   0.000422394   8.1671e-05    7.33922e-05      21     
produce:wclsdatahd:WireCellToolkit                    95.4969       125.333       153.006       127.47        20.3128        21     
produce:gaushit:GausHitFinder                        0.706275       1.37462       2.44316       1.41915      0.439789        21     
produce:reco3d:SpacePointSolver                       1.11175       15.1455       144.467       5.14581       31.2794        21     
produce:hitpdune:DisambigFromSpacePoints              1.01888       3.43943       17.5796       2.42327       3.66726        21     
produce:nhitsfilter:NumberOfHitsFilter              0.000336563   0.000515725   0.000856789   0.000484195   0.000129934      21     
produce:pandora:StandardPandora                       41.9656       2734.31       43368.6       115.387       9406.31        21     
produce:pandoraWriter:StandardPandora                0.147199      0.311877       0.72665       0.26599      0.146873        21     
produce:pandoraTrack:LArPandoraTrackCreation          2.12865       6.06643       29.4891       5.00033       5.51375        21     
produce:pandoraShower:LArPandoraShowerCreation        2.47863       5.59011       18.1848       4.46425       3.40872        21     
produce:pandoracalo:Calorimetry                       1.0524        2.75152       10.9491       2.45714       1.99169        21     
produce:pandoracalonosce:Calorimetry                  1.06386       2.80877       12.0503       2.1935        2.23726        21     
produce:pandorapid:Chi2ParticleID                   0.00194215    0.00354941    0.00883699    0.00319157    0.00148971       21     
produce:pandoraShowercalo:ShowerCalorimetry           2.26709       5.26139       16.7028       4.73029       2.92058        21     
produce:pandoraShowercalonosce:ShowerCalorimetry      2.33725       5.21543       16.0048       4.73833       2.76995        21     
[art]:TriggerResults:TriggerResultInserter          2.2891e-05    3.83577e-05    8.57e-05      3.477e-05    1.44115e-05      21     
end_path:out1:RootOutput                             1.561e-05    3.52228e-05   0.000262672   2.2271e-05    5.11736e-05      21     
end_path:out1:RootOutput(write)                       3.92382       5.20157       8.2366        5.10724       1.11306        21     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5655.35 MB
  Peak resident set size usage (VmHWM): 3734.99 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'proc_bsmtrigger_protodunehd_1_255286_1_1763808192_reco.root', 'start_time': 1763808192.515454, 'end_time': 1763869591.6650455}
justIN time: 2026-02-09 00:35:00 UTC       justIN version: 01.06.00