justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269049.113@dunegpschedd01.fnal.gov

Jobsub ID269049.113@dunegpschedd01.fnal.gov
Workflow ID11251
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-18 15:20:56
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce515
Last heartbeat2025-12-18 16:22:31
From worker nodeHostnameb9p10p3260.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-18 15:45:21
Input filesvd-protodune-top:3430_26_b_pvdt.test
JobscriptExit code0
Real time34m (2099s)
CPU time33m (1998s = 95%)
Max RSS bytes3682480128 (3511 MiB)
Outputting started2025-12-18 16:20:21
Output filesvd-protodune-det-reco:3430_26_b_pvdt_reco_stage1_20251218T162005_reco.root
Finished2025-12-18 16:22:31
Saved logsjustin-logs:269049.113-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

] <OmnibusNoiseFilter:nf4> EOS at call=59 
[17:19:51.563] D [sigproc ] <OmnibusSigProc:anode4sigproc4> EOS at call=59 anode=4 
[17:19:51.564] D [  glue  ] <ChannelSelector:chsel3> see EOS at call=29 
[17:19:51.564] D [  aux   ] <Resampler:resmp3> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusNoiseFilter:nf3> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusSigProc:anode3sigproc3> EOS at call=59 anode=3 
[17:19:51.564] D [  glue  ] <ChannelSelector:chsel2> see EOS at call=29 
[17:19:51.564] D [  aux   ] <Resampler:resmp2> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusNoiseFilter:nf2> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusSigProc:anode2sigproc2> EOS at call=59 anode=2 
[17:19:51.564] D [  glue  ] <ChannelSelector:chsel1> see EOS at call=29 
[17:19:51.564] D [  aux   ] <Resampler:resmp1> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusNoiseFilter:nf1> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusSigProc:anode1sigproc1> EOS at call=59 anode=1 
[17:19:51.564] D [  glue  ] <ChannelSelector:chsel0> see EOS at call=29 
[17:19:51.564] D [  aux   ] <Resampler:resmp0> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusNoiseFilter:nf0> EOS at call=59 
[17:19:51.564] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=59 anode=0 
[17:19:51.565] D [  glue  ] <FrameFanin:nfsp> EOS at call=59 with 8 
[17:19:51.565] D [  glue  ] frame sink sees EOS
[17:19:51.565] D [ pgraph ] <Pgrapher:> graph execution complete 
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 17.72 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.87 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.62 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.5 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 2.63 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 2.61 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 2.59 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 2.59 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.5 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.48 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.48 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.47 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Gen::Retagger : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0 sec
[17:19:51.565] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[17:19:51.565] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[17:19:51.565] I [ timer  ] Timer: Total node execution : 56.06999889947474 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 6144 traces tagged "gauss"
FrameSaver: q=7.47555e+07 n=1305300 tag=gauss
wclsFrameSaver: saving 6144 traces tagged "wiener"
FrameSaver: q=7.49284e+07 n=1293256 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4181 XUs and 7116 XVs -> 46 XUVs
C:0 T:1 1347 XUs and 2725 XVs -> 43 XUVs
C:0 T:2 41 XUs and 38 XVs -> 0 XUVs
C:0 T:3 1116 XUs and 830 XVs -> 13 XUVs
C:0 T:4 124 XUs and 161 XVs -> 3 XUVs
C:0 T:5 1053 XUs and 1053 XVs -> 28 XUVs
C:0 T:6 280 XUs and 219 XVs -> 12 XUVs
C:0 T:7 1797 XUs and 1275 XVs -> 14 XUVs
159 XUVs total
143 collection wire objects
159 potential space points
Neighbour search...
509 tests to find 212 neighbours
Iterating with no regularization...
Begin: 8.39577e+11
0 8.3928e+11
Now with regularization...
Begin: 8.39267e+11
0 8.39267e+11
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
18-Dec-2025 17:20:05 CET  Closed output file "3430_26_b_pvdt_reco_stage1_20251218T162005_reco.root"
DataPrepModule::endJob: # events processed: 30
DataPrepModule::endJob:   # events skipped: 0

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        38.2969       64.3374       310.176       52.8707       46.9646        30     
----------------------------------------------------------------------------------------------------------------------------------
source:VDColdboxTDERawInput(read)                5.65e-05     0.000102251   0.000169001   9.89105e-05   2.84656e-05      30     
produce:caldata:DataPrepModule                   0.142003      0.236332      0.387748      0.256268      0.055659        30     
produce:wclsdatavd:WireCellToolkit                33.5284       43.5292       69.2017       41.7743       8.14308        30     
produce:gaushit:GausHitFinder                    0.359624       1.10222       3.58598      0.761717      0.841651        30     
produce:reco3d:SpacePointSolver                   1.04023       4.71057       36.7065       3.38479       6.08665        30     
produce:hitpdune:DisambigFromSpacePoints        0.00644102     0.0501991     0.787543      0.0218506     0.137666        30     
produce:pandora:StandardPandora                   1.42079       12.2459       200.136       5.02175       35.0315        30     
produce:pandoraTrack:LArPandoraTrackCreation     0.0379797     0.147687       1.18808      0.103072      0.197729        30     
produce:pandoraGnocalo:GnocchiCalorimetry       0.00549825     0.0138127     0.0480475     0.011718     0.00778221       30     
[art]:TriggerResults:TriggerResultInserter       1.568e-05    2.66315e-05    6.791e-05     2.342e-05    9.80652e-06      30     
end_path:out1:RootOutput                         3.06e-06     6.57833e-06    3.183e-05     3.745e-06    7.27041e-06      30     
end_path:out1:RootOutput(write)                   1.67709       2.28893       4.18718       2.0302       0.547416        30     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6119.15 MB
  Peak resident set size usage (VmHWM): 3682.48 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 30
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 3 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:    vdcb_adcChannelRawRmsFiller:   0.15 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec/event
Art has completed and will exit with status 0.
Output files:
\tReco: 3430_26_b_pvdt_reco_stage1_20251218T162005_reco.root
Forming reco metadata
Successfully opened file 3430_26_b_pvdt_reco_stage1_20251218T162005_reco.root
Ran successfully
{
  "name": "3430_26_b_pvdt_reco_stage1_20251218T162005_reco.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_14_01d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "tde_reco_stage1_protodunevd_keepup.fcl",
    "dune.campaign": "vd-protodune-top-det-reco",
    "core.start_time": 1766074807.0,
    "core.end_time": 1766074807.0,
    "core.events": [
      3002,
      3006,
      3010,
      3014,
      3018,
      3022,
      3026,
      3030,
      3034,
      3038,
      3042,
      3046,
      3050,
      3054,
      3058,
      3062,
      3066,
      3070,
      3074,
      3078,
      3082,
      3086,
      3090,
      3094,
      3098,
      3102,
      3106,
      3110,
      3114,
      3118
    ],
    "core.event_count": 30,
    "core.first_event_number": 3002,
    "core.last_event_number": 3118,
    "core.data_stream": "cosmics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune-top",
    "core.runs": [
      3430
    ],
    "core.runs_subruns": [
      343000026
    ],
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune-top:3430_26_b_pvdt.test"
    }
  ]
}
justIN time: 2025-12-20 13:43:53 UTC       justIN version: 01.05.03