Jobsub ID 269103.1@dunegpschedd01.fnal.gov
| Jobsub ID | 269103.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11251 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 4 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-12-18 17:15:00 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2025-12-18 18:34:03 |
| From worker node | Hostname | tds442.pic.es |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 4 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-18 17:16:46 |
| Input files | vd-protodune-top:3430_25_b_pvdt.test
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4275s) |
| CPU time | 1h (3901s = 91%) |
| Max RSS bytes | 3891396608 (3711 MiB) |
| Outputting started | 2025-12-18 18:28:01 |
| Output files | vd-protodune-det-reco:3430_25_b_pvdt_reco_stage1_20251218T182753_reco.root
|
| Finished | 2025-12-18 18:34:03 |
| Saved logs | justin-logs:269103.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
.461] D [sigproc ] <OmnibusSigProc:anode3sigproc3> EOS at call=59 anode=3
[19:24:20.461] D [ glue ] <ChannelSelector:chsel2> see EOS at call=29
[19:24:20.461] D [ aux ] <Resampler:resmp2> EOS at call=59
[19:24:20.461] D [sigproc ] <OmnibusNoiseFilter:nf2> EOS at call=59
[19:24:20.461] D [sigproc ] <OmnibusSigProc:anode2sigproc2> EOS at call=59 anode=2
[19:24:20.461] D [ glue ] <ChannelSelector:chsel1> see EOS at call=29
[19:24:20.461] D [ aux ] <Resampler:resmp1> EOS at call=59
[19:24:20.461] D [sigproc ] <OmnibusNoiseFilter:nf1> EOS at call=59
[19:24:20.461] D [sigproc ] <OmnibusSigProc:anode1sigproc1> EOS at call=59 anode=1
[19:24:20.461] D [ glue ] <ChannelSelector:chsel0> see EOS at call=29
[19:24:20.462] D [ aux ] <Resampler:resmp0> EOS at call=59
[19:24:20.462] D [sigproc ] <OmnibusNoiseFilter:nf0> EOS at call=59
[19:24:20.462] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=59 anode=0
[19:24:20.462] D [ glue ] <FrameFanin:nfsp> EOS at call=59 with 8
[19:24:20.462] D [ glue ] frame sink sees EOS
[19:24:20.462] D [ pgraph ] <Pgrapher:> graph execution complete
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 14.64 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.52 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.31 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 10.01 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 2.06 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 1.96 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 1.95 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 1.95 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Aux::Resampler : 0.32 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Aux::Resampler : 0.31 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Aux::Resampler : 0.31 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Aux::Resampler : 0.31 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Gen::Retagger : 0.01 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[19:24:20.462] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:24:20.462] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusNoiseFilter : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0 sec
[19:24:20.462] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[19:24:20.462] I [ timer ] Timer: Total node execution : 57.680001525208354 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 6144 traces tagged "gauss"
FrameSaver: q=2.1469e+07 n=3142492 tag=gauss
wclsFrameSaver: saving 6144 traces tagged "wiener"
FrameSaver: q=2.18911e+07 n=3061913 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 54900 XUs and 105639 XVs -> 19519 XUVs
C:0 T:1 40268 XUs and 69845 XVs -> 17858 XUVs
C:0 T:2 37745 XUs and 74256 XVs -> 14730 XUVs
C:0 T:3 36018 XUs and 67809 XVs -> 13083 XUVs
C:0 T:4 20449 XUs and 40065 XVs -> 8229 XUVs
C:0 T:5 39209 XUs and 66270 XVs -> 13157 XUVs
C:0 T:6 37670 XUs and 82868 XVs -> 14276 XUVs
C:0 T:7 41619 XUs and 71946 XVs -> 10462 XUVs
111314 XUVs total
8295 collection wire objects
111314 potential space points
Neighbour search...
17596262 tests to find 7543914 neighbours
Iterating with no regularization...
Begin: 8.19317e+09
0 7.88129e+09
1 7.84066e+09
2 7.83847e+09
Now with regularization...
Begin: 7.8163e+09
0 7.81546e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
18-Dec-2025 19:27:53 CET Closed output file "3430_25_b_pvdt_reco_stage1_20251218T182753_reco.root"
DataPrepModule::endJob: # events processed: 30
DataPrepModule::endJob: # events skipped: 0
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 39.3876 129.193 597.396 61.5387 124.582 30
----------------------------------------------------------------------------------------------------------------------------------
source:VDColdboxTDERawInput(read) 4.6012e-05 8.69074e-05 0.000284477 8.0392e-05 4.40693e-05 30
produce:caldata:DataPrepModule 0.12583 0.152336 0.507527 0.139059 0.0665344 30
produce:wclsdatavd:WireCellToolkit 32.5975 47.0203 66.1215 44.1141 9.68457 30
produce:gaushit:GausHitFinder 0.431037 2.511 5.12847 2.50231 1.45035 30
produce:reco3d:SpacePointSolver 1.87301 18.7606 58.8882 4.88124 21.3798 30
produce:hitpdune:DisambigFromSpacePoints 0.0124243 0.266494 0.959097 0.0355353 0.344942 30
produce:pandora:StandardPandora 2.4191 57.2661 462.395 10.1961 96.3161 30
produce:pandoraTrack:LArPandoraTrackCreation 0.0515626 0.66401 2.81053 0.143572 0.828015 30
produce:pandoraGnocalo:GnocchiCalorimetry 0.00675705 0.0300125 0.0830503 0.0141443 0.026137 30
[art]:TriggerResults:TriggerResultInserter 1.032e-05 1.7747e-05 8.3952e-05 1.4811e-05 1.26922e-05 30
end_path:out1:RootOutput 2.89e-06 6.8652e-06 3.2451e-05 3.6905e-06 7.86996e-06 30
end_path:out1:RootOutput(write) 1.77346 2.50317 3.82874 2.13668 0.661572 30
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6319.13 MB
Peak resident set size usage (VmHWM): 3891.4 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 30
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 3 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: vdcb_adcChannelRawRmsFiller: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.00 sec/event
Art has completed and will exit with status 0.
Output files:
\tReco: 3430_25_b_pvdt_reco_stage1_20251218T182753_reco.root
Forming reco metadata
Successfully opened file 3430_25_b_pvdt_reco_stage1_20251218T182753_reco.root
Ran successfully
{
"name": "3430_25_b_pvdt_reco_stage1_20251218T182753_reco.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_14_01d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "tde_reco_stage1_protodunevd_keepup.fcl",
"dune.campaign": "vd-protodune-top-det-reco",
"core.start_time": 1766082475.0,
"core.end_time": 1766082475.0,
"core.events": [
2882,
2886,
2890,
2894,
2898,
2902,
2906,
2910,
2914,
2918,
2922,
2926,
2930,
2934,
2938,
2942,
2946,
2950,
2954,
2958,
2962,
2966,
2970,
2974,
2978,
2982,
2986,
2990,
2994,
2998
],
"core.event_count": 30,
"core.first_event_number": 2882,
"core.last_event_number": 2998,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune-top",
"core.runs": [
3430
],
"core.runs_subruns": [
343000025
],
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune-top:3430_25_b_pvdt.test"
}
]
} 