Jobsub ID 44688.31@dunegpschedd01.fnal.gov
| Jobsub ID | 44688.31@dunegpschedd01.fnal.gov |
| Workflow ID | 2482 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-11 01:00:00 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce506 |
| Last heartbeat | 2025-09-11 03:16:38 |
| From worker node | Hostname | b9p07p6748.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-09-11 02:10:29 |
| Input files | vd-protodune:np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429.hdf5
|
| Outputting started | 2025-09-11 03:15:22 |
| Output files | |
| Finished | 2025-09-11 03:16:38 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
igproc0> EOS at call=35 anode=0
[05:12:45.799] D [ glue ] <FrameFanin:nfsp> EOS at call=35 with 8
[05:12:45.799] D [ glue ] frame sink sees EOS
[05:12:45.800] D [ pgraph ] <Pgrapher:> graph execution complete
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 9.55 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 8.98 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 8.79 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.54 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.17 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.15 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.96 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.68 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Aux::Resampler : 1.1 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Aux::Resampler : 0.74 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Aux::Resampler : 0.63 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Aux::Resampler : 0.63 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Gen::Retagger : 0.01 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[05:12:45.800] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[05:12:45.800] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[05:12:45.800] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[05:12:45.800] I [ timer ] Timer: Total node execution : 65.97999971732497 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 62080 traces tagged "gauss"
FrameSaver: q=1.04795e+07 n=1304610 tag=gauss
wclsFrameSaver: saving 75292 traces tagged "wiener"
FrameSaver: q=1.11227e+07 n=1254651 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 476 XUs and 685 XVs -> 18 XUVs
C:0 T:1 884 XUs and 1404 XVs -> 30 XUVs
C:0 T:2 77 XUs and 105 XVs -> 1 XUVs
C:0 T:3 1696 XUs and 1910 XVs -> 47 XUVs
C:0 T:4 1858 XUs and 2054 XVs -> 103 XUVs
C:0 T:5 1102 XUs and 760 XVs -> 29 XUVs
C:0 T:6 1968 XUs and 1789 XVs -> 120 XUVs
C:0 T:7 871 XUs and 737 XVs -> 77 XUVs
C:0 T:8 8043 XUs and 7689 XVs -> 1278 XUVs
C:0 T:9 5345 XUs and 5484 XVs -> 642 XUVs
C:0 T:10 5213 XUs and 8183 XVs -> 826 XUVs
C:0 T:11 11455 XUs and 27287 XVs -> 2823 XUVs
C:0 T:12 15558 XUs and 30765 XVs -> 4856 XUVs
C:0 T:13 4453 XUs and 6904 XVs -> 670 XUVs
C:0 T:14 1002 XUs and 855 XVs -> 49 XUVs
C:0 T:15 3043 XUs and 5253 XVs -> 576 XUVs
12145 XUVs total
2100 collection wire objects
12145 potential space points
Neighbour search...
1512961 tests to find 631994 neighbours
Iterating with no regularization...
Begin: 4.91545e+08
0 4.51269e+08
1 4.494e+08
2 4.49039e+08
Now with regularization...
Begin: 4.40348e+08
0 4.40107e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
11-Sep-2025 05:15:12 CEST Closed output file "np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429_reco_stage1_20250911T031512_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 125.063 213.49 434.5 196.373 72.6333 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.44e-05 0.0001319 0.000352783 0.000116991 7.64892e-05 18
produce:tpcrawdecoder:PDVDTPCReader 5.99915 7.13055 10.5867 6.89914 0.928086 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.00117529 0.00254724 0.00908703 0.00156278 0.00219341 18
produce:pdvddaphne:DAPHNEReaderPDVD 3.3451 4.23558 4.68623 4.24665 0.320321 18
produce:ophit:OpHitFinder 0.0341756 0.0507337 0.0621568 0.0518419 0.00651212 18
produce:opflash:OpFlashFinderVerticalDrift 0.00723915 0.0164697 0.0237278 0.0168456 0.00502121 18
produce:wclsdatavd:WireCellToolkit 62.6396 75.5653 93.1258 75.3707 9.11766 18
produce:gaushit:GausHitFinder 0.796418 1.50958 2.32197 1.55037 0.414749 18
produce:nhitsfilter:NumberOfHitsFilter 0.000240493 0.000374828 0.000676047 0.000370483 9.87336e-05 18
produce:reco3d:SpacePointSolver 11.5217 19.8652 28.6586 20.1021 5.12521 18
produce:hitpdune:DisambigFromSpacePoints 0.163924 0.34076 0.544558 0.363235 0.11346 18
produce:pandora:StandardPandora 31.5816 97.7716 302.957 78.3374 62.1457 18
produce:pandoraTrack:LArPandoraTrackCreation 0.652105 1.44038 2.456 1.42203 0.535476 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0184294 0.036403 0.0635071 0.0361426 0.0133945 18
[art]:TriggerResults:TriggerResultInserter 1.718e-05 3.04369e-05 0.000124871 2.4425e-05 2.35009e-05 18
end_path:out1:RootOutput 4.9e-06 9.20944e-06 4.034e-05 7.68e-06 7.62647e-06 18
end_path:out1:RootOutput(write) 4.43893 5.48086 6.8361 5.28682 0.827862 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5792.39 MB
Peak resident set size usage (VmHWM): 3853.16 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429_reco_stage1_20250911T031512_keepup.root
\tHists: np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429_reco_stage1_20250911T031512_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429_reco_stage1_20250911T031512_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429_reco_stage1_20250911T031512_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757560513.0,
"core.end_time": 1757560513.0,
"core.events": [
417242,
417262,
417282,
417302,
417322,
417342,
417362,
417382,
417402,
417422,
417442,
417462,
417482,
417502,
417522,
417542,
417562,
417582
],
"core.event_count": 18,
"core.first_event_number": 417242,
"core.last_event_number": 417582,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429_reco_stage1_20250911T031512_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757560513.0,
"core.end_time": 1757560513.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1159_df-s03-d3_dw_0_20250830T225429.hdf5"
}
]
} 