Jobsub ID 39338.164@dunegpschedd02.fnal.gov
| Jobsub ID | 39338.164@dunegpschedd02.fnal.gov |
| Workflow ID | 2575 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-13 15:40:16 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce510 |
| Last heartbeat | 2025-09-13 18:13:52 |
| From worker node | Hostname | b9p10p0963.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-13 17:12:37 |
| Input files | vd-protodune:np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320.hdf5
|
| Outputting started | 2025-09-13 18:13:52 |
| Output files | |
| Finished | 2025-09-13 18:57:41 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
amples within desired window for channel 8216
wclsFrameSaver: no samples within desired window for channel 8217
wclsFrameSaver: no samples within desired window for channel 9288
wclsFrameSaver: no samples within desired window for channel 9289
wclsFrameSaver: no samples within desired window for channel 9291
wclsFrameSaver: no samples within desired window for channel 9372
wclsFrameSaver: no samples within desired window for channel 9373
wclsFrameSaver: no samples within desired window for channel 9375
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9558
wclsFrameSaver: no samples within desired window for channel 9617
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9801
wclsFrameSaver: no samples within desired window for channel 9980
wclsFrameSaver: no samples within desired window for channel 10272
wclsFrameSaver: no samples within desired window for channel 10273
wclsFrameSaver: no samples within desired window for channel 10274
wclsFrameSaver: no samples within desired window for channel 10294
wclsFrameSaver: no samples within desired window for channel 10476
wclsFrameSaver: no samples within desired window for channel 10534
wclsFrameSaver: no samples within desired window for channel 10535
wclsFrameSaver: no samples within desired window for channel 10612
wclsFrameSaver: no samples within desired window for channel 10721
wclsFrameSaver: no samples within desired window for channel 10723
wclsFrameSaver: no samples within desired window for channel 10724
wclsFrameSaver: no samples within desired window for channel 10725
wclsFrameSaver: no samples within desired window for channel 10872
wclsFrameSaver: no samples within desired window for channel 11344
wclsFrameSaver: no samples within desired window for channel 11344
wclsFrameSaver: no samples within desired window for channel 11344
wclsFrameSaver: no samples within desired window for channel 11346
wclsFrameSaver: no samples within desired window for channel 11346
wclsFrameSaver: no samples within desired window for channel 11346
wclsFrameSaver: no samples within desired window for channel 11830
wclsFrameSaver: no samples within desired window for channel 11831
wclsFrameSaver: no samples within desired window for channel 11832
wclsFrameSaver: no samples within desired window for channel 11833
wclsFrameSaver: no samples within desired window for channel 11833
wclsFrameSaver: no samples within desired window for channel 11834
FrameSaver: q=5.29023e+06 n=659689 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 528 XUs and 582 XVs -> 37 XUVs
C:0 T:1 1065 XUs and 1149 XVs -> 71 XUVs
C:0 T:2 1161 XUs and 1018 XVs -> 71 XUVs
C:0 T:3 605 XUs and 320 XVs -> 27 XUVs
C:0 T:4 61 XUs and 108 XVs -> 4 XUVs
C:0 T:5 187 XUs and 332 XVs -> 8 XUVs
C:0 T:6 994 XUs and 1349 XVs -> 61 XUVs
C:0 T:7 311 XUs and 390 XVs -> 16 XUVs
C:0 T:8 1087 XUs and 1387 XVs -> 63 XUVs
C:0 T:9 486 XUs and 467 XVs -> 30 XUVs
C:0 T:10 734 XUs and 747 XVs -> 58 XUVs
C:0 T:11 318 XUs and 465 XVs -> 22 XUVs
C:0 T:12 3993 XUs and 4501 XVs -> 156 XUVs
C:0 T:13 417 XUs and 491 XVs -> 44 XUVs
C:0 T:14 1673 XUs and 1836 XVs -> 126 XUVs
C:0 T:15 52 XUs and 88 XVs -> 5 XUVs
799 XUVs total
723 collection wire objects
799 potential space points
Neighbour search...
4185 tests to find 1922 neighbours
Iterating with no regularization...
Begin: 2.81997e+08
0 2.79428e+08
1 2.79424e+08
Now with regularization...
Begin: 2.76624e+08
0 2.76624e+08
13-Sep-2025 20:13:37 CEST Closed output file "np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320_reco_stage1_20250913T181337_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 120.886 200.822 309.981 191.469 49.3892 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.247e-05 0.000135016 0.000408544 0.000116881 7.61779e-05 18
produce:tpcrawdecoder:PDVDTPCReader 6.54837 7.20093 8.07212 7.14552 0.490616 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.00108797 0.00221035 0.0100491 0.00145797 0.00206567 18
produce:pdvddaphne:DAPHNEReaderPDVD 4.09747 4.79222 6.12801 4.76401 0.460288 18
produce:ophit:OpHitFinder 0.051157 0.0638338 0.0755113 0.0641367 0.00717449 18
produce:opflash:OpFlashFinderVerticalDrift 0.0078938 0.0149868 0.0223279 0.0153569 0.00390822 18
produce:wclsdatavd:WireCellToolkit 62.5961 76.7603 92.6361 76.2668 7.85525 18
produce:gaushit:GausHitFinder 0.964074 1.45409 2.07004 1.38807 0.365252 18
produce:nhitsfilter:NumberOfHitsFilter 0.000237292 0.000369249 0.000713986 0.000365088 0.000107178 18
produce:reco3d:SpacePointSolver 8.16589 18.2411 26.4128 18.149 5.50421 18
produce:hitpdune:DisambigFromSpacePoints 0.0803239 0.322013 0.52037 0.318857 0.127245 18
produce:pandora:StandardPandora 20.4667 81.354 168.293 74.5768 40.7502 18
produce:pandoraTrack:LArPandoraTrackCreation 0.352144 1.37565 2.41212 1.2346 0.556814 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0162558 0.0393711 0.0572275 0.0399584 0.012095 18
[art]:TriggerResults:TriggerResultInserter 1.846e-05 2.90931e-05 7.7971e-05 2.6875e-05 1.27163e-05 18
end_path:out1:RootOutput 4.73e-06 8.33506e-06 2.19e-05 7.87e-06 3.50206e-06 18
end_path:out1:RootOutput(write) 7.09621 9.1581 14.1224 8.72923 1.74137 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5102.49 MB
Peak resident set size usage (VmHWM): 3161.09 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320_reco_stage1_20250913T181337_keepup.root
\tHists: np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320_reco_stage1_20250913T181339_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320_reco_stage1_20250913T181337_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320_reco_stage1_20250913T181337_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757787219.0,
"core.end_time": 1757787219.0,
"core.events": [
613442,
613462,
613482,
613502,
613522,
613542,
613562,
613582,
613602,
613622,
613642,
613662,
613682,
613702,
613722,
613742,
613762,
613782
],
"core.event_count": 18,
"core.first_event_number": 613442,
"core.last_event_number": 613782,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39273
],
"core.runs_subruns": [
3927300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320_reco_stage1_20250913T181339_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757787219.0,
"core.end_time": 1757787219.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39273
],
"core.runs_subruns": [
3927300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039273_1704_df-s02-d0_dw_0_20250901T122320.hdf5"
}
]
} 