Jobsub ID 38121.175@dunegpschedd02.fnal.gov
| Jobsub ID | 38121.175@dunegpschedd02.fnal.gov |
| Workflow ID | 2496 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-11 10:02:32 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce508 |
| Last heartbeat | 2025-09-11 12:06:15 |
| From worker node | Hostname | b9p06p9894.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-11 10:56:09 |
| Input files | vd-protodune:np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734.hdf5
|
| Outputting started | 2025-09-11 12:04:07 |
| Output files | |
| Finished | 2025-09-11 12:26:56 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
indow for channel 10264
wclsFrameSaver: no samples within desired window for channel 10265
wclsFrameSaver: no samples within desired window for channel 10265
wclsFrameSaver: no samples within desired window for channel 10266
wclsFrameSaver: no samples within desired window for channel 10266
wclsFrameSaver: no samples within desired window for channel 10267
wclsFrameSaver: no samples within desired window for channel 10267
wclsFrameSaver: no samples within desired window for channel 10267
wclsFrameSaver: no samples within desired window for channel 10268
wclsFrameSaver: no samples within desired window for channel 10269
wclsFrameSaver: no samples within desired window for channel 10270
wclsFrameSaver: no samples within desired window for channel 10322
wclsFrameSaver: no samples within desired window for channel 10333
wclsFrameSaver: no samples within desired window for channel 10974
wclsFrameSaver: no samples within desired window for channel 10980
wclsFrameSaver: no samples within desired window for channel 10983
wclsFrameSaver: no samples within desired window for channel 11282
wclsFrameSaver: no samples within desired window for channel 11283
wclsFrameSaver: no samples within desired window for channel 11283
wclsFrameSaver: no samples within desired window for channel 11284
wclsFrameSaver: no samples within desired window for channel 11285
wclsFrameSaver: no samples within desired window for channel 11291
wclsFrameSaver: no samples within desired window for channel 11293
wclsFrameSaver: no samples within desired window for channel 11340
wclsFrameSaver: no samples within desired window for channel 11442
wclsFrameSaver: no samples within desired window for channel 11736
wclsFrameSaver: no samples within desired window for channel 11737
wclsFrameSaver: no samples within desired window for channel 11738
wclsFrameSaver: no samples within desired window for channel 11739
wclsFrameSaver: no samples within desired window for channel 11740
wclsFrameSaver: no samples within desired window for channel 11741
wclsFrameSaver: no samples within desired window for channel 11741
wclsFrameSaver: no samples within desired window for channel 12147
wclsFrameSaver: no samples within desired window for channel 12147
wclsFrameSaver: no samples within desired window for channel 12148
wclsFrameSaver: no samples within desired window for channel 12148
wclsFrameSaver: no samples within desired window for channel 12149
wclsFrameSaver: no samples within desired window for channel 12149
FrameSaver: q=1.13546e+07 n=1179249 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 149 XUs and 131 XVs -> 7 XUVs
C:0 T:1 1219 XUs and 1195 XVs -> 60 XUVs
C:0 T:2 792 XUs and 1015 XVs -> 47 XUVs
C:0 T:3 2443 XUs and 2468 XVs -> 87 XUVs
C:0 T:4 318 XUs and 357 XVs -> 28 XUVs
C:0 T:5 673 XUs and 681 XVs -> 24 XUVs
C:0 T:6 257 XUs and 223 XVs -> 8 XUVs
C:0 T:7 658 XUs and 608 XVs -> 50 XUVs
C:0 T:8 11548 XUs and 18093 XVs -> 3568 XUVs
C:0 T:9 10827 XUs and 13640 XVs -> 2076 XUVs
C:0 T:10 15001 XUs and 29212 XVs -> 5221 XUVs
C:0 T:11 9129 XUs and 25109 XVs -> 3629 XUVs
C:0 T:12 15052 XUs and 31168 XVs -> 3757 XUVs
C:0 T:13 1531 XUs and 2743 XVs -> 321 XUVs
C:0 T:14 3193 XUs and 8620 XVs -> 799 XUVs
C:0 T:15 8610 XUs and 17181 XVs -> 1910 XUVs
21592 XUVs total
2934 collection wire objects
21592 potential space points
Neighbour search...
2756288 tests to find 1170004 neighbours
Iterating with no regularization...
Begin: 4.52082e+08
0 3.81799e+08
1 3.77343e+08
2 3.76449e+08
3 3.76111e+08
Now with regularization...
Begin: 3.61671e+08
0 3.61345e+08
11-Sep-2025 14:03:53 CEST Closed output file "np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734_reco_stage1_20250911T120353_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 129.212 223.374 364.013 211.981 66.6109 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.9731e-05 0.000110478 0.000164313 0.000109052 3.22199e-05 18
produce:tpcrawdecoder:PDVDTPCReader 5.88369 10.9599 86.6075 6.57841 18.3487 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.001169 0.0243735 0.401427 0.00147095 0.091463 18
produce:pdvddaphne:DAPHNEReaderPDVD 2.92463 4.41599 6.22332 4.25236 0.684159 18
produce:ophit:OpHitFinder 0.0375579 0.0513193 0.0598261 0.0528204 0.00577438 18
produce:opflash:OpFlashFinderVerticalDrift 0.00932595 0.0176586 0.0281201 0.0169216 0.00455867 18
produce:wclsdatavd:WireCellToolkit 60.7476 74.956 102.392 74.9931 9.95676 18
produce:gaushit:GausHitFinder 0.838359 1.70599 2.24849 1.79238 0.45953 18
produce:nhitsfilter:NumberOfHitsFilter 0.000212454 0.000455181 0.00121891 0.000421553 0.000218093 18
produce:reco3d:SpacePointSolver 8.86019 21.4616 31.6178 23.0853 6.39731 18
produce:hitpdune:DisambigFromSpacePoints 0.163913 0.385781 0.678464 0.377877 0.132763 18
produce:pandora:StandardPandora 30.7243 101.524 233.15 89.6281 50.146 18
produce:pandoraTrack:LArPandoraTrackCreation 0.671199 1.67271 2.96705 1.55124 0.67577 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0219761 0.0460272 0.0624115 0.05098 0.0117746 18
[art]:TriggerResults:TriggerResultInserter 2.103e-05 3.47256e-05 7.1731e-05 3.1381e-05 1.20605e-05 18
end_path:out1:RootOutput 5.01e-06 1.11762e-05 3.6031e-05 8.515e-06 8.42852e-06 18
end_path:out1:RootOutput(write) 4.39725 6.10397 7.43965 6.56718 0.915372 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5159.84 MB
Peak resident set size usage (VmHWM): 3232.22 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734_reco_stage1_20250911T120353_keepup.root
\tHists: np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734_reco_stage1_20250911T120353_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734_reco_stage1_20250911T120353_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734_reco_stage1_20250911T120353_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757592234.0,
"core.end_time": 1757592234.0,
"core.events": [
113047,
113067,
113087,
113107,
113127,
113147,
113167,
113187,
113207,
113227,
113247,
113267,
113287,
113307,
113327,
113347,
113367,
113387
],
"core.event_count": 18,
"core.first_event_number": 113047,
"core.last_event_number": 113387,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39273
],
"core.runs_subruns": [
3927300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734_reco_stage1_20250911T120353_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757592234.0,
"core.end_time": 1757592234.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39273
],
"core.runs_subruns": [
3927300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039273_0314_df-s03-d1_dw_0_20250831T133734.hdf5"
}
]
} 