Jobsub ID 46236.78@dunegpschedd01.fnal.gov
| Jobsub ID | 46236.78@dunegpschedd01.fnal.gov |
| Workflow ID | 2579 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-14 15:49:36 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2025-09-14 16:46:49 |
| From worker node | Hostname | b9p12p4372.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-14 15:51:00 |
| Input files | vd-protodune:np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710.hdf5
|
| Outputting started | 2025-09-14 16:46:49 |
| Output files | |
| Finished | 2025-09-14 17:47:56 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
rameSaver: no samples within desired window for channel 10079
wclsFrameSaver: no samples within desired window for channel 10120
wclsFrameSaver: no samples within desired window for channel 10125
wclsFrameSaver: no samples within desired window for channel 10127
wclsFrameSaver: no samples within desired window for channel 10303
wclsFrameSaver: no samples within desired window for channel 10431
wclsFrameSaver: no samples within desired window for channel 10569
wclsFrameSaver: no samples within desired window for channel 10610
wclsFrameSaver: no samples within desired window for channel 10895
wclsFrameSaver: no samples within desired window for channel 10895
wclsFrameSaver: no samples within desired window for channel 11027
wclsFrameSaver: no samples within desired window for channel 11085
wclsFrameSaver: no samples within desired window for channel 11087
wclsFrameSaver: no samples within desired window for channel 11630
wclsFrameSaver: no samples within desired window for channel 11631
wclsFrameSaver: no samples within desired window for channel 11632
wclsFrameSaver: no samples within desired window for channel 12004
wclsFrameSaver: no samples within desired window for channel 12004
wclsFrameSaver: no samples within desired window for channel 12004
wclsFrameSaver: no samples within desired window for channel 12006
wclsFrameSaver: no samples within desired window for channel 12006
wclsFrameSaver: no samples within desired window for channel 12007
wclsFrameSaver: no samples within desired window for channel 12007
wclsFrameSaver: no samples within desired window for channel 12018
wclsFrameSaver: no samples within desired window for channel 12018
wclsFrameSaver: no samples within desired window for channel 12019
wclsFrameSaver: no samples within desired window for channel 12020
wclsFrameSaver: no samples within desired window for channel 12021
wclsFrameSaver: no samples within desired window for channel 12022
wclsFrameSaver: no samples within desired window for channel 12146
wclsFrameSaver: no samples within desired window for channel 12176
wclsFrameSaver: no samples within desired window for channel 12176
wclsFrameSaver: no samples within desired window for channel 12176
wclsFrameSaver: no samples within desired window for channel 12247
wclsFrameSaver: no samples within desired window for channel 12248
wclsFrameSaver: no samples within desired window for channel 12249
wclsFrameSaver: no samples within desired window for channel 12249
wclsFrameSaver: no samples within desired window for channel 12252
FrameSaver: q=8.8901e+06 n=1017814 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 2263 XUs and 3012 XVs -> 115 XUVs
C:0 T:1 163 XUs and 228 XVs -> 11 XUVs
C:0 T:2 605 XUs and 524 XVs -> 33 XUVs
C:0 T:3 335 XUs and 375 XVs -> 20 XUVs
C:0 T:4 634 XUs and 575 XVs -> 36 XUVs
C:0 T:5 2212 XUs and 2432 XVs -> 103 XUVs
C:0 T:6 504 XUs and 457 XVs -> 24 XUVs
C:0 T:7 1505 XUs and 1838 XVs -> 61 XUVs
C:0 T:8 2515 XUs and 2973 XVs -> 119 XUVs
C:0 T:9 809 XUs and 1036 XVs -> 56 XUVs
C:0 T:10 712 XUs and 964 XVs -> 182 XUVs
C:0 T:11 4398 XUs and 3298 XVs -> 307 XUVs
C:0 T:12 1340 XUs and 1275 XVs -> 123 XUVs
C:0 T:13 1166 XUs and 1712 XVs -> 108 XUVs
C:0 T:14 3455 XUs and 3891 XVs -> 327 XUVs
C:0 T:15 2665 XUs and 3594 XVs -> 195 XUVs
1820 XUVs total
1353 collection wire objects
1820 potential space points
Neighbour search...
16168 tests to find 8292 neighbours
Iterating with no regularization...
Begin: 4.22183e+08
0 4.12639e+08
1 4.12255e+08
Now with regularization...
Begin: 4.00409e+08
0 4.00388e+08
14-Sep-2025 18:46:38 CEST Closed output file "np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710_reco_stage1_20250914T164638_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 54.6362 173.044 271.962 170.209 45.703 19
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.542e-05 0.000103641 0.00014311 0.00010944 2.24852e-05 19
produce:tpcrawdecoder:PDVDTPCReader 1.77047 7.94359 9.71927 7.96885 1.55873 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0066941 0.0125758 0.0472992 0.00916361 0.00915207 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.23089 2.59302 3.09352 2.54491 0.234884 19
produce:ophit:OpHitFinder 0.028927 0.0445682 0.0505869 0.0456816 0.00517774 19
produce:opflash:OpFlashFinderVerticalDrift 0.00489026 0.0106965 0.0173763 0.00965445 0.00372753 19
produce:wclsdatavd:WireCellToolkit 37.1439 70.7158 90.743 70.2199 10.8855 19
produce:gaushit:GausHitFinder 0.963862 1.63113 2.23813 1.64579 0.357547 19
produce:nhitsfilter:NumberOfHitsFilter 0.00015536 0.000350509 0.000449671 0.00039217 9.15799e-05 19
produce:reco3d:SpacePointSolver 3.16853 16.511 24.9365 17.6345 5.26391 19
produce:hitpdune:DisambigFromSpacePoints 0.0619136 0.294227 0.556705 0.310569 0.128588 19
produce:pandora:StandardPandora 5.56706 66.2684 134.616 68.5874 30.5799 19
produce:pandoraTrack:LArPandoraTrackCreation 0.158816 1.24363 2.1161 1.18366 0.481328 19
produce:pandoraGnocalo:GnocchiCalorimetry 0.00803175 0.0394291 0.0641172 0.0422153 0.0146169 19
[art]:TriggerResults:TriggerResultInserter 1.335e-05 2.69532e-05 6.354e-05 2.616e-05 1.0793e-05 19
end_path:out1:RootOutput 3.61e-06 8.78158e-06 3.127e-05 7.78e-06 5.64044e-06 19
end_path:out1:RootOutput(write) 1.66691 5.69763 7.1118 6.32 1.29091 19
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5283.83 MB
Peak resident set size usage (VmHWM): 3341.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710_reco_stage1_20250914T164638_keepup.root
\tHists: np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710_reco_stage1_20250914T164638_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710_reco_stage1_20250914T164638_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710_reco_stage1_20250914T164638_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757868399.0,
"core.end_time": 1757868399.0,
"core.events": [
440479,
440483,
440487,
440491,
440495,
440499,
440503,
440507,
440511,
440515,
440519,
440523,
440527,
440531,
440535,
440539,
440543,
440547,
440551
],
"core.event_count": 19,
"core.first_event_number": 440479,
"core.last_event_number": 440551,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39350
],
"core.runs_subruns": [
3935000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710_reco_stage1_20250914T164638_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757868399.0,
"core.end_time": 1757868399.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39350
],
"core.runs_subruns": [
3935000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039350_6033_df-s04-d3_dw_0_20250914T153710.hdf5"
}
]
} 