Jobsub ID 47593.12@dunegpschedd01.fnal.gov
| Jobsub ID | 47593.12@dunegpschedd01.fnal.gov |
| Workflow ID | 2815 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-17 14:47:21 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce1 |
| Last heartbeat | 2025-09-17 17:12:31 |
| From worker node | Hostname | mahagon01.farm.particle.cz |
| cpuinfo | AMD EPYC 7301 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-17 14:52:22 |
| Input files | vd-protodune:np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241.hdf5
|
| Outputting started | 2025-09-17 16:29:25 |
| Output files | |
| Finished | 2025-09-17 18:10:49 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
channel 10440
wclsFrameSaver: no samples within desired window for channel 10440
wclsFrameSaver: no samples within desired window for channel 10441
wclsFrameSaver: no samples within desired window for channel 10443
wclsFrameSaver: no samples within desired window for channel 10455
wclsFrameSaver: no samples within desired window for channel 10635
wclsFrameSaver: no samples within desired window for channel 10698
wclsFrameSaver: no samples within desired window for channel 10701
wclsFrameSaver: no samples within desired window for channel 10939
wclsFrameSaver: no samples within desired window for channel 10985
wclsFrameSaver: no samples within desired window for channel 10986
wclsFrameSaver: no samples within desired window for channel 10987
wclsFrameSaver: no samples within desired window for channel 11042
wclsFrameSaver: no samples within desired window for channel 11316
wclsFrameSaver: no samples within desired window for channel 11316
wclsFrameSaver: no samples within desired window for channel 11317
wclsFrameSaver: no samples within desired window for channel 11318
wclsFrameSaver: no samples within desired window for channel 11318
wclsFrameSaver: no samples within desired window for channel 11501
wclsFrameSaver: no samples within desired window for channel 11502
wclsFrameSaver: no samples within desired window for channel 11514
wclsFrameSaver: no samples within desired window for channel 11515
wclsFrameSaver: no samples within desired window for channel 11516
wclsFrameSaver: no samples within desired window for channel 11517
wclsFrameSaver: no samples within desired window for channel 11518
wclsFrameSaver: no samples within desired window for channel 11519
wclsFrameSaver: no samples within desired window for channel 11519
wclsFrameSaver: no samples within desired window for channel 11570
wclsFrameSaver: no samples within desired window for channel 11729
wclsFrameSaver: no samples within desired window for channel 11729
wclsFrameSaver: no samples within desired window for channel 11868
wclsFrameSaver: no samples within desired window for channel 11905
wclsFrameSaver: no samples within desired window for channel 11906
wclsFrameSaver: no samples within desired window for channel 11906
wclsFrameSaver: no samples within desired window for channel 12061
wclsFrameSaver: no samples within desired window for channel 12061
wclsFrameSaver: no samples within desired window for channel 12062
wclsFrameSaver: no samples within desired window for channel 12063
wclsFrameSaver: no samples within desired window for channel 12064
FrameSaver: q=6.99501e+06 n=853866 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 272 XUs and 491 XVs -> 10 XUVs
C:0 T:1 93 XUs and 91 XVs -> 7 XUVs
C:0 T:2 449 XUs and 645 XVs -> 26 XUVs
C:0 T:3 1359 XUs and 1266 XVs -> 55 XUVs
C:0 T:4 916 XUs and 539 XVs -> 22 XUVs
C:0 T:5 1074 XUs and 909 XVs -> 95 XUVs
C:0 T:6 518 XUs and 486 XVs -> 39 XUVs
C:0 T:7 588 XUs and 588 XVs -> 38 XUVs
C:0 T:8 1206 XUs and 1856 XVs -> 79 XUVs
C:0 T:9 1028 XUs and 814 XVs -> 55 XUVs
C:0 T:10 816 XUs and 1175 XVs -> 55 XUVs
C:0 T:11 8123 XUs and 8901 XVs -> 693 XUVs
C:0 T:12 2134 XUs and 2056 XVs -> 109 XUVs
C:0 T:13 1324 XUs and 1424 XVs -> 77 XUVs
C:0 T:14 3589 XUs and 3607 XVs -> 150 XUVs
C:0 T:15 810 XUs and 1101 XVs -> 78 XUVs
1588 XUVs total
1219 collection wire objects
1588 potential space points
Neighbour search...
31104 tests to find 8124 neighbours
Iterating with no regularization...
Begin: 8.16857e+08
0 7.84622e+08
1 7.84314e+08
Now with regularization...
Begin: 7.68914e+08
0 7.68877e+08
17-Sep-2025 18:29:12 CEST Closed output file "np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241_reco_stage1_20250917T162912_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 65.2192 287.124 629.977 259.069 112.633 20
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.7366e-05 0.000181335 0.00116613 0.000105209 0.000233084 20
produce:tpcrawdecoder:PDVDTPCReader 8.55385 16.2929 19.2786 16.2488 2.13241 20
produce:triggerrawdecoder:PDVDTriggerReader4 0.273789 0.27812 0.286961 0.276656 0.00347565 20
produce:pdvddaphne:DAPHNEReaderPDVD 0.000404866 0.000600424 0.00260433 0.000500246 0.000463289 20
produce:ophit:OpHitFinder 0.000208234 0.000431933 0.00237011 0.000296816 0.000460477 20
produce:opflash:OpFlashFinderVerticalDrift 7.0633e-05 0.000136092 0.000926161 8.6939e-05 0.0001824 20
produce:wclsdatavd:WireCellToolkit 32.5715 113.853 139.329 117.473 22.5832 20
produce:gaushit:GausHitFinder 1.05507 2.42466 4.65765 2.2472 0.924677 20
produce:nhitsfilter:NumberOfHitsFilter 0.000194638 0.000499499 0.000954756 0.000483365 0.000169287 20
produce:reco3d:SpacePointSolver 4.24775 21.9394 43.2039 21.897 8.77562 20
produce:hitpdune:DisambigFromSpacePoints 0.0979769 0.381621 0.897066 0.313997 0.210638 20
produce:pandora:StandardPandora 16.1842 122.656 412.825 93.4163 86.9115 20
produce:pandoraTrack:LArPandoraTrackCreation 0.551116 2.17534 4.43469 1.96354 0.983282 20
produce:pandoraGnocalo:GnocchiCalorimetry 0.0169579 0.0476563 0.0701997 0.0470609 0.0141322 20
[art]:TriggerResults:TriggerResultInserter 2.673e-05 5.83593e-05 0.000199116 4.496e-05 3.93357e-05 20
end_path:out1:RootOutput 5.701e-06 1.15604e-05 4.1689e-05 9.8285e-06 7.37025e-06 20
end_path:out1:RootOutput(write) 1.61005 7.02602 8.9774 6.7365 1.62318 20
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4986.49 MB
Peak resident set size usage (VmHWM): 3008.55 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241_reco_stage1_20250917T162912_keepup.root
\tHists: np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241_reco_stage1_20250917T162912_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241_reco_stage1_20250917T162912_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241_reco_stage1_20250917T162912_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1758126553.0,
"core.end_time": 1758126553.0,
"core.events": [
26273,
26277,
26281,
26285,
26289,
26293,
26297,
26301,
26305,
26309,
26313,
26317,
26321,
26325,
26329,
26333,
26337,
26341,
26345,
26349
],
"core.event_count": 20,
"core.first_event_number": 26273,
"core.last_event_number": 26349,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39388
],
"core.runs_subruns": [
3938800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241_reco_stage1_20250917T162912_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1758126553.0,
"core.end_time": 1758126553.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39388
],
"core.runs_subruns": [
3938800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039388_0341_df-s05-d1_dw_0_20250916T202241.hdf5"
}
]
} 