Jobsub ID 303843.2@dunegpschedd01.fnal.gov
| Jobsub ID | 303843.2@dunegpschedd01.fnal.gov |
| Workflow ID | 12725 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-02-04 03:46:37 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce513 |
| Last heartbeat | 2026-02-04 04:30:15 |
| From worker node | Hostname | b9p17p7474.cern.ch |
| cpuinfo | Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 03:47:24 |
| Input files | vd-protodune:np02vd_raw_run040380_0089_df-s04-d0_dw_0_20251105T183616.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2551s) |
| CPU time | 40m (2412s = 94%) |
| Max RSS bytes | 1873784832 (1786 MiB) |
| Outputting started | 2026-02-04 04:29:55 |
| Output files | |
| Finished | 2026-02-04 04:30:15 |
| Saved logs | justin-logs:303843.2-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
088
----- Number Of Hits found : [2455 2691 2343]
---- Number Of 2D tracks found : [16 13 16]
--- Number of 3D tracks found : 4
-- Found 64 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367756.0111105
number of samples = 9088
----- Number Of Hits found : [2900 2717 1918]
---- Number Of 2D tracks found : [35 36 43]
--- Number of 3D tracks found : 8
-- Found 127 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367756.0111039
number of samples = 9344
----- Number Of Hits found : [1423 1690 1998]
---- Number Of 2D tracks found : [48 47 64]
--- Number of 3D tracks found : 12
-- Found 213 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367756.0111039
number of samples = 9344
----- Number Of Hits found : [4756 4306 6022]
---- Number Of 2D tracks found : [128 112 150]
--- Number of 3D tracks found : 148
-- Found 319 Single Hits!
Across modules [0, 1] merged 1 3D tracks together across module !!!
Found 1 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 17
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 17 TRIGGER 8204 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:35:56 2025 + 996728320.0 ns
Trigger timestamp 1762367756.9967284
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762367756.9954612
number of samples = 7872
----- Number Of Hits found : [2513 2485 1229]
---- Number Of 2D tracks found : [ 9 11 17]
--- Number of 3D tracks found : 7
-- Found 80 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367756.9954612
number of samples = 7872
----- Number Of Hits found : [2475 2257 2001]
---- Number Of 2D tracks found : [29 26 36]
--- Number of 3D tracks found : 9
-- Found 137 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367756.9954562
number of samples = 8064
----- Number Of Hits found : [1398 1619 2239]
---- Number Of 2D tracks found : [42 38 50]
--- Number of 3D tracks found : 14
-- Found 232 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367756.9954562
number of samples = 8064
----- Number Of Hits found : [2861 3205 4066]
---- Number Of 2D tracks found : [71 66 83]
--- Number of 3D tracks found : 22
-- Found 333 Single Hits!
Across modules [0, 1] merged 1 3D tracks together across module !!!
Across modules [2, 3] merged 1 3D tracks together across module !!!
Found 1 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 18
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 18 TRIGGER 8207 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:35:57 2025 + 83262208.0 ns
Trigger timestamp 1762367757.0832622
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762367757.0820014
number of samples = 7872
----- Number Of Hits found : [2585 2567 1988]
---- Number Of 2D tracks found : [18 24 22]
--- Number of 3D tracks found : 9
-- Found 68 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367757.0820014
number of samples = 7872
----- Number Of Hits found : [4831 5495 4796]
---- Number Of 2D tracks found : [ 86 101 71]
--- Number of 3D tracks found : 248
-- Found 125 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367757.081984
number of samples = 8064
----- Number Of Hits found : [704 946 962]
---- Number Of 2D tracks found : [ 92 106 78]
--- Number of 3D tracks found : 249
-- Found 194 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367757.081984
number of samples = 8064
----- Number Of Hits found : [2633 2223 3137]
---- Number Of 2D tracks found : [121 135 108]
--- Number of 3D tracks found : 258
-- Found 255 Single Hits!
Found 4 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 19
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 19 TRIGGER 8210 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:35:57 2025 + 575595776.0 ns
Trigger timestamp 1762367757.5755959
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762367757.5743408
number of samples = 7872
----- Number Of Hits found : [2090 2093 1567]
---- Number Of 2D tracks found : [10 10 10]
--- Number of 3D tracks found : 4
-- Found 78 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367757.5743408
number of samples = 7872
----- Number Of Hits found : [3164 3079 3062]
---- Number Of 2D tracks found : [40 37 35]
--- Number of 3D tracks found : 10
-- Found 143 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367757.574336
number of samples = 8064
----- Number Of Hits found : [1576 1984 3050]
---- Number Of 2D tracks found : [60 51 58]
--- Number of 3D tracks found : 20
-- Found 211 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367757.574336
number of samples = 8064
----- Number Of Hits found : [1347 1396 2843]
---- Number Of 2D tracks found : [79 65 78]
--- Number of 3D tracks found : 26
-- Found 288 Single Hits!
Found 4 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 20
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 20 TRIGGER 8215 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:35:58 2025 + 133533440.0 ns
Trigger timestamp 1762367758.1335335
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762367758.1322815
number of samples = 7872
----- Number Of Hits found : [3295 2951 2230]
---- Number Of 2D tracks found : [16 18 24]
--- Number of 3D tracks found : 6
-- Found 77 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367758.1322815
number of samples = 7872
----- Number Of Hits found : [2155 1841 977]
---- Number Of 2D tracks found : [28 27 40]
--- Number of 3D tracks found : 15
-- Found 143 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367758.1322558
number of samples = 8064
----- Number Of Hits found : [1960 2508 3839]
---- Number Of 2D tracks found : [48 55 84]
--- Number of 3D tracks found : 24
-- Found 228 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367758.1322558
number of samples = 8064
----- Number Of Hits found : [2684 2725 3355]
---- Number Of 2D tracks found : [ 69 76 116]
--- Number of 3D tracks found : 37
-- Found 341 Single Hits!
Across modules [0, 1] merged 3 3D tracks together across module !!!
Found 9 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 21
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 21 TRIGGER 8218 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:35:58 2025 + 836755200.0 ns
Trigger timestamp 1762367758.8367553
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762367758.8354828
number of samples = 7872
----- Number Of Hits found : [2996 3044 2373]
---- Number Of 2D tracks found : [21 14 20]
--- Number of 3D tracks found : 6
-- Found 92 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367758.8354828
number of samples = 7872
----- Number Of Hits found : [4466 3960 4387]
---- Number Of 2D tracks found : [58 52 55]
--- Number of 3D tracks found : 12
-- Found 174 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367758.8354878
number of samples = 8064
----- Number Of Hits found : [ 853 855 1105]
---- Number Of 2D tracks found : [65 61 64]
--- Number of 3D tracks found : 15
-- Found 241 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367758.8354878
number of samples = 8064
----- Number Of Hits found : [2102 2094 3508]
---- Number Of 2D tracks found : [86 80 99]
--- Number of 3D tracks found : 22
-- Found 312 Single Hits!
Across modules [0, 1] merged 1 3D tracks together across module !!!
Across modules [2, 3] merged 1 3D tracks together across module !!!
Found 2 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 22
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 22 TRIGGER 8222 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:35:59 2025 + 563281664.0 ns
Trigger timestamp 1762367759.5632818
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762367759.5620148
number of samples = 8512
----- Number Of Hits found : [2412 2503 1801]
---- Number Of 2D tracks found : [10 14 11]
--- Number of 3D tracks found : 6
-- Found 60 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762367759.5620148
number of samples = 8512
----- Number Of Hits found : [2883 3086 2595]
---- Number Of 2D tracks found : [37 39 44]
--- Number of 3D tracks found : 16
-- Found 120 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762367759.5620158
number of samples = 8704
----- Number Of Hits found : [ 859 978 1371]
---- Number Of 2D tracks found : [41 44 57]
--- Number of 3D tracks found : 19
-- Found 187 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762367759.5620158
number of samples = 8704
----- Number Of Hits found : [1729 1854 2262]
---- Number Of 2D tracks found : [60 62 79]
--- Number of 3D tracks found : 28
-- Found 257 Single Hits!
Across modules [2, 3] merged 1 3D tracks together across module !!!
Found 2 cathode crossing tracks
file closed!
**************
* Reco total *
**************
* Nb of Hits 768302
* Nb of 2D Tracks 7541
* Nb of 3D Tracks 4607
* Nb of Ghosts 0
* Nb of Single Hits 6975
* Nb of PDS Peaks 0
* Nb of PDS Clusters 0
**************
it took 2448.99 s to run 23 events (average of 106.48 per event)
Select jobs to execute...
Select jobs to execute...
Complete log: .snakemake/log/2026-02-04T044842.852044.snakemake.log
Done running snakemake
