Jobsub ID 303843.7@dunegpschedd01.fnal.gov
| Jobsub ID | 303843.7@dunegpschedd01.fnal.gov |
| Workflow ID | 12725 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-02-04 03:46:37 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce508 |
| Last heartbeat | 2026-02-04 04:10:17 |
| From worker node | Hostname | b9p35p0043.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 03:47:26 |
| Input files | vd-protodune:np02vd_raw_run040380_0015_df-s04-d0_dw_0_20251105T180240.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 22m (1355s) |
| CPU time | 19m (1197s = 88%) |
| Max RSS bytes | 1975668736 (1884 MiB) |
| Outputting started | 2026-02-04 04:10:02 |
| Output files | |
| Finished | 2026-02-04 04:10:17 |
| Saved logs | justin-logs:303843.7-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
d 84 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762365754.7157013
number of samples = 9152
----- Number Of Hits found : [3382 3118 2784]
---- Number Of 2D tracks found : [93 79 82]
--- Number of 3D tracks found : 86
-- Found 161 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762365754.715712
number of samples = 9344
----- Number Of Hits found : [1481 1541 1562]
---- Number Of 2D tracks found : [106 93 100]
--- Number of 3D tracks found : 92
-- Found 258 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762365754.715712
number of samples = 9344
----- Number Of Hits found : [2300 1882 3639]
---- Number Of 2D tracks found : [127 116 134]
--- Number of 3D tracks found : 99
-- Found 355 Single Hits!
Across modules [0, 1] merged 2 3D tracks together across module !!!
Found 3 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 18
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 18 TRIGGER 1372 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:02:38 2025 + 457665792.0 ns
Trigger timestamp 1762365758.457666
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762365758.456398
number of samples = 7872
----- Number Of Hits found : [5365 5223 6353]
---- Number Of 2D tracks found : [42 47 39]
--- Number of 3D tracks found : 14
-- Found 71 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762365758.456398
number of samples = 7872
----- Number Of Hits found : [3194 3491 2615]
---- Number Of 2D tracks found : [60 67 64]
--- Number of 3D tracks found : 22
-- Found 135 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762365758.4563842
number of samples = 8064
----- Number Of Hits found : [1237 1066 1603]
---- Number Of 2D tracks found : [73 79 74]
--- Number of 3D tracks found : 28
-- Found 205 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762365758.4563842
number of samples = 8064
----- Number Of Hits found : [2147 2326 2716]
---- Number Of 2D tracks found : [ 87 100 102]
--- Number of 3D tracks found : 34
-- Found 324 Single Hits!
Across modules [0, 1] merged 1 3D tracks together across module !!!
Found 1 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 19
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 19 TRIGGER 1376 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:02:40 2025 + 576497408.0 ns
Trigger timestamp 1762365760.5764976
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762365760.5752423
number of samples = 8384
----- Number Of Hits found : [7082 9178 6141]
---- Number Of 2D tracks found : [ 68 127 90]
--- Number of 3D tracks found : 18
-- Found 73 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762365760.5752423
number of samples = 8384
----- Number Of Hits found : [2729 3093 3160]
---- Number Of 2D tracks found : [ 84 147 108]
--- Number of 3D tracks found : 23
-- Found 163 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762365760.575232
number of samples = 8640
----- Number Of Hits found : [1871 2389 3209]
---- Number Of 2D tracks found : [ 99 167 137]
--- Number of 3D tracks found : 32
-- Found 263 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762365760.575232
number of samples = 8640
----- Number Of Hits found : [1118 1255 2005]
---- Number Of 2D tracks found : [112 179 153]
--- Number of 3D tracks found : 37
-- Found 351 Single Hits!
Across modules [2, 3] merged 1 3D tracks together across module !!!
Found 3 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 20
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 20 TRIGGER 1420 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:02:45 2025 + 730792192.0 ns
Trigger timestamp 1762365765.7307923
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762365765.7295177
number of samples = 7872
----- Number Of Hits found : [2382 2008 1651]
---- Number Of 2D tracks found : [14 12 11]
--- Number of 3D tracks found : 6
-- Found 75 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762365765.7295177
number of samples = 7872
----- Number Of Hits found : [4230 3679 4144]
---- Number Of 2D tracks found : [60 57 54]
--- Number of 3D tracks found : 9
-- Found 126 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762365765.729536
number of samples = 8064
----- Number Of Hits found : [ 9297 15699 17108]
---- Number Of 2D tracks found : [190 218 243]
--- Number of 3D tracks found : 22
-- Found 197 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762365765.729536
number of samples = 8064
----- Number Of Hits found : [ 5997 9998 11490]
---- Number Of 2D tracks found : [265 314 380]
--- Number of 3D tracks found : 27
-- Found 298 Single Hits!
Found 2 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 21
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 21 TRIGGER 1424 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:02:47 2025 + 591737088.0 ns
Trigger timestamp 1762365767.5917373
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762365767.590478
number of samples = 7872
----- Number Of Hits found : [3353 3290 2415]
---- Number Of 2D tracks found : [24 21 29]
--- Number of 3D tracks found : 9
-- Found 71 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762365767.590478
number of samples = 7872
----- Number Of Hits found : [3330 3723 2802]
---- Number Of 2D tracks found : [46 55 57]
--- Number of 3D tracks found : 16
-- Found 140 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762365767.590464
number of samples = 8064
----- Number Of Hits found : [ 9281 15767 16369]
---- Number Of 2D tracks found : [184 227 251]
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
3D finalizing track: problem with interpolation
--- Number of 3D tracks found : 141
-- Found 211 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762365767.590464
number of samples = 8064
----- Number Of Hits found : [ 8622 14616 15683]
---- Number Of 2D tracks found : [304 387 455]
--- Number of 3D tracks found : 149
-- Found 297 Single Hits!
Across modules [0, 1] merged 1 3D tracks together across module !!!
Found 2 cathode crossing tracks
-*-*-*-*-*-*-*-*-*-*-
READING EVENT 22
-*-*-*-*-*-*-*-*-*-*-
RUN 40380 of bot EVENT 22 TRIGGER 1428 : kADCSimpleWindow ( 6 )
Taken at Wed Nov 5 19:02:49 2025 + 705622272.0 ns
Trigger timestamp 1762365769.7056224
## Reading TPC ##
MODULE 0
Removing 12 broken channels
1st sample timestamp: 1762365769.7043417
number of samples = 8128
----- Number Of Hits found : [5095 6779 7565]
---- Number Of 2D tracks found : [ 73 106 122]
--- Number of 3D tracks found : 135
-- Found 77 Single Hits!
MODULE 1
Removing 12 broken channels
1st sample timestamp: 1762365769.7043417
number of samples = 8128
----- Number Of Hits found : [3135 3142 2715]
---- Number Of 2D tracks found : [ 96 130 150]
--- Number of 3D tracks found : 142
-- Found 166 Single Hits!
MODULE 2
Removing 12 broken channels
1st sample timestamp: 1762365769.704352
number of samples = 8320
----- Number Of Hits found : [1821 1974 2752]
---- Number Of 2D tracks found : [110 151 183]
--- Number of 3D tracks found : 145
-- Found 258 Single Hits!
MODULE 3
Removing 12 broken channels
1st sample timestamp: 1762365769.704352
number of samples = 8320
----- Number Of Hits found : [2693 2923 4129]
---- Number Of 2D tracks found : [134 179 224]
--- Number of 3D tracks found : 153
-- Found 363 Single Hits!
Across modules [0, 1] merged 1 3D tracks together across module !!!
Found 5 cathode crossing tracks
file closed!
**************
* Reco total *
**************
* Nb of Hits 1606114
* Nb of 2D Tracks 17425
* Nb of 3D Tracks 2213
* Nb of Ghosts 0
* Nb of Single Hits 7641
* Nb of PDS Peaks 0
* Nb of PDS Clusters 0
**************
it took 1274.74 s to run 23 events (average of 55.42 per event)
Select jobs to execute...
Select jobs to execute...
Complete log: .snakemake/log/2026-02-04T044815.953995.snakemake.log
Done running snakemake
