justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303843.9@dunegpschedd01.fnal.gov

Jobsub ID303843.9@dunegpschedd01.fnal.gov
Workflow ID12725
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-04 03:46:37
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2026-02-04 04:21:33
From worker nodeHostnameb9p17p7474.cern.ch
cpuinfoIntel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-04 03:47:29
Input filesvd-protodune:np02vd_raw_run040380_0072_df-s04-d3_dw_0_20251105T183009.hdf5
JobscriptExit code0
Real time33m (2023s)
CPU time31m (1894s = 93%)
Max RSS bytes1873567744 (1786 MiB)
Outputting started2026-02-04 04:21:14
Output files
Finished2026-02-04 04:21:33
Saved logsjustin-logs:303843.9-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

w ( 6 )
Taken at  Wed Nov  5 19:29:53 2025  +  149225728.0  ns 
Trigger timestamp  1762367393.149226

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367393.1479452
number of samples =  7936
----- Number Of Hits found :  [2255 2243 1897]
---- Number Of 2D tracks found :  [13 12 13]
--- Number of 3D tracks found :  5
-- Found  77  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367393.1479452
number of samples =  7936
----- Number Of Hits found :  [3818 3792 4730]
---- Number Of 2D tracks found :  [54 55 48]
--- Number of 3D tracks found :  19
-- Found  133  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367393.147968
number of samples =  8064
----- Number Of Hits found :  [1355 1563 1863]
---- Number Of 2D tracks found :  [68 68 67]
--- Number of 3D tracks found :  25
-- Found  217  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367393.147968
number of samples =  8064
----- Number Of Hits found :  [3015 3927 5167]
---- Number Of 2D tracks found :  [ 96 101 116]
--- Number of 3D tracks found :  31
-- Found  294  Single Hits!
Found  4  cathode crossing tracks 
-*-*-*-*-*-*-*-*-*-*-
 READING EVENT  17
-*-*-*-*-*-*-*-*-*-*-
RUN  40380  of  bot  EVENT  17  TRIGGER  6909 : kADCSimpleWindow ( 6 )
Taken at  Wed Nov  5 19:29:53 2025  +  677134592.0  ns 
Trigger timestamp  1762367393.6771348

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367393.6758704
number of samples =  8512
----- Number Of Hits found :  [3465 3201 3481]
---- Number Of 2D tracks found :  [20 25 27]
--- Number of 3D tracks found :  7
-- Found  92  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367393.6758704
number of samples =  8512
----- Number Of Hits found :  [3023 2888 2803]
---- Number Of 2D tracks found :  [33 44 49]
--- Number of 3D tracks found :  19
-- Found  162  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367393.6758718
number of samples =  8704
----- Number Of Hits found :  [3089 3536 4694]
---- Number Of 2D tracks found :  [ 71  94 106]
--- Number of 3D tracks found :  28
-- Found  244  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367393.6758718
number of samples =  8704
----- Number Of Hits found :  [2715 2949 3932]
---- Number Of 2D tracks found :  [ 97 116 133]
--- Number of 3D tracks found :  39
-- Found  324  Single Hits!
Across modules  [0, 1] merged  3  3D tracks together across module !!! 
Found  7  cathode crossing tracks 
-*-*-*-*-*-*-*-*-*-*-
 READING EVENT  18
-*-*-*-*-*-*-*-*-*-*-
RUN  40380  of  bot  EVENT  18  TRIGGER  6910 : kADCSimpleWindow ( 6 )
Taken at  Wed Nov  5 19:29:54 2025  +  74932736.0  ns 
Trigger timestamp  1762367394.0749328

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367394.0736737
number of samples =  7872
----- Number Of Hits found :  [2750 2567 1545]
---- Number Of 2D tracks found :  [14 15 19]
--- Number of 3D tracks found :  4
-- Found  83  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367394.0736737
number of samples =  7872
----- Number Of Hits found :  [2277 1973 1781]
---- Number Of 2D tracks found :  [25 26 28]
--- Number of 3D tracks found :  10
-- Found  140  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367394.0736642
number of samples =  8064
----- Number Of Hits found :  [2633 3513 3973]
---- Number Of 2D tracks found :  [55 68 74]
--- Number of 3D tracks found :  13
-- Found  215  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367394.0736642
number of samples =  8064
----- Number Of Hits found :  [1803 1464 1798]
---- Number Of 2D tracks found :  [70 84 94]
--- Number of 3D tracks found :  21
-- Found  281  Single Hits!
Found  1  cathode crossing tracks 
-*-*-*-*-*-*-*-*-*-*-
 READING EVENT  19
-*-*-*-*-*-*-*-*-*-*-
RUN  40380  of  bot  EVENT  19  TRIGGER  6914 : kADCSimpleWindow ( 6 )
Taken at  Wed Nov  5 19:29:54 2025  +  315693056.0  ns 
Trigger timestamp  1762367394.3156931

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367394.3144202
number of samples =  7872
----- Number Of Hits found :  [2305 2182 1465]
---- Number Of 2D tracks found :  [21 22 26]
--- Number of 3D tracks found :  5
-- Found  54  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367394.3144202
number of samples =  7872
----- Number Of Hits found :  [1505 1379  588]
---- Number Of 2D tracks found :  [27 29 34]
--- Number of 3D tracks found :  7
-- Found  115  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367394.3144321
number of samples =  8064
----- Number Of Hits found :  [3062 3225 3363]
---- Number Of 2D tracks found :  [83 95 97]
--- Number of 3D tracks found :  71
-- Found  164  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367394.3144321
number of samples =  8064
----- Number Of Hits found :  [1110 1049 1471]
---- Number Of 2D tracks found :  [ 92 105 105]
--- Number of 3D tracks found :  75
-- Found  234  Single Hits!
Found  2  cathode crossing tracks 
-*-*-*-*-*-*-*-*-*-*-
 READING EVENT  20
-*-*-*-*-*-*-*-*-*-*-
RUN  40380  of  bot  EVENT  20  TRIGGER  6916 : kADCSimpleWindow ( 6 )
Taken at  Wed Nov  5 19:29:54 2025  +  923043072.0  ns 
Trigger timestamp  1762367394.9230433

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367394.921775
number of samples =  7872
----- Number Of Hits found :  [1748 1466 1007]
---- Number Of 2D tracks found :  [9 6 4]
--- Number of 3D tracks found :  3
-- Found  51  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367394.921775
number of samples =  7872
----- Number Of Hits found :  [2281 2148 1523]
---- Number Of 2D tracks found :  [23 20 24]
--- Number of 3D tracks found :  6
-- Found  116  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367394.921792
number of samples =  8064
----- Number Of Hits found :  [1483 1129 1755]
---- Number Of 2D tracks found :  [35 30 43]
--- Number of 3D tracks found :  11
-- Found  170  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367394.921792
number of samples =  8064
----- Number Of Hits found :  [1999 2353 3577]
---- Number Of 2D tracks found :  [61 56 87]
--- Number of 3D tracks found :  17
-- Found  229  Single Hits!
Across modules  [2, 3] merged  1  3D tracks together across module !!! 
Found  2  cathode crossing tracks 
-*-*-*-*-*-*-*-*-*-*-
 READING EVENT  21
-*-*-*-*-*-*-*-*-*-*-
RUN  40380  of  bot  EVENT  21  TRIGGER  6920 : kADCSimpleWindow ( 6 )
Taken at  Wed Nov  5 19:29:55 2025  +  831004416.0  ns 
Trigger timestamp  1762367395.8310046

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367395.8297436
number of samples =  7872
----- Number Of Hits found :  [5074 4638 5142]
---- Number Of 2D tracks found :  [45 51 43]
--- Number of 3D tracks found :  19
-- Found  64  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367395.8297436
number of samples =  7872
----- Number Of Hits found :  [2504 2541 1495]
---- Number Of 2D tracks found :  [54 61 56]
--- Number of 3D tracks found :  25
-- Found  132  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367395.829728
number of samples =  8064
----- Number Of Hits found :  [ 886  911 1466]
---- Number Of 2D tracks found :  [65 73 70]
--- Number of 3D tracks found :  29
-- Found  179  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367395.829728
number of samples =  8064
----- Number Of Hits found :  [1651 1855 2806]
---- Number Of 2D tracks found :  [80 89 93]
--- Number of 3D tracks found :  37
-- Found  270  Single Hits!
Across modules  [0, 1] merged  1  3D tracks together across module !!! 
Found  4  cathode crossing tracks 
-*-*-*-*-*-*-*-*-*-*-
 READING EVENT  22
-*-*-*-*-*-*-*-*-*-*-
RUN  40380  of  bot  EVENT  22  TRIGGER  6923 : kADCSimpleWindow ( 6 )
Taken at  Wed Nov  5 19:29:56 2025  +  111619584.0  ns 
Trigger timestamp  1762367396.1116197

## Reading TPC ##

MODULE  0
 Removing  12  broken channels
1st sample timestamp:  1762367396.110369
number of samples =  8576
----- Number Of Hits found :  [3697 3967 3566]
---- Number Of 2D tracks found :  [21 26 22]
--- Number of 3D tracks found :  8
-- Found  78  Single Hits!

MODULE  1
 Removing  12  broken channels
1st sample timestamp:  1762367396.110369
number of samples =  8576
----- Number Of Hits found :  [3392 3582 2958]
---- Number Of 2D tracks found :  [45 51 54]
--- Number of 3D tracks found :  17
-- Found  167  Single Hits!

MODULE  2
 Removing  12  broken channels
1st sample timestamp:  1762367396.1103678
number of samples =  8768
----- Number Of Hits found :  [1386  990 1656]
---- Number Of 2D tracks found :  [57 62 72]
--- Number of 3D tracks found :  26
-- Found  228  Single Hits!

MODULE  3
 Removing  12  broken channels
1st sample timestamp:  1762367396.1103678
number of samples =  8768
----- Number Of Hits found :  [3121 3129 4433]
---- Number Of 2D tracks found :  [ 87 106 118]
--- Number of 3D tracks found :  35
-- Found  300  Single Hits!
Across modules  [0, 1] merged  1  3D tracks together across module !!! 
Found  5  cathode crossing tracks 
file closed!
**************
* Reco total *
**************
* Nb of Hits 800403
* Nb of 2D Tracks 7651
* Nb of 3D Tracks 2217
* Nb of Ghosts 0
* Nb of Single Hits 6925
* Nb of PDS Peaks 0
* Nb of PDS Clusters 0
**************
it took 1927.68 s to run 23 events (average of 83.81 per event)
Select jobs to execute...
Select jobs to execute...
Complete log: .snakemake/log/2026-02-04T044847.811136.snakemake.log
Done running snakemake
justIN time: 2026-02-04 06:00:41 UTC       justIN version: 01.06.00