Jobsub ID 298724.18@dunegpschedd01.fnal.gov
| Jobsub ID | 298724.18@dunegpschedd01.fnal.gov |
| Workflow ID | 12195 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 19:54:08 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2026-01-21 22:06:27 |
| From worker node | Hostname | sdsc-49.t2.ucsd.edu |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 19:55:24 |
| Input files | hd-protodune:np04hd_raw_run027306_0002_dataflow1_datawriter_0_20240619T175558.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7843s) |
| CPU time | 1h (6943s = 88%) |
| Max RSS bytes | 2617700352 (2496 MiB) |
| Outputting started | 2026-01-21 22:06:08 |
| Output files | |
| Finished | 2026-01-21 22:06:27 |
| Saved logs | justin-logs:298724.18-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0 T:3 80 XUs and 84 XVs -> 2 XUVs
C:0 T:4 57 XUs and 76 XVs -> 3 XUVs
C:0 T:5 20240 XUs and 15202 XVs -> 358 XUVs
C:0 T:6 6534 XUs and 6245 XVs -> 197 XUVs
C:0 T:7 124 XUs and 113 XVs -> 6 XUVs
11005 XUVs total
2786 collection wire objects
11005 potential space points
Neighbour search...
1292903 tests to find 365290 neighbours
Iterating with no regularization...
Begin: 6.11165e+07
0 5.21506e+07
1 5.13211e+07
2 5.12676e+07
3 5.1259e+07
Now with regularization...
Begin: 5.0077e+07
0 5.00706e+07
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000270903 0.000155449 0.000124216 0.000154734 0.000430465 0.00014621 0.00014621 0.000115335 0.000115097 0.000115156 0.000127852 0.000141978 0.000141919
----view 1: 0.000177383 0.000177443 0.000177383 0.000734031 0.0015412 0.00396562 0.00021112 4.66108e-05 3.83854e-05 3.83258e-05 3.83854e-05 3.83854e-05 0.000267565
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00014621 0.000115335 0.000115097 0.000115156 0.000127852 0.000141978 0.000141919 0.00217801 0.00054276 0.00054276 0.00269395 0.00575483 0
----view 1: 0.00021112 4.66108e-05 3.83854e-05 3.83258e-05 3.83854e-05 3.83854e-05 0.000267565 6.52671e-05 6.09756e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000115335 0.000115097 0.000115156 0.000127852 0.000141978 0.000141919 0.00217801 0.00054276 0.00054276 0.00269395 0.00575483 0 0
----view 1: 4.66108e-05 3.83854e-05 3.83258e-05 3.83854e-05 3.83854e-05 0.000267565 6.52671e-05 6.09756e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05 4.91738e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000115097 0.000115156 0.000127852 0.000141978 0.000141919 0.00217801 0.00054276 0.00054276 0.00269395 0.00575483 0 0 0
----view 1: 3.83854e-05 3.83258e-05 3.83854e-05 3.83854e-05 0.000267565 6.52671e-05 6.09756e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05 4.91738e-05 4.91142e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000115156 0.000127852 0.000141978 0.000141919 0.00217801 0.00054276 0.00054276 0.00269395 0.00575483 0 0 0 0
----view 1: 3.83258e-05 3.83854e-05 3.83854e-05 0.000267565 6.52671e-05 6.09756e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000127852 0.000141978 0.000141919 0.00217801 0.00054276 0.00054276 0.00269395 0.00575483 0 0 0 0 0
----view 1: 3.83854e-05 3.83854e-05 0.000267565 6.52671e-05 6.09756e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05 4.91738e-05 4.91142e-05 4.91142e-05 4.91738e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000340044 0.000159264 0.000144064 0.000106037 0.000281632 0.0003196 0.000143647 0.000131369 0.00011313 0.00011313 0.00011313 0.000134289 0.000139415
----view 1: 0.000169456 0.000169396 0.000169456 0.000169456 0.00134939 0.00437057 0.000398576 0.000130415 3.66569e-05 3.66569e-05 3.66569e-05 3.65973e-05 0.000209808
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000131369 0.00011313 0.00011313 0.00011313 0.000134289 0.000139415 0.000721455 0.00170302 0.000533283 0.000533342 0.00274754 0.00565296 0
----view 1: 0.000130415 3.66569e-05 3.66569e-05 3.66569e-05 3.65973e-05 0.000209808 9.45926e-05 6.23465e-05 5.47767e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69685e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00011313 0.00011313 0.00011313 0.000134289 0.000139415 0.000721455 0.00170302 0.000533283 0.000533342 0.00274754 0.00565296 0 0
----view 1: 3.66569e-05 3.66569e-05 3.66569e-05 3.65973e-05 0.000209808 9.45926e-05 6.23465e-05 5.47767e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69685e-05 4.69089e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00011313 0.00011313 0.000134289 0.000139415 0.000721455 0.00170302 0.000533283 0.000533342 0.00274754 0.00565296 0 0 0
----view 1: 3.66569e-05 3.66569e-05 3.65973e-05 0.000209808 9.45926e-05 6.23465e-05 5.47767e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69089e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00011313 0.000134289 0.000139415 0.000721455 0.00170302 0.000533283 0.000533342 0.00274754 0.00565296 0 0 0 0
----view 1: 3.66569e-05 3.65973e-05 0.000209808 9.45926e-05 6.23465e-05 5.47767e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69089e-05 4.69685e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000134289 0.000139415 0.000721455 0.00170302 0.000533283 0.000533342 0.00274754 0.00565296 0 0 0 0 0
----view 1: 3.65973e-05 0.000209808 9.45926e-05 6.23465e-05 5.47767e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69685e-05 4.69089e-05 4.69089e-05 4.69685e-05 4.69089e-05
21-Jan-2026 14:06:03 PST Closed output file "np04hd_raw_run027306_0002_dataflow1_datawriter_0_20240619T175558_20260121T220603_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 26.915 257.259 570.236 270.433 116.201 30
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.2972e-05 0.000120295 0.000238526 0.000113399 2.53056e-05 30
produce:tpcrawdecoder:PDHDTPCReader 26.31 28.2981 37.6918 27.3487 2.29694 30
produce:triggerrawdecoder:PDHDTriggerReader3 0.132929 0.13529 0.186297 0.133371 0.00949081 30
produce:timingrawdecoder:PDHDTimingRawDecoder 0.066539 0.0680324 0.0939799 0.066813 0.00494603 30
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.331601 0.338004 0.472304 0.332711 0.0249924 30
produce:beamevent:BeamEvent 0.00690784 0.0765356 1.75476 0.0105863 0.314365 30
produce:fembfilter:PDHDFEMBFilter 6.0204e-05 0.000170078 0.000469469 0.000169977 6.54747e-05 30
produce:wclsdatahd:WireCellToolkit 106.258 128.908 145.805 132.755 9.40386 26
produce:gaushit:GausHitFinder 0.820924 1.51391 2.45584 1.51558 0.32834 26
produce:nhitsfilter:NumberOfHitsFilter 0.000442418 0.000646285 0.000971377 0.000648647 0.000140639 26
produce:reco3d:SpacePointSolver 0.675671 2.87497 8.5902 2.48879 1.59349 26
produce:hitpdune:DisambigFromSpacePoints 0.91082 2.35477 5.52966 2.22696 1.03484 26
produce:pandora:StandardPandora 28.3079 110.974 346.698 101.803 70.0496 26
produce:pandoraWriter:StandardPandora 0.205034 0.3395 0.501997 0.340517 0.0783436 26
produce:pandoraTrack:LArPandoraTrackCreation 2.73061 7.26337 16.4939 6.79029 3.1623 26
produce:pandoraShower:LArPandoraShowerCreation 2.4098 7.50148 20.0389 6.95002 3.83458 26
[art]:TriggerResults:TriggerResultInserter 3.4423e-05 6.17896e-05 0.000125318 5.8121e-05 2.19468e-05 30
end_path:out1:RootOutput 6.259e-06 1.3725e-05 3.5612e-05 1.12305e-05 6.10414e-06 30
end_path:out1:RootOutput(write) 0.0182715 1.34523 2.45589 1.42281 0.623254 30
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 11862.4 MB
Peak resident set size usage (VmHWM): 2617.7 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 521M
-rw-r--r--. 1 cuser cuser 371M Jan 21 14:06 np04hd_raw_run027306_0002_dataflow1_datawriter_0_20240619T175558_20260121T220603_keepup.root
-rw-r--r--. 1 cuser cuser 143M Jan 21 14:05 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 6.1M Jan 21 14:06 jobscript.log
-rw-r--r--. 1 cuser cuser 228K Jan 21 14:06 mem.db
-rw-r--r--. 1 cuser cuser 48K Jan 21 14:06 time.db
-rw-r--r--. 1 cuser cuser 17K Jan 21 14:06 np04hd_raw_run027306_0002_dataflow1_datawriter_0_20240619T175558.hdf5_calibana.root
-rw-r--r--. 1 cuser cuser 3.5K Jan 21 14:06 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 83 Jan 21 11:55 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 0 Jan 21 11:55 debugprod.log
disk usage
521M .
