hash: optimize Toeplitz RSS computation