spi: txx9: Use transfer speed unconditionally