Look at FT42XX products: those are USB to SPI/Quad SPI bridges supporting up to 30 Mbit/s clock rates. FTDI offers drivers for ARMv7 and ARMv8 as a part of their `libft4222` package, so there's a good chance those bridges will work with a Pi.

Digikey sells FT4222H modules for $18 a piece.