Groq runs Mixtral 8x7B-32k with 500 T/s

Groq runs Mixtral 8x7B-32k with 500 T/s
529 by tin7in | 361 comments on Hacker News.