Friday, March 8, 2024

Fine tune a 70B language model at home

Fine tune a 70B language model at home
601 by jph00 | 146 comments on Hacker News.
Jeremy from Answer.AI here. This is our first project since launching our new R&D lab at the start of this year. It's the #1 most requested thing I've been hearing from open source model builders: the ability to use multiple GPUs with QLoRA training. So that's why we decided to make it our first project. Huge thanks to Tim Dettmers for helping us get started to this -- and of course for creating QLoRA in the first place! Let me know if you have any questions or thoughts.

My favourite animation trick: exponential smoothing (2023)

My favourite animation trick: exponential smoothing (2023)
582 by atan2 | 330 comments on Hacker News.


Don't fuck with paste

Don't fuck with paste
561 by zettabomb | 279 comments on Hacker News.