Show HN: Shoehorn – Quantize any model down to run on your machine

2 comments

• hmokiguess 1 hour ago
  Reminds me of https://github.com/AlexsJones/llmfit
• mbuchel-hn 1 hour ago
  does this work similar to airllm? i am wondering how it would handle something like quantizing kimi k3 on a budget of 8 gbs, or is that something you are not attempting to solve yet?