lqdev

https://vickiboykis.com/2024/02/28/gguf-the-long-way-around/

We’ve been on a whirlwind adventure to build up our intuition of how machine learning models work, what artifacts they produce, how the machine learning artifact storage story has changed over the past couple years, and finally ended up in GGUF’s documentation to better understand the log that is presented to us when we perform local inference on artifacts in GGUF.


Send me a message or webmention
Back to feed