@somegeekintn Cool. For whatever it’s worth I’m currently testing Gemma 4, 26B 4bit. Seems to use about 15 GB of memory.
Replying to:
@somegeekintn Cool. For whatever it’s worth I’m currently testing Gemma 4, 26B 4bit. Seems to use about 15 GB of memory.