How to Download and Run Google Gemma AI Model on PC and Mac

Only recently, Google launched its first open-source AI mannequin referred to as Gemma in two sizes, Gemma 2B and 7B. The mannequin is first rate for inventive duties in English like textual content technology, summarization, primary reasoning, and many others. Resulting from its small dimension, the mannequin might be downloaded and domestically used on a low-resource laptop with out an web connection. So right here is our tutorial to obtain and run the Google Gemma AI mannequin on Home windows, macOS, and Linux.

Obtain Google Gemma 2B Mannequin

• Go forward and obtain LM Studio (Free) in your laptop. Subsequent, launch this system.
• On the homepage, one can find the “Google’s Gemma 2B Instruct” mannequin. It’s also possible to manually seek for “Gemma”. Now, open it.
• Subsequent, merely click on on “Obtain”. It’s a 1.5GB file because the Gemma 2B mannequin has been 4-bit quantized to compress the mannequin dimension and scale back reminiscence utilization. If in case you have 8+ GB RAM, you possibly can obtain the 8-bit quantized mannequin (2.67GB) that can provide higher efficiency.

Run Google Gemma Offline Utilizing LM Studio

• In LM Studio, transfer to the “Chat” window on the left aspect.
• After that, click on on “Choose a mannequin to load” and select “gemma”. It is going to devour about 1.4GB RAM.

• Now, go forward and ask your questions. In my expertise, the tiny 2B Gemma mannequin is sweet for inventive duties within the English language. It refuses to reply something of worth the place opinion on any topic is sought (e.g. is C higher than Rust?).

• It’s also possible to set a system immediate on the precise to customise the conduct of the AI mannequin.

So that is how one can obtain and run Google’s Gemma mannequin in your PC, Mac, and Linux laptop. Whereas I discover Google’s open-source mannequin fairly bland, it could be helpful for people who find themselves searching for a easy AI mannequin to run domestically.

Anyway, that’s all from us. In case you are searching for a real native AI assistant, I’d strongly suggest trying out Open Interpreter. It really works like ChatGPT’s Code Interpreter and performs precise duties in your laptop. Lastly, in case you have any questions, tell us within the remark part beneath.