How do I Set Up Gemini Nano in Chrome

What to know

• Google is constructing Gemini Nano proper into Chrome that may permit customers to run the LLM domestically.
• Currently, this characteristic is barely accessible on Chrome Canary and would require you to set it up proper. 
• Use the steps within the information to arrange built-in Gemini Nano in Chrome.

Google is within the technique of including Gemini Nano proper into Chrome. With this variation, you’ll have the Gemini LLM operating inside Chrome, permitting you to make use of it offline and get solutions to your questions instantaneously. 

However, since that is presently an experiment, it could be some time earlier than you see it on the browser’s desk construct. But with Chrome Canary, you may have this up and operating right this moment. Here’s all the pieces you should know to arrange Gemini Nano constructed proper into Chrome.

How do I arrange Gemini Nano constructed into Chrome

1. Firstly, obtain and set up Chrome Canary should you haven’t already. Your Chrome Canary model must be 127 or above.
2. Open chrome://flags/#immediate-api-for-gemini-nano in Chrome Canary. 
   
   
3. Set it to Enabled. Wait, do NOT Relaunch Chrome Canary when prompted.
   
4. Next, open chrome://flags/#optimization-guide-on-device-model in Chrome Canary.
5. Set it to Enabled BypassPerfRequirement.
   
6. Now Relaunch Chrome Canary.
7. Open chrome://elements/
8. Scroll down and search for Optimization Guide on Device Model. Make positive it’s absolutely downloaded. (If the model is 0.0.0.0, click on on ‘Check for update’).
9. Once the mannequin is downloaded, open a webpage and press F12 to open the console. 
10. Check windows.ai within the console. If you don’t obtain any errors, your setup is accomplished efficiently.

Note: On Chrome Canary model 128, we couldn’t get previous step 10. However, a number of customers have been capable of arrange Gemini Nano in Chrome using the identical steps. So, do strive your luck.

Via: Github/Lightning joyce