Tuesday, June 4, 2024

Integrate Local LLMs with Mobile and Web Apps

 This video installs Firebase Genkit locally which is a framework with powerful tooling to help app developers build, test, deploy, and monitor AI-powered features.


Code:

conda create -n genkit python=3.11

node -v
sudo npm cache clean -f
sudo npm install -g n
sudo n stable
sudo n latest
restart the shell
node -v

ollama pull mistral

mkdir genkitmistral
cd genkitmistral

sudo npm i -g genkit
npm init -y
genkit init

then go to src/src and change model to mistral

genkit start

No comments: