App Preview

Local Setup

Create a docker-compose.yml file (see docker/docker-compose.yml) and add the following instructions:

version: "3.8"

services:
  ollama:
    image: ollama/ollama:latest
    container_name: ollama
    ports:
      - "11434:11434"
    volumes:
      - ollama_storage:/root/.ollama
    restart: unless-stopped

volumes:
  ollama_storage:

In your terminal:

• run docker-compose.yml file to pull the image for ollama and start the container

docker compose up -d

• to pull the ollama models

docker compose exec ollama ollama pull all-minilm
docker compose exec ollama ollama pull tinyllama

Astra DB for RAG

• Create a Datastax Astra DB database and keyspace, then add the required variables to your .env file (See .env.example).

• Seed the vector store:

yarn seed

To run the app:

To run the development server:

yarn install
yarn dev

Open http://localhost:3000 with your browser to see the result.