Skip to content

Quick Start Tutorial

Welcome to the Quick Start Tutorial for AI Dev Local, your local development environment for powerful AI integrations.

Objective

In this tutorial, you'll:

  • Install AI Dev Local
  • Configure your environment
  • Launch services to get started fast

Step 1: Installation

Prerequisites

  1. Python 3.10+
  2. Docker
  3. pipx (for package installation)

Install AI Dev Local

# Install with pipx
pipx install ai-dev-local

# Verify installation
ai-dev-local --version

Step 2: Configuration

Initialize Configuration

Initialize the default settings:

ai-dev-local config init

Set API Keys

For OpenAI models:

ai-dev-local config set OPENAI_API_KEY your-openai-api-key

(Optional) For other LLM providers:

ai-dev-local config set ANTHROPIC_API_KEY your-anthropic-api-key

Validate the setup:

ai-dev-local config validate

Step 3: Launch Services

Start the Environment

Launch the services:

ai-dev-local start

Verify Running Services

Check that services are running smoothly:

ai-dev-local status

Navigate to the Dashboard:

Open in browser: http://localhost:3002/

Step 4: Explore Features

Dashboard

Use the Dashboard to monitor and control your services.

Open WebUI

Chat with AI models via Open WebUI.

FlowiseAI

Build AI workflows visually with FlowiseAI.

Langfuse

Track and debug LLM interactions using Langfuse.

LiteLLM

Access the unified API proxy for LLMs.

Step 5: Local AI Models (Optional)

Using Ollama for Local Models

If you want to run AI models locally instead of using cloud APIs:

# Start services with Ollama
ai-dev-local start --ollama

# Browse available models
ai-dev-local ollama list-available --category code

# Install popular models
ai-dev-local ollama pull codellama:7b
ai-dev-local ollama pull llama2:7b

# Sync models to LiteLLM for unified API access
ai-dev-local ollama sync-litellm

# Restart LiteLLM to apply changes
docker-compose restart litellm

Benefits of Local Models: - Privacy: Your data stays local - Cost: No API usage charges - Speed: No network latency for inference - Offline: Works without internet connection

Useful Commands

  • Stop Services: ai-dev-local stop
  • View Logs: ai-dev-local logs
  • Update Configuration: ai-dev-local config set <KEY> <VALUE>
  • Check Ollama Models: ai-dev-local ollama models
  • Open Documentation: ai-dev-local docs

Next Steps

Once you're familiar with the basics, check out: