Upsun AI Gateway

This gateway provides authenticated access to AI providers (Anthropic Claude, OpenAI, Google Vertex AI) for Upsun staff.

Quick Start (2 commands)

1 Install the CLI
curl -fsS https://ai-gateway.plat.farm/install.sh | bash

Or manually: GOPRIVATE=go.platform.sh go install go.platform.sh/ai/internal-gateway/cmd/ai-gateway@latest

2 Run setup
ai-gateway setup

This walks you through SSO login, installs and starts the background service, and configures your shell.

Manual Installation

If you prefer to run each step separately:

  1. ai-gateway login — Authenticate via Okta SSO
  2. ai-gateway service install — Install and start the proxy service
  3. ai-gateway shell-init --add — Add eval "$(ai-gateway env)" to your shell profile

Usage

Once configured, AI tools will automatically use the gateway:

Tip: Check proxy status with ai-gateway service status. View logs on Linux with journalctl --user -u ai-gateway-proxy -f.

Commands

Using Other AI Tools (BYOK)

For any OpenAI-compatible tool that supports "bring your own key", configure:

The local proxy handles authentication automatically.

Available Models

Claude (Anthropic via Vertex AI)

OpenAI

Gemini (Google via Vertex AI)

Mistral

Other (via Vertex AI)

Alternative: Token Mode

If you prefer not to run a background service, use token mode:

eval "$(ai-gateway env --no-proxy)"

This configures tools to connect directly to the gateway. Tokens are refreshed on each invocation.