Skip to content

Add explicit BYOK Gemini, OpenAI, and Claude providers - #2

Draft
Nitin-Sagar-B wants to merge 2 commits into
mainfrom
codex/multi-provider-byok
Draft

Nitin-Sagar-B wants to merge 2 commits into
mainfrom
codex/multi-provider-byok

Conversation

@Nitin-Sagar-B

Copy link
Copy Markdown
Collaborator

Summary

Adds optional session-only BYOK cloud providers while preserving local Ollama as SparkOllama's default route.

  • keeps loopback-only Ollama and installed-model discovery
  • adds Google Gemini, OpenAI, and Anthropic Claude provider adapters
  • uses the OpenAI Responses API with response storage disabled
  • uses the Anthropic Messages streaming API and Gemini content streaming API
  • accepts editable model IDs so users can choose models available to their accounts
  • requires a password-field key and explicit cloud-transmission consent
  • never persists keys or copies them into process-global environment variables
  • clears conversation context when the selected provider/model changes
  • updates privacy, architecture, limitations, GEO metadata, optional dependencies, and CI

Validation

  • 35 tests
  • Ruff format and lint
  • strict mypy
  • locked environment with all cloud extras installed
  • wheel and source distribution builds
  • Python 3.11–3.13 package workflow validates all optional providers

Scope

SparkOllama remains local-first and has no Sparkience-hosted backend. Cloud provider availability, billing, retention, and model access remain governed by the user's provider account.

@Nitin-Sagar-B
Nitin-Sagar-B force-pushed the codex/multi-provider-byok branch from 74aa7e5 to 336af05 Compare November 3, 2026 02:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant