diff --git a/AGENTS.md b/AGENTS.md index 6407afc..8087187 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -31,7 +31,7 @@ make test # whole repo make -f example/example.mk example-test # this part only, standalone ``` -Expected: `example suite: 205 passed, 0 failed`. Failure action: reproduce +Expected: `example suite: 261 passed, 0 failed`. Failure action: reproduce through the real stack first (failing route-level test), then fix; the reproduction stays in the suite. Conventions: `tests/README.md`. diff --git a/README.md b/README.md index 5f51c9d..4e5817a 100644 --- a/README.md +++ b/README.md @@ -42,13 +42,13 @@ cause, never silence them. Per-part targets (`google`, `google-test`, `ai`, ## The living example -A route-level demo of every feature, with 205 integration tests on the real +A route-level demo of every feature, with 261 integration tests on the real stack (no mocks). Standalone, no other part needed. ```sh make -f example/example.mk example # build ./build/example/living-server 8080 # run -make -f example/example.mk example-test # expect: 205 passed, 0 failed +make -f example/example.mk example-test # expect: 261 passed, 0 failed ``` Open `http://127.0.0.1:8080/` and click through the matrix. Narrow the @@ -116,6 +116,21 @@ google-token && ./build/google/sa-token` prints an access token. The Agent Platform demo pages are under `/agent/` and, like all `/voice`, `/google`, `/agent` and `/ai` routes, are excluded from locust. +More Google Cloud (plan `plans/18-breadth.md`): `/google/discovery` calls any +method of any of Google's 316 Discovery APIs by id; typed packages are +`/google/cloudai` (Translation, Vision, Language, Video Intelligence, Document +AI, Speech v2), `/google/enterprise` (Discovery Engine, Dialogflow, Retail, +Contact Center Insights, CES), `/google/data` (BigQuery, Storage, Pub/Sub, +Firestore, Spanner, Bigtable, Secret Manager, Dataplex, DLP, KMS), +`/google/maps`, `/google/workspace` (needs domain-wide delegation) and +`/google/ops` (Compute, Run, GKE, IAM, Service Usage, Logging, Monitoring). +Every API with its enable link is in `src/google/APIS.md`. + +More vendors (plan 18, `src/vendors/`): `/ai/compat` (39 OpenAI-compatible +providers, one table row each), `/ai/mistral`, `/ai/cohere`, `/ai/perplexity`, +`/ai/bedrock`, `/ai/azure`, `/ai/huggingface`, `/ai/audio`, `/ai/media`, +`/ai/retrieval`. Env keys are listed in `src/llm/SPEC.md` section 5. + Other vendors (plan `plans/17-llm-vendor-platforms.md`, shared layer `src/llm/SPEC.md`): pages `/ai/xai`, `/ai/xai/platform`, `/ai/anthropic`, `/ai/anthropic/admin`, `/ai/meta`, `/ai/deepseek`, `/ai/openai`, @@ -274,9 +289,13 @@ src/llm shared layer for the vendor platforms below (client, SSE, err src/xai src/anthropic src/meta src/deepseek src/openai src/openrouter whole public API platforms of Grok, Claude, Meta Model API (Muse Spark), DeepSeek, OpenAI and OpenRouter, one dir per work package -src/google Google Cloud: generic client, OAuth + service accounts, voice, and the +src/vendors plan 18 vendors, one dir each: compat (39 OpenAI-compatible providers), + mistral, cohere, perplexity, bedrock (SigV4), azure, huggingface, + audio (ElevenLabs, Deepgram, ...), media (image/video), retrieval +src/google Google Cloud: generic client, OAuth + service accounts, voice, the Gemini Enterprise Agent Platform (models, runtime, sessions, sandbox, - registry, armor, optimize, adk, live), one dir per module + registry, armor, optimize, adk, live) and plan 18 packages (discovery: + all 316 Discovery APIs, cloudai, enterprise, data, maps, workspace, ops) src/cli molo binary: CLI, dev server, embedder, AI, ops, i18n, CSP src/tenancy multi-tenancy src/audit hash-chained audit log, GDPR export/erasure, retention diff --git a/example/SPEC.md b/example/SPEC.md index ee4005f..c1819c5 100644 --- a/example/SPEC.md +++ b/example/SPEC.md @@ -74,6 +74,11 @@ owning sibling plan and the file that will close it. destructive routes are dry runs unless the body has `"confirm":true`. No route test scripts a vendor reply. All `/ai` routes are excluded from locust. +19. Breadth (plan 18): seven Google packages at `/google/` (discovery, + cloudai, enterprise, data, maps, workspace, ops) and ten vendor packages + at `/ai/` (compat, mistral, cohere, perplexity, bedrock, azure, + huggingface, audio, media, retrieval). Same contract as items 17 and 18. + Every `/google` and `/ai` route is excluded from locust. ## Caps diff --git a/plans/18-breadth.md b/plans/18-breadth.md index 45bfd82..0c57c3d 100644 --- a/plans/18-breadth.md +++ b/plans/18-breadth.md @@ -1,6 +1,6 @@ # 18 Breadth: the rest of Google Cloud and every other AI vendor -Status: planned 2026-10-25. Goal: offer as many provider APIs as possible +Status: implemented and merged, 2026-10-25 (all 17 packages; see each package SPEC for what is verified against a published spec, probed live, or unverified). Goal: offer as many provider APIs as possible through the framework, each built the way plans 16 (Google) and 17 (LLM vendors) were built. Read both first: the method, the rules and the caps there apply unchanged unless this file says otherwise. @@ -118,4 +118,27 @@ credential rows to `src/llm/SPEC.md` section 5, update the READMEs and ## 5. Gaps -(filled in at integration) +- No vendor key exists, so every vendor package is verified against its + published spec (or SDK source, or reference pages) and unauthenticated + probes only. No success body was seen from any vendor. +- Most newer Google APIs are not enabled on `lisa-448004` (Pub/Sub, Firestore, + Spanner, Bigtable Admin, DLP, KMS, Translation, Document AI, Video + Intelligence, all Maps, all Workspace, Discovery Engine, Dialogflow, Retail, + Contact Center Insights, CES and several ops products), so those packages are + verified by Discovery only. `src/google/APIS.md` has the enable links. +- Workspace needs domain-wide delegation authorized by a Workspace admin; a + delegated token (`sub`) was refused with `invalid_grant`. +- Maps Geocoding, Time Zone and Elevation refuse OAuth: they need a Maps API key. +- TLS: `src/clients` pins TLS 1.3. `api.mixedbread.com` is TLS 1.2 only (the + whole Mixedbread part is unreachable), and the handshake fails against + sambanova, chutes and qianfan while curl reaches them. Decision needed on + allowing TLS 1.2 for outbound clients (`src/clients/transports/tls_wolfssl.cpp`). +- `src/llm` and `GoogleClient` gaps found by the packages: POST-only streaming + (no GET SSE), JSON-only bodies in `GoogleClient` (media, binary), no + unauthenticated request mode, no per-call timeout or Retry-After, no signing + hook (Bedrock has its own client), no `X-Goog-User-Project` or custom + headers in `GoogleClient`. +- Not built: Midjourney (no public API), Pika (no documented endpoints), + PlayHT (hosts do not resolve), Media Translation (not in Discovery), + GitHub Models, Lambda, Lepton, Hyperbolic, Kluster, Anyscale, Sarvam, Reka + and AI21 (reasons in the compat SPEC section 5). diff --git a/src/google/APIS.md b/src/google/APIS.md index cfe56ee..0ee37b4 100644 --- a/src/google/APIS.md +++ b/src/google/APIS.md @@ -14,7 +14,7 @@ Service Usage (`GET serviceusage.googleapis.com/v1/projects//services//overview?project=` -Fast path for all of them: +Fast path for all of them (the command takes many services at once): ```sh gcloud services enable \ @@ -30,6 +30,77 @@ gcloud services enable \ iamcredentials.googleapis.com \ cloudtrace.googleapis.com \ logging.googleapis.com \ + translate.googleapis.com \ + vision.googleapis.com \ + language.googleapis.com \ + videointelligence.googleapis.com \ + documentai.googleapis.com \ + bigquery.googleapis.com \ + storage.googleapis.com \ + pubsub.googleapis.com \ + firestore.googleapis.com \ + spanner.googleapis.com \ + bigtableadmin.googleapis.com \ + secretmanager.googleapis.com \ + dataplex.googleapis.com \ + dlp.googleapis.com \ + cloudkms.googleapis.com \ + datastore.googleapis.com \ + places.googleapis.com \ + addressvalidation.googleapis.com \ + solar.googleapis.com \ + pollen.googleapis.com \ + airquality.googleapis.com \ + areainsights.googleapis.com \ + routes.googleapis.com \ + geocoding-backend.googleapis.com \ + timezone-backend.googleapis.com \ + elevation-backend.googleapis.com \ + streetviewpublish.googleapis.com \ + apikeys.googleapis.com \ + gmail.googleapis.com \ + drive.googleapis.com \ + calendar-json.googleapis.com \ + sheets.googleapis.com \ + docs.googleapis.com \ + slides.googleapis.com \ + forms.googleapis.com \ + tasks.googleapis.com \ + chat.googleapis.com \ + meet.googleapis.com \ + people.googleapis.com \ + keep.googleapis.com \ + classroom.googleapis.com \ + youtube.googleapis.com \ + youtubeanalytics.googleapis.com \ + youtubereporting.googleapis.com \ + admin.googleapis.com \ + groupssettings.googleapis.com \ + vault.googleapis.com \ + compute.googleapis.com \ + run.googleapis.com \ + cloudfunctions.googleapis.com \ + container.googleapis.com \ + cloudbuild.googleapis.com \ + artifactregistry.googleapis.com \ + iam.googleapis.com \ + cloudresourcemanager.googleapis.com \ + serviceusage.googleapis.com \ + monitoring.googleapis.com \ + cloudscheduler.googleapis.com \ + cloudtasks.googleapis.com \ + workflows.googleapis.com \ + workflowexecutions.googleapis.com \ + eventarc.googleapis.com \ + cloudbilling.googleapis.com \ + cloudasset.googleapis.com \ + orgpolicy.googleapis.com \ + discoveryengine.googleapis.com \ + dialogflow.googleapis.com \ + retail.googleapis.com \ + contactcenterinsights.googleapis.com \ + ces.googleapis.com \ + recommendationengine.googleapis.com \ --project=example-214512124 ``` @@ -39,21 +110,116 @@ gcloud services enable \ |---|---|---|---| | Agent Platform API (Vertex AI) | `aiplatform.googleapis.com` | models, runtime, sessions, sandbox, optimize, adk, live, voice (vertex backend) | [enable](https://console.developers.google.com/apis/api/aiplatform.googleapis.com/overview?project=example-214512124) | | Gemini API | `generativelanguage.googleapis.com` | voice (gemini backend), live (API key) | [enable](https://console.developers.google.com/apis/api/generativelanguage.googleapis.com/overview?project=example-214512124) | -| Cloud Text-to-Speech API | `texttospeech.googleapis.com` | voice (cloud backend) | [enable](https://console.developers.google.com/apis/api/texttospeech.googleapis.com/overview?project=example-214512124) | -| Cloud Speech-to-Text API | `speech.googleapis.com` | voice (cloud backend) | [enable](https://console.developers.google.com/apis/api/speech.googleapis.com/overview?project=example-214512124) | +| Cloud Text-to-Speech API | `texttospeech.googleapis.com` | voice (cloud backend), cloudai | [enable](https://console.developers.google.com/apis/api/texttospeech.googleapis.com/overview?project=example-214512124) | +| Cloud Speech-to-Text API | `speech.googleapis.com` | voice (cloud backend), cloudai | [enable](https://console.developers.google.com/apis/api/speech.googleapis.com/overview?project=example-214512124) | | Model Armor API | `modelarmor.googleapis.com` | armor | [enable](https://console.developers.google.com/apis/api/modelarmor.googleapis.com/overview?project=example-214512124) | | Security Command Center API | `securitycenter.googleapis.com` | armor | [enable](https://console.developers.google.com/apis/api/securitycenter.googleapis.com/overview?project=example-214512124) | | Agent Registry API | `agentregistry.googleapis.com` | registry | [enable](https://console.developers.google.com/apis/api/agentregistry.googleapis.com/overview?project=example-214512124) | | Network Services API | `networkservices.googleapis.com` | registry | [enable](https://console.developers.google.com/apis/api/networkservices.googleapis.com/overview?project=example-214512124) | | Network Security API | `networksecurity.googleapis.com` | registry | [enable](https://console.developers.google.com/apis/api/networksecurity.googleapis.com/overview?project=example-214512124) | -| IAM Service Account Credentials API | `iamcredentials.googleapis.com` | sandbox (data plane JWT) | [enable](https://console.developers.google.com/apis/api/iamcredentials.googleapis.com/overview?project=example-214512124) | +| IAM Service Account Credentials API | `iamcredentials.googleapis.com` | sandbox (data plane JWT), ops | [enable](https://console.developers.google.com/apis/api/iamcredentials.googleapis.com/overview?project=example-214512124) | | Cloud Trace API | `cloudtrace.googleapis.com` | optimize | [enable](https://console.developers.google.com/apis/api/cloudtrace.googleapis.com/overview?project=example-214512124) | -| Cloud Logging API | `logging.googleapis.com` | optimize | [enable](https://console.developers.google.com/apis/api/logging.googleapis.com/overview?project=example-214512124) | +| Cloud Logging API | `logging.googleapis.com` | optimize, ops | [enable](https://console.developers.google.com/apis/api/logging.googleapis.com/overview?project=example-214512124) | +| Cloud Translation API | `translate.googleapis.com` | cloudai | [enable](https://console.developers.google.com/apis/api/translate.googleapis.com/overview?project=example-214512124) | +| Cloud Vision API | `vision.googleapis.com` | cloudai | [enable](https://console.developers.google.com/apis/api/vision.googleapis.com/overview?project=example-214512124) | +| Cloud Natural Language API | `language.googleapis.com` | cloudai | [enable](https://console.developers.google.com/apis/api/language.googleapis.com/overview?project=example-214512124) | +| Cloud Video Intelligence API | `videointelligence.googleapis.com` | cloudai | [enable](https://console.developers.google.com/apis/api/videointelligence.googleapis.com/overview?project=example-214512124) | +| Cloud Document AI API | `documentai.googleapis.com` | cloudai | [enable](https://console.developers.google.com/apis/api/documentai.googleapis.com/overview?project=example-214512124) | +| BigQuery API | `bigquery.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/bigquery.googleapis.com/overview?project=example-214512124) | +| Cloud Storage API | `storage.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/storage.googleapis.com/overview?project=example-214512124) | +| Cloud Pub/Sub API | `pubsub.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/pubsub.googleapis.com/overview?project=example-214512124) | +| Cloud Firestore API | `firestore.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/firestore.googleapis.com/overview?project=example-214512124) | +| Cloud Spanner API | `spanner.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/spanner.googleapis.com/overview?project=example-214512124) | +| Cloud Bigtable Admin API | `bigtableadmin.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/bigtableadmin.googleapis.com/overview?project=example-214512124) | +| Secret Manager API | `secretmanager.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/secretmanager.googleapis.com/overview?project=example-214512124) | +| Cloud Dataplex API | `dataplex.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/dataplex.googleapis.com/overview?project=example-214512124) | +| Sensitive Data Protection (DLP) | `dlp.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/dlp.googleapis.com/overview?project=example-214512124) | +| Cloud Key Management Service (KMS) API | `cloudkms.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/cloudkms.googleapis.com/overview?project=example-214512124) | +| Cloud Datastore API | `datastore.googleapis.com` | data | [enable](https://console.developers.google.com/apis/api/datastore.googleapis.com/overview?project=example-214512124) | +| Places API (New) | `places.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/places.googleapis.com/overview?project=example-214512124) | +| Address Validation API | `addressvalidation.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/addressvalidation.googleapis.com/overview?project=example-214512124) | +| Solar API | `solar.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/solar.googleapis.com/overview?project=example-214512124) | +| Pollen API | `pollen.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/pollen.googleapis.com/overview?project=example-214512124) | +| Air Quality API | `airquality.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/airquality.googleapis.com/overview?project=example-214512124) | +| Places Aggregate API | `areainsights.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/areainsights.googleapis.com/overview?project=example-214512124) | +| Routes API | `routes.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/routes.googleapis.com/overview?project=example-214512124) | +| Geocoding API | `geocoding-backend.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/geocoding-backend.googleapis.com/overview?project=example-214512124) | +| Time Zone API | `timezone-backend.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/timezone-backend.googleapis.com/overview?project=example-214512124) | +| Maps Elevation API | `elevation-backend.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/elevation-backend.googleapis.com/overview?project=example-214512124) | +| Street View Publish API | `streetviewpublish.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/streetviewpublish.googleapis.com/overview?project=example-214512124) | +| API Keys API | `apikeys.googleapis.com` | maps | [enable](https://console.developers.google.com/apis/api/apikeys.googleapis.com/overview?project=example-214512124) | +| Gmail API | `gmail.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/gmail.googleapis.com/overview?project=example-214512124) | +| Google Drive API | `drive.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/drive.googleapis.com/overview?project=example-214512124) | +| Google Calendar API | `calendar-json.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/calendar-json.googleapis.com/overview?project=example-214512124) | +| Google Sheets API | `sheets.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/sheets.googleapis.com/overview?project=example-214512124) | +| Google Docs API | `docs.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/docs.googleapis.com/overview?project=example-214512124) | +| Google Slides API | `slides.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/slides.googleapis.com/overview?project=example-214512124) | +| Google Forms API | `forms.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/forms.googleapis.com/overview?project=example-214512124) | +| Google Tasks API | `tasks.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/tasks.googleapis.com/overview?project=example-214512124) | +| Google Chat API | `chat.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/chat.googleapis.com/overview?project=example-214512124) | +| Google Meet API | `meet.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/meet.googleapis.com/overview?project=example-214512124) | +| People API | `people.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/people.googleapis.com/overview?project=example-214512124) | +| Google Keep API | `keep.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/keep.googleapis.com/overview?project=example-214512124) | +| Google Classroom API | `classroom.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/classroom.googleapis.com/overview?project=example-214512124) | +| YouTube Data API v3 | `youtube.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/youtube.googleapis.com/overview?project=example-214512124) | +| YouTube Analytics API | `youtubeanalytics.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/youtubeanalytics.googleapis.com/overview?project=example-214512124) | +| YouTube Reporting API | `youtubereporting.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/youtubereporting.googleapis.com/overview?project=example-214512124) | +| Admin SDK API | `admin.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/admin.googleapis.com/overview?project=example-214512124) | +| Groups Settings API | `groupssettings.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/groupssettings.googleapis.com/overview?project=example-214512124) | +| Google Vault API | `vault.googleapis.com` | workspace | [enable](https://console.developers.google.com/apis/api/vault.googleapis.com/overview?project=example-214512124) | +| Compute Engine API | `compute.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/compute.googleapis.com/overview?project=example-214512124) | +| Cloud Run Admin API | `run.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/run.googleapis.com/overview?project=example-214512124) | +| Cloud Functions API | `cloudfunctions.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudfunctions.googleapis.com/overview?project=example-214512124) | +| Kubernetes Engine API | `container.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=example-214512124) | +| Cloud Build API | `cloudbuild.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudbuild.googleapis.com/overview?project=example-214512124) | +| Artifact Registry API | `artifactregistry.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/artifactregistry.googleapis.com/overview?project=example-214512124) | +| Identity and Access Management (IAM) API | `iam.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/iam.googleapis.com/overview?project=example-214512124) | +| Cloud Resource Manager API | `cloudresourcemanager.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudresourcemanager.googleapis.com/overview?project=example-214512124) | +| Service Usage API | `serviceusage.googleapis.com` | ops, discovery | [enable](https://console.developers.google.com/apis/api/serviceusage.googleapis.com/overview?project=example-214512124) | +| Cloud Monitoring API | `monitoring.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/monitoring.googleapis.com/overview?project=example-214512124) | +| Cloud Scheduler API | `cloudscheduler.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudscheduler.googleapis.com/overview?project=example-214512124) | +| Cloud Tasks API | `cloudtasks.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudtasks.googleapis.com/overview?project=example-214512124) | +| Workflows API | `workflows.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/workflows.googleapis.com/overview?project=example-214512124) | +| Workflow Executions API | `workflowexecutions.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/workflowexecutions.googleapis.com/overview?project=example-214512124) | +| Eventarc API | `eventarc.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/eventarc.googleapis.com/overview?project=example-214512124) | +| Cloud Billing API | `cloudbilling.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudbilling.googleapis.com/overview?project=example-214512124) | +| Cloud Asset API | `cloudasset.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/cloudasset.googleapis.com/overview?project=example-214512124) | +| Organization Policy API | `orgpolicy.googleapis.com` | ops | [enable](https://console.developers.google.com/apis/api/orgpolicy.googleapis.com/overview?project=example-214512124) | +| Discovery Engine API | `discoveryengine.googleapis.com` | enterprise | [enable](https://console.developers.google.com/apis/api/discoveryengine.googleapis.com/overview?project=example-214512124) | +| Dialogflow API | `dialogflow.googleapis.com` | enterprise | [enable](https://console.developers.google.com/apis/api/dialogflow.googleapis.com/overview?project=example-214512124) | +| AI Commerce Search API | `retail.googleapis.com` | enterprise | [enable](https://console.developers.google.com/apis/api/retail.googleapis.com/overview?project=example-214512124) | +| Contact Center AI Insights API | `contactcenterinsights.googleapis.com` | enterprise | [enable](https://console.developers.google.com/apis/api/contactcenterinsights.googleapis.com/overview?project=example-214512124) | +| Gemini Enterprise for Customer Experience API | `ces.googleapis.com` | enterprise | [enable](https://console.developers.google.com/apis/api/ces.googleapis.com/overview?project=example-214512124) | +| Recommendations AI (Beta) | `recommendationengine.googleapis.com` | enterprise | [enable](https://console.developers.google.com/apis/api/recommendationengine.googleapis.com/overview?project=example-214512124) | Extra steps beyond enabling: -- Security Command Center API: Enabling the API is not enough: Security Command Center must also be activated for the organization (https://console.cloud.google.com/security/command-center). Activation can need an organization-level role and may cost money. -- IAM Service Account Credentials API: The service account also needs `roles/iam.serviceAccountTokenCreator` on the account it signs for. +- Security Command Center API: Enabling the API is not enough: Security Command Center must also be activated for the organization (https://console.cloud.google.com/security/command-center). +- IAM Service Account Credentials API: The service account also needs roles/iam.serviceAccountTokenCreator on the account it signs for. +- Geocoding API: Refuses OAuth (REQUEST_DENIED): needs a Maps Platform API key. +- Time Zone API: Refuses OAuth (REQUEST_DENIED): needs a Maps Platform API key. +- Maps Elevation API: Refuses OAuth (REQUEST_DENIED): needs a Maps Platform API key. +- Street View Publish API: Needs the Street View Publish OAuth scope, not cloud-platform. +- API Keys API: Only needed to create or lint Maps keys; keys themselves are made at the credentials page. +- Gmail API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Drive API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Calendar API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Sheets API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Docs API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Slides API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Forms API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Tasks API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Chat API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Meet API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- People API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Keep API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Classroom API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- YouTube Data API v3: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- YouTube Analytics API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- YouTube Reporting API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Admin SDK API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Groups Settings API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). +- Google Vault API: Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim). ## Credential pages diff --git a/src/google/api_catalog.cpp b/src/google/api_catalog.cpp index f743032..cc152a4 100644 --- a/src/google/api_catalog.cpp +++ b/src/google/api_catalog.cpp @@ -11,23 +11,167 @@ const std::vector& all() { {"generativelanguage.googleapis.com", "Gemini API", "voice (gemini backend), live (API key)", ""}, {"texttospeech.googleapis.com", "Cloud Text-to-Speech API", - "voice (cloud backend)", ""}, + "voice (cloud backend), cloudai", ""}, {"speech.googleapis.com", "Cloud Speech-to-Text API", - "voice (cloud backend)", ""}, - {"modelarmor.googleapis.com", "Model Armor API", "armor", ""}, - {"securitycenter.googleapis.com", "Security Command Center API", "armor", - "Enabling the API is not enough: Security Command Center must also be " - "activated for the organization " - "(https://console.cloud.google.com/security/command-center)."}, - {"agentregistry.googleapis.com", "Agent Registry API", "registry", ""}, - {"networkservices.googleapis.com", "Network Services API", "registry", ""}, - {"networksecurity.googleapis.com", "Network Security API", "registry", ""}, + "voice (cloud backend), cloudai", ""}, + {"modelarmor.googleapis.com", "Model Armor API", + "armor", ""}, + {"securitycenter.googleapis.com", "Security Command Center API", + "armor", "Enabling the API is not enough: Security Command Center must also be activated for the organization (https://console.cloud.google.com/security/command-center)."}, + {"agentregistry.googleapis.com", "Agent Registry API", + "registry", ""}, + {"networkservices.googleapis.com", "Network Services API", + "registry", ""}, + {"networksecurity.googleapis.com", "Network Security API", + "registry", ""}, {"iamcredentials.googleapis.com", "IAM Service Account Credentials API", - "sandbox (data plane JWT)", - "The service account also needs roles/iam.serviceAccountTokenCreator " - "on the account it signs for."}, - {"cloudtrace.googleapis.com", "Cloud Trace API", "optimize", ""}, - {"logging.googleapis.com", "Cloud Logging API", "optimize", ""}, + "sandbox (data plane JWT), ops", "The service account also needs roles/iam.serviceAccountTokenCreator on the account it signs for."}, + {"cloudtrace.googleapis.com", "Cloud Trace API", + "optimize", ""}, + {"logging.googleapis.com", "Cloud Logging API", + "optimize, ops", ""}, + {"translate.googleapis.com", "Cloud Translation API", + "cloudai", ""}, + {"vision.googleapis.com", "Cloud Vision API", + "cloudai", ""}, + {"language.googleapis.com", "Cloud Natural Language API", + "cloudai", ""}, + {"videointelligence.googleapis.com", "Cloud Video Intelligence API", + "cloudai", ""}, + {"documentai.googleapis.com", "Cloud Document AI API", + "cloudai", ""}, + {"bigquery.googleapis.com", "BigQuery API", + "data", ""}, + {"storage.googleapis.com", "Cloud Storage API", + "data", ""}, + {"pubsub.googleapis.com", "Cloud Pub/Sub API", + "data", ""}, + {"firestore.googleapis.com", "Cloud Firestore API", + "data", ""}, + {"spanner.googleapis.com", "Cloud Spanner API", + "data", ""}, + {"bigtableadmin.googleapis.com", "Cloud Bigtable Admin API", + "data", ""}, + {"secretmanager.googleapis.com", "Secret Manager API", + "data", ""}, + {"dataplex.googleapis.com", "Cloud Dataplex API", + "data", ""}, + {"dlp.googleapis.com", "Sensitive Data Protection (DLP)", + "data", ""}, + {"cloudkms.googleapis.com", "Cloud Key Management Service (KMS) API", + "data", ""}, + {"datastore.googleapis.com", "Cloud Datastore API", + "data", ""}, + {"places.googleapis.com", "Places API (New)", + "maps", ""}, + {"addressvalidation.googleapis.com", "Address Validation API", + "maps", ""}, + {"solar.googleapis.com", "Solar API", + "maps", ""}, + {"pollen.googleapis.com", "Pollen API", + "maps", ""}, + {"airquality.googleapis.com", "Air Quality API", + "maps", ""}, + {"areainsights.googleapis.com", "Places Aggregate API", + "maps", ""}, + {"routes.googleapis.com", "Routes API", + "maps", ""}, + {"geocoding-backend.googleapis.com", "Geocoding API", + "maps", "Refuses OAuth (REQUEST_DENIED): needs a Maps Platform API key."}, + {"timezone-backend.googleapis.com", "Time Zone API", + "maps", "Refuses OAuth (REQUEST_DENIED): needs a Maps Platform API key."}, + {"elevation-backend.googleapis.com", "Maps Elevation API", + "maps", "Refuses OAuth (REQUEST_DENIED): needs a Maps Platform API key."}, + {"streetviewpublish.googleapis.com", "Street View Publish API", + "maps", "Needs the Street View Publish OAuth scope, not cloud-platform."}, + {"apikeys.googleapis.com", "API Keys API", + "maps", "Only needed to create or lint Maps keys; keys themselves are made at the credentials page."}, + {"gmail.googleapis.com", "Gmail API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"drive.googleapis.com", "Google Drive API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"calendar-json.googleapis.com", "Google Calendar API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"sheets.googleapis.com", "Google Sheets API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"docs.googleapis.com", "Google Docs API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"slides.googleapis.com", "Google Slides API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"forms.googleapis.com", "Google Forms API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"tasks.googleapis.com", "Google Tasks API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"chat.googleapis.com", "Google Chat API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"meet.googleapis.com", "Google Meet API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"people.googleapis.com", "People API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"keep.googleapis.com", "Google Keep API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"classroom.googleapis.com", "Google Classroom API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"youtube.googleapis.com", "YouTube Data API v3", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"youtubeanalytics.googleapis.com", "YouTube Analytics API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"youtubereporting.googleapis.com", "YouTube Reporting API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"admin.googleapis.com", "Admin SDK API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"groupssettings.googleapis.com", "Groups Settings API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"vault.googleapis.com", "Google Vault API", + "workspace", "Workspace data: needs a Workspace OAuth scope; a service account needs domain-wide delegation authorized by a Workspace admin (subject claim)."}, + {"compute.googleapis.com", "Compute Engine API", + "ops", ""}, + {"run.googleapis.com", "Cloud Run Admin API", + "ops", ""}, + {"cloudfunctions.googleapis.com", "Cloud Functions API", + "ops", ""}, + {"container.googleapis.com", "Kubernetes Engine API", + "ops", ""}, + {"cloudbuild.googleapis.com", "Cloud Build API", + "ops", ""}, + {"artifactregistry.googleapis.com", "Artifact Registry API", + "ops", ""}, + {"iam.googleapis.com", "Identity and Access Management (IAM) API", + "ops", ""}, + {"cloudresourcemanager.googleapis.com", "Cloud Resource Manager API", + "ops", ""}, + {"serviceusage.googleapis.com", "Service Usage API", + "ops, discovery", ""}, + {"monitoring.googleapis.com", "Cloud Monitoring API", + "ops", ""}, + {"cloudscheduler.googleapis.com", "Cloud Scheduler API", + "ops", ""}, + {"cloudtasks.googleapis.com", "Cloud Tasks API", + "ops", ""}, + {"workflows.googleapis.com", "Workflows API", + "ops", ""}, + {"workflowexecutions.googleapis.com", "Workflow Executions API", + "ops", ""}, + {"eventarc.googleapis.com", "Eventarc API", + "ops", ""}, + {"cloudbilling.googleapis.com", "Cloud Billing API", + "ops", ""}, + {"cloudasset.googleapis.com", "Cloud Asset API", + "ops", ""}, + {"orgpolicy.googleapis.com", "Organization Policy API", + "ops", ""}, + {"discoveryengine.googleapis.com", "Discovery Engine API", + "enterprise", ""}, + {"dialogflow.googleapis.com", "Dialogflow API", + "enterprise", ""}, + {"retail.googleapis.com", "AI Commerce Search API", + "enterprise", ""}, + {"contactcenterinsights.googleapis.com", "Contact Center AI Insights API", + "enterprise", ""}, + {"ces.googleapis.com", "Gemini Enterprise for Customer Experience API", + "enterprise", ""}, + {"recommendationengine.googleapis.com", "Recommendations AI (Beta)", + "enterprise", ""}, }; return kApis; } diff --git a/src/llm/SPEC.md b/src/llm/SPEC.md index 3ad95c3..80acca5 100644 --- a/src/llm/SPEC.md +++ b/src/llm/SPEC.md @@ -83,3 +83,20 @@ fetches, so open it by hand. Anthropic's old host `console.anthropic.com` redirects to `platform.claude.com`. Google's keys and the APIs to enable live in `src/google/APIS.md`. +Packages added by plan 18 (`src/vendors//`). Key page status as in the table +above; where a package covers many providers, its own SPEC holds the full +table (provider, env var, page). + +| Package | Env var(s) | Page | +|---|---|---| +| Cohere | `COHERE_API_KEY` | https://dashboard.cohere.com/api-keys (docs) | +| Mistral | `MISTRAL_API_KEY` | package SPEC section 9 | +| Perplexity | `PERPLEXITY_API_KEY` | https://console.perplexity.ai/ (unverified path) | +| Amazon Bedrock | `AWS_BEARER_TOKEN_BEDROCK`, or `AWS_ACCESS_KEY_ID` + `AWS_SECRET_ACCESS_KEY` (+ `AWS_SESSION_TOKEN`), `AWS_REGION` | https://console.aws.amazon.com/iam/home#/security_credentials (unverified) | +| Azure OpenAI / Foundry | `AZURE_OPENAI_ENDPOINT`, `AZURE_OPENAI_API_KEY`, `AZURE_OPENAI_API_VERSION`; Entra: `AZURE_TENANT_ID`, `AZURE_CLIENT_ID`, `AZURE_CLIENT_SECRET`; optional `AZURE_AI_ENDPOINT`, `AZURE_CONTENT_SAFETY_ENDPOINT`, `AZURE_CONTENT_SAFETY_KEY`, `AZURE_AUTHORITY_HOST` | Azure portal, package SPEC section 12 | +| Hugging Face | `HF_TOKEN` | https://huggingface.co/settings/tokens (docs) | +| Audio | `ELEVENLABS_API_KEY`, `ASSEMBLYAI_API_KEY`, `DEEPGRAM_API_KEY`, `CARTESIA_API_KEY`, `SPEECHMATICS_API_KEY`, `SPEECHMATICS_MANAGEMENT_TOKEN`, `HUME_API_KEY` | package SPEC section on credentials | +| Media | `STABILITY_API_KEY`, `BFL_API_KEY`, `RUNWAY_API_KEY` (or `RUNWAYML_API_SECRET`), `LUMA_API_KEY`, `REPLICATE_API_TOKEN`, `FAL_KEY`, `IDEOGRAM_API_KEY`, `RECRAFT_API_TOKEN`, `LEONARDO_API_KEY`, `MINIMAX_API_KEY`, `KLING_ACCESS_KEY` + `KLING_SECRET_KEY`, `HF_API_KEY_ID` + `HF_API_KEY_SECRET` (Higgsfield) | package SPEC section on credentials | +| Retrieval | `VOYAGE_API_KEY`, `JINA_API_KEY`, `PINECONE_API_KEY`, `QDRANT_API_KEY` + `QDRANT_URL`, `WEAVIATE_API_KEY` + `WEAVIATE_URL`, `MXBAI_API_KEY`, `TAVILY_API_KEY`, `EXA_API_KEY`, `BRAVE_API_KEY` | package SPEC | +| Compat (39 providers) | one env var per row, e.g. `GROQ_API_KEY`, `NEBIUS_API_KEY`, `UPSTAGE_API_KEY` | `src/vendors/compat/SPEC.md` section 4 | + diff --git a/src/llm/error.cpp b/src/llm/error.cpp index a9f80f5..c8feec2 100644 --- a/src/llm/error.cpp +++ b/src/llm/error.cpp @@ -56,6 +56,16 @@ ApiError error_from_response(const std::string& vendor, message = err->as_string(); } else if (doc.is_object()) { std::string m = text_of(doc.find("message")); + // FastAPI-style envelope: {"detail":"text"} or {"detail":[{"msg":"text"}]}. + if (m.empty()) { + const Json* d = doc.find("detail"); + if (d && d->is_array() && !d->as_array().empty()) { + const Json& first = d->as_array().front(); + m = first.is_object() ? text_of(first.find("msg")) : text_of(&first); + } else { + m = text_of(d); + } + } if (!m.empty()) message = m; std::string t = text_of(doc.find("type")); if (t.empty()) t = text_of(doc.find("code")); diff --git a/tests/src/google/test_api_catalog.cpp b/tests/src/google/test_api_catalog.cpp index 7ec3b60..7fa9447 100644 --- a/tests/src/google/test_api_catalog.cpp +++ b/tests/src/google/test_api_catalog.cpp @@ -17,7 +17,7 @@ TEST(api_catalog, services_unique_and_well_formed) { ASSERT_FALSE(api.title.empty()); ASSERT_FALSE(api.used_by.empty()); } - ASSERT_TRUE(apis::all().size() >= 12u); + ASSERT_TRUE(apis::all().size() >= 80u); } TEST(api_catalog, enable_url_matches_google_activation_page) { diff --git a/tests/src/llm/test_llm.cpp b/tests/src/llm/test_llm.cpp index af55ba1..ae7116c 100644 --- a/tests/src/llm/test_llm.cpp +++ b/tests/src/llm/test_llm.cpp @@ -84,6 +84,8 @@ TEST(llm, error_envelopes) { {"{\"type\":\"error\",\"error\":{\"type\":\"not_found_error\",\"message\":\"nope\"}}", 404, "not_found_error", "nope"}, {"{\"error\":{\"code\":\"rate_limit_exceeded\",\"message\":\"slow\"}}", 429, "rate_limit_exceeded", "slow"}, {"{\"error\":\"plain text error\"}", 400, "UNKNOWN", "plain text error"}, + {"{\"detail\":\"Invalid API Key\"}", 401, "UNKNOWN", "Invalid API Key"}, + {"{\"detail\":[{\"msg\":\"field required\"}]}", 422, "UNKNOWN", "field required"}, {"{\"message\":\"top level\",\"code\":\"E42\"}", 400, "E42", "top level"}, {"bad gateway", 400, "UNKNOWN", "HTTP 400"}, };