Let the gateway target non-OpenAI upstreams and allow client model passthrough
gateway_thinking_dialect overrides the URL-sniffed protocol dialect for a reverse-proxied upstream (e.g. Ollama) whose URL carries no identifying token; upstream_capabilities() uses the same effective dialect to stop sending stream_options to upstreams that don't support it. gateway_allow_client_model lets a client-requested model name through even with force-model on, for an upstream that serves many models with no single stable alias. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XjW4qocnaJxhugUi5ca8Wo
This commit is contained in:
@@ -91,6 +91,7 @@ class VisionAugmenter:
|
||||
cache: VisionCache,
|
||||
referer: str = "",
|
||||
title: str = "",
|
||||
vision_dialect: str = "",
|
||||
ledger=None,
|
||||
owner: tuple = ("unknown", "unknown"),
|
||||
pricing=None,
|
||||
@@ -103,6 +104,7 @@ class VisionAugmenter:
|
||||
self.cache = cache
|
||||
self.referer = referer
|
||||
self.title = title
|
||||
self.vision_dialect = vision_dialect
|
||||
self.ledger = ledger
|
||||
self.owner = owner
|
||||
self.pricing = pricing
|
||||
@@ -154,7 +156,7 @@ class VisionAugmenter:
|
||||
"temperature": 0.2,
|
||||
"stream": False,
|
||||
}
|
||||
apply_thinking(payload, self.vision_url, default_enabled=False)
|
||||
apply_thinking(payload, self.vision_url, default_enabled=False, dialect=self.vision_dialect)
|
||||
headers = {
|
||||
"Authorization": f"Bearer {self.vision_key}",
|
||||
"Content-Type": "application/json",
|
||||
|
||||
Reference in New Issue
Block a user