Ollama Crowd-Funded Server
Welcome to the Ollama Crowd-Funded Server! This server allows you to communicate with Ollama models using official JavaScript or Python clients. The servers are generously provided by individuals who contribute their resources.
Table of Contents
Using the Ollama Server
To use the Ollama server, simply utilize the original client with the provided URL. Below is an example of how to use the Ollama client in Python:
from ollama import Client
client = Client(
host="https://ollama.molodetz.nl"
)
messages = []
def chat(message):
if message:
messages.append({'role': 'user', 'content': message})
content = ''
for response in client.chat(model='qwen2.5-coder:0.5b', messages=messages, stream=True):
content += response.message.content
print(response.message.content, end='', flush=True)
messages.append({'role': 'assistant', 'content': content})
print("")
while True:
message = input("You: ")
chat(message)
WebSocket Client
The client.py script is an asynchronous WebSocket client for the Ollama API. It connects to the Ollama server, fetches available models, and listens for messages.
Features
- Asynchronous WebSocket connections using
aiohttp. - Fetches available models from the Ollama API.
- Logs received data and errors.
- Supports concurrent WebSocket connections.
Installation
To run the WebSocket client, ensure you have Python 3.7 or higher installed. You can install the required dependencies using pip:
pip install aiohttp
Usage
You can run the WebSocket client with the following command:
python client.py --concurrency <number_of_connections> --ollama_url <ollama_api_url>
--concurrency: Number of concurrent WebSocket connections (default: 4).--ollama_url: Ollama API URL (default:https://localhost:11434).
Example
To run the client with the default settings:
python client.py
Contributing
Contributions are welcome! If you would like to contribute to the project, please fork the repository and submit a pull request.
License
This project is licensed under the MIT License. See the LICENSE file for more details.
| .gitignore | |
| client.py | |
| documentation.html | |
| index.html | |
| Makefile | |
| README.md | |
| requirements.txt | |
| server.py | |
| test_openai_api.py | |
| test.py |