# Ollama Crowd-Funded Server Welcome to the **Ollama Crowd-Funded Server**! This server allows you to communicate with Ollama models using official JavaScript or Python clients. The servers are generously provided by individuals who contribute their resources. ## Table of Contents - [Using the Ollama Server](#using-the-ollama-server) - [WebSocket Client](#websocket-client) - [Installation](#installation) - [Usage](#usage) - [Contributing](#contributing) - [License](#license) ## Using the Ollama Server To use the Ollama server, simply utilize the original client with the provided URL. Below is an example of how to use the Ollama client in Python: ```python from ollama import Client client = Client( host="https://ollama.molodetz.nl" ) messages = [] def chat(message): if message: messages.append({'role': 'user', 'content': message}) content = '' for response in client.chat(model='qwen2.5-coder:0.5b', messages=messages, stream=True): content += response.message.content print(response.message.content, end='', flush=True) messages.append({'role': 'assistant', 'content': content}) print("") while True: message = input("You: ") chat(message) ``` ## WebSocket Client The `client.py` script is an asynchronous WebSocket client for the Ollama API. It connects to the Ollama server, fetches available models, and listens for messages. ### Features - Asynchronous WebSocket connections using `aiohttp`. - Fetches available models from the Ollama API. - Logs received data and errors. - Supports concurrent WebSocket connections. ### Installation To run the WebSocket client, ensure you have Python 3.7 or higher installed. You can install the required dependencies using pip: ```bash pip install aiohttp ``` ### Usage You can run the WebSocket client with the following command: ```bash python client.py --concurrency <number_of_connections> --ollama_url <ollama_api_url> ``` - `--concurrency`: Number of concurrent WebSocket connections (default: 4). - `--ollama_url`: Ollama API URL (default: `https://localhost:11434`). ### Example To run the client with the default settings: ```bash python client.py ``` ## Contributing Contributions are welcome! If you would like to contribute to the project, please fork the repository and submit a pull request. ## License This project is licensed under the MIT License. See the [LICENSE](LICENSE) file for more details.