Project Documentation

Overview

This project implements a WebSocket client and server for the Ollama API, allowing users to communicate with an Ollama server. The server is designed to handle multiple concurrent connections and stream responses back to clients.

File Structure

• client.py: The WebSocket client that connects to the Ollama API and handles message sending and receiving.
• index.html: The HTML interface for the Ollama Crowd-Funded Server, providing instructions and usage examples.
• Makefile: A build script for setting up the project environment, running the server, and executing tests.
• prompt.txt: Contains instructions for maintaining code consistency and logging practices.
• requirements.txt: Lists the Python dependencies required for the project.
• server.py: The WebSocket server that manages connections and forwards messages between clients and the Ollama API.
• test.py: Contains tests for the functionality of the client and server.

Client Implementation (client.py)

The client connects to the Ollama API via WebSocket and handles incoming messages. It supports concurrent connections and logs important events.

Key Functions

• websocket_client(url: str, ollama_url: str): Connects to the WebSocket server and handles message exchange.
• main(concurrency: int, ollama_url: str): Initializes multiple WebSocket connections based on the specified concurrency level.
• validate_url(url: str): Validates the provided URL format.

Server Implementation (server.py)

The server listens for incoming WebSocket connections and manages message forwarding to and from the Ollama API.

Key Classes

• OllamaServer: Manages individual WebSocket connections and message queues.
• ServerManager: Manages multiple OllamaServer instances and forwards messages between them.

Key Functions

• websocket_handler(request): Handles incoming WebSocket connections and initializes OllamaServer.
• http_handler(request): Handles HTTP requests and forwards them to the appropriate WebSocket server.

HTML Interface (index.html)

The HTML file provides a user-friendly interface for interacting with the Ollama server. It includes instructions for using the server and a code snippet for the client.

Build and Run Instructions (Makefile)

To set up the project, run the following commands:

1. Install dependencies:

   make install

2. Start the server:

   make server

3. Run the client:

   make client

4. Execute tests:

   make test

Dependencies (requirements.txt)

The project requires the following Python packages:

• aiohttp: For asynchronous HTTP and WebSocket handling.

Testing (test.py)

The test file contains unit tests to ensure the functionality of the client and server components.

Contribution

Contributions to improve the project are welcome. Please follow the standard practices for submitting issues and pull requests.

License

This project is licensed under the MIT License.