docs: adds image for network visualization
Build & Deploy / build (push) Successful in 2m12s

This commit is contained in:
2026-07-15 01:32:23 +02:00
parent 642ad1d9e4
commit d69769fb28
3 changed files with 33 additions and 4 deletions
+2 -1
View File
@@ -8,4 +8,5 @@
*.sqlite-wal *.sqlite-wal
.vs/ .vs/
**appsettings.Development.json **appsettings.Development.json
!**/appsettings.Example.json !**/appsettings.Example.json
debug/**
+31 -3
View File
@@ -1,10 +1,38 @@
# ReverseLlama # ReverseLlama
(Eigenentwicklung; weitesgehend vibecoded) ReverseLlama is a small outbound HTTP tunnel for running Ollama (or vLLM, etc.) on GPU workstations while exposing the API from a server that cannot reach those workstations directly.
ReverseLlama is a small outbound HTTP tunnel for testing Ollama on GPU workstations while exposing the API from a server that cannot reach those workstations directly. The client opens and maintains a WebSocket connection to the server. The server accepts normal HTTP requests and forwards them through that WebSocket to the client. The client then calls a local upstream such as `http://localhost:11434` and streams the response back.
The client opens a WebSocket connection to the server. The server accepts normal HTTP requests and forwards them through that WebSocket to the client. The client then calls a local upstream such as `http://localhost:11434` and streams the response back. <table>
<tr>
<td><img src="docs/README_architecture.png" width="1400" alt="client-server architecture visualized using arrows"></td>
<td>
The server provides
- An API with
- Authentication via API keys
- Authorization (planned)
- Load balancing (Scale your AI strategy horizontally!)
- (Ollama-only) Model management (install, remove, load, unload models)
- Client monitoring
- Who is active
- What models are running
- How many requests is each client processing
- How many requests has each client processed
- Group management (planned)
- Who can access which models
- What clients are mapped to which groups
- Billing (planned)
- (planned) Price per model per thousand tokens
- (planned) Usage per API user
- (planned) Rate limiting
The client provides a persistent outbound connection to the server and forwards requests to the local Ollama (or vLLM, etc.) instance. Responses stream back through the tunnel with minimal overhead.
</td>
</tr>
</table>
## Projects ## Projects
Binary file not shown.

After

Width:  |  Height:  |  Size: 147 KiB