modelgrid.com/modelgrid
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 2 Wiki Activity

docs(readme): remove stale runtime references

Browse Source
This commit is contained in:
Jürgen Kunz
2026-04-21 12:45:52 +00:00
parent 0ea98caed6
commit 5e8ce6690d
2 changed files with 8 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files
readme.hints.md
+3 -4
View File
@@ -3,7 +3,7 @@
## Project Overview
ModelGrid is a root-level daemon that manages GPU infrastructure, Docker, and AI model containers
(Ollama, vLLM, TGI) with an OpenAI-compatible API interface.
(vLLM, TGI) with an OpenAI-compatible API interface.
## Architecture
@@ -84,13 +84,12 @@ ts/
### Greenlit Model System
- Only pre-approved models can be auto-pulled for security
- Greenlist fetched from remote URL (configurable)
- Only catalog-listed models can be auto-deployed on demand
- Catalog fetched from a remote URL (configurable)
- VRAM requirements checked before loading
### Container Types
- **Ollama**: Easy to use, native API converted to OpenAI format
- **vLLM**: High performance, natively OpenAI-compatible
- **TGI**: HuggingFace Text Generation Inference