← Back to Search
📦 Repository Details
OpenLLM
bentoml/OpenLLM
🐙 GitHub
🤖 LLM Infrastructure
Python
⭐ 11909
Stars
🔱 786
Forks
🐙 View on GitHub
🌐 Homepage
📝 Description
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
🏷️ Topics
bentoml
fine-tuning
llama
llama2
llama3-1
llama3-2
llama3-2-vision
llm
llm-inference
llm-ops
llm-serving
llmops
mistral
mlops
model-inference
open-source-llm
openllm
vicuna
💻 Languages
Python (65602.0%)
Shell (2809.0%)
📊 Repository Information
Scanned
2025-11-05 05:53:24
Platform ID
2586
👥 Developers (10)
Aaron Pham
🐙 aarnphm
📧 contact@aarnphm.xyz
85
Quality
Alan Poulain
🐙 alanpoulain
📧 contact@alanpoulain.eu
45
Quality
Unknown
🐙 GutZuFusss
📧 leon.ikinger@googlemail.com
45
Quality
Frost Ming
🐙 frostming
📧 me@frostming.com
45
Quality
Chaoyu
🐙 parano
📧 paranoyang@gmail.com
45
Quality
Unknown
🐙 bojiang
📧 bojiang_@outlook.com
39
Quality
Zhao Shenyang
🐙 larme
📧 dev@zsy.im
36
Quality
Rick Zhou
🐙 rickzx
📧 rickzhoucmu@gmail.com
36
Quality
Fazli Sapuan
🐙 fuzzie360
📧 fazli@sapuan.org
35
Quality
Jian Shen
🐙 jianshen92
📧 jianshen92@gmail.com
25
Quality