Difference between revisions of "AI compute"
KevinYager (talk | contribs) (→Cloud LLM Routers & Inference Providers) |
KevinYager (talk | contribs) (→Cloud LLM Routers & Inference Providers) |
||
| Line 27: | Line 27: | ||
* [https://www.together.ai/ Together AI] | * [https://www.together.ai/ Together AI] | ||
* [https://hyperbolic.xyz/ Hyperbolic AI] | * [https://hyperbolic.xyz/ Hyperbolic AI] | ||
| + | |||
| + | ==Local Router== | ||
| + | * [https://ollama.com/ Ollama] | ||
| + | * [https://github.com/mudler/LocalAI LocalAI] | ||
==Acceleration Hardware== | ==Acceleration Hardware== | ||
Revision as of 10:28, 19 February 2025
Contents
Cloud GPU
Cloud Training Compute
Cloud LLM Routers & Inference Providers
- OpenRouter (open and closed models, no Enterprise tier)
- LiteLLM (closed models, Enterprise tier)
- Cent ML (open models, Enterprise tier)
- Fireworks AI (open models, Enterprise tier)
- Abacus AI (open and closed models, Enterprise tier)
- Portkey (open? and closed models, Enterprise tier)
- Huggingface Inference Providers Hub
Multi-model Web Chat Interfaces
Multi-model Web Playground Interfaces
Local Router
Acceleration Hardware
- Nvidia GPUs
- Google TPU
- Etched: Transformer ASICs
- Cerebras
- Untether AI
- Graphcore
- SambaNova Systems
- Groq
- Tesla Dojo
- Deep Silicon: Combined hardware/software solution for accelerated AI (e.g. ternary math)
