Petals
Run LLMs at home BitTorrent-style - distributed inference
About Petals
Run LLMs at home BitTorrent-style - distributed inference.
Petals is open source, is completely free to use.
Platform Support
Available for: Windows, macOS, Linux
System Requirements
- Minimum RAM: 8 GB
- GPU: Required for best performance
Links
Official Website · GitHub Repository
Full description coming soon. Check the official website or GitHub for more details.
Frequently Asked Questions
What is Petals?
Run LLMs at home BitTorrent-style - distributed inference ## About Petals Run LLMs at home BitTorrent-style - distributed inference. Petals is open source, is completely free to use. ### Platform Support Available for: **Windows, macOS, Linux** ### Syst...
Is Petals free?
Yes, Petals is completely free to use. It's also open source.
Does Petals work offline?
Petals may require an internet connection for some features.
What platforms does Petals support?
Petals is available for Windows, macOS, Linux.
Related Tools
View all →
Ollama
Run large language models locally with a simple CLI interface
LM Studio
Discover, download, and run local LLMs with an easy-to-use desktop app
Jan
Open-source ChatGPT alternative that runs 100% offline on your computer
GPT4All
Free-to-use, locally running, privacy-aware chatbot by Nomic AI
Text Generation WebUI
The AUTOMATIC1111 of text generation - maximum control for LLMs
KoboldCpp
Easy-to-use AI text generation software for GGML/GGUF models