RedPajama-INCITE
A family of open-source models trained on the RedPajama dataset.
Overview
The RedPajama-INCITE family of models is a set of open-source large language models developed by Together AI and a consortium of other organizations. These models are trained on the RedPajama dataset, a 1.2 trillion token, fully open-source reproduction of the data used to train the LLaMA models. The RedPajama-INCITE family includes base models, instruction-tuned models, and chat models of various sizes.
✨ Key Features
- Trained on the open-source RedPajama dataset
- Includes base, instruction-tuned, and chat models
- Available in various sizes (e.g., 3B, 7B)
- Aims to replicate the LLaMA recipe with open data and models
🎯 Key Differentiators
- Based on a fully open-source reproduction of the LLaMA training data
- Provides a complete suite of base, instruction-tuned, and chat models
Unique Value: Provides a fully open-source and reproducible alternative to the LLaMA family of models.
🎯 Use Cases (4)
🏆 Alternatives
Offers a complete ecosystem of data and models for building on the LLaMA architecture in a fully open manner.
💻 Platforms
✅ Offline Mode Available
🔌 Integrations
💰 Pricing
Free tier: Free to use.
🔄 Similar Tools in Open Source LLMs
Meta Llama 3
A family of pretrained and instruction-tuned generative text models from Meta....
Mistral AI
A French company specializing in high-performance, efficient, and accessible large language models....
EleutherAI
A non-profit AI research group focused on open-source AI research and the development of large langu...
Qwen
A series of large language and multimodal models developed by Alibaba Cloud, with many variants dist...
Google Gemma
A family of lightweight, open models built from the same research and technology used to create the ...
Falcon
A family of open-source large language models available in various parameter sizes, released under t...