AI & LLM Platforms
Compare 158 ai & llm platforms tools to find the right one for your needs
📂 Subcategories
📁 AI Guardrails & Safety
📁 AI Observability & Monitoring
📁 LLM API Providers
📁 LLM Evaluation & Testing
📁 LLM Fine-Tuning Platforms
📁 LLM Hosting & Inference
📁 LLM Routers & Gateways
📁 Multimodal AI Platforms
📁 Open Source LLMs
📁 Prompt Engineering Tools
🔧 Tools
Compare and find the best ai & llm platforms for your needs
Lakera Guard
Protects LLM applications from prompt injection, jailbreaks, and malicious misuse in real-time.
Langfuse
An open-source platform for LLM observability, evals, prompt management, and metrics to debug and improve LLM applications.
Portkey AI
An AI gateway and observability suite that helps teams build reliable, production-grade AI applications faster.
Pynt
An innovative API Security testing platform that exposes real API threats through simulated attacks.
Langfuse
An open-source platform for tracing, debugging, and evaluating LLM applications, helping teams build better products faster.
Groq
A company that builds custom hardware and software for accelerating AI inference.
Portkey
An AI gateway that provides observability, routing, caching, and security for LLM applications, helping teams ship reliable products faster.
Together AI
A cloud platform for building and running generative AI models, with a focus on open-source models.
CoreWeave
A specialized cloud provider offering high-performance GPU compute for AI and machine learning workloads.
Fireworks AI
A platform for developers to run, fine-tune, and share large language models, with a focus on speed and affordability.
OctoAI
A platform for running, tuning, and scaling open-source and custom AI models with a focus on performance and efficiency.
Lambda Labs
Provides AI infrastructure including GPU cloud, clusters, and workstations for training AI models.
Anthropic
An AI safety and research company focused on developing helpful, harmless, and honest AI systems.
Weights & Biases
A tool for tracking experiments, versioning data, and managing models for machine learning.
Predibase
A low-code AI platform for fine-tuning and serving open-source LLMs efficiently.
Braintrust
An enterprise-grade platform for evaluating and monitoring LLM applications, helping teams build reliable AI products.
Mistral AI
A European company developing open and proprietary high-performance language models.
Weights & Biases
A platform for tracking experiments, versioning data, and managing models, with growing support for LLM evaluation and observability.
Deepchecks
An open-source and enterprise platform for testing and validating machine learning models and data, with a focus on LLM applications.
Helicone
An open-source platform for monitoring LLM usage, managing costs, and improving performance through a simple proxy integration.
Replicate
A platform for running and sharing open-source machine learning models in the cloud.
Arthur AI
An AI performance company that helps accelerate model operations for accuracy, explainability, and fairness.
Arthur AI
An AI performance monitoring and observability platform that ensures the reliability, security, and compliance of AI systems.
Aporia
A comprehensive platform for AI observability, governance, and performance, ensuring models are reliable and aligned with business goals.
Anthropic Claude 3.5
A family of AI models (Haiku, Sonnet, and Opus) with advanced vision capabilities, focused on safety and enterprise use cases.
ZenML
An open-source MLOps framework for creating portable, production-ready AI pipelines, from traditional ML to LLM workflows.
Evidently AI
An open-source Python library and platform to evaluate, test, and monitor ML models from validation to production.
Galileo AI
An observability and evaluation platform that helps teams ship reliable AI agents faster by automating evaluations and providing real-time protection.
Weights & Biases
A platform for tracking experiments, versioning data and models, and managing the MLOps lifecycle, including LLM observability.
Hugging Face
A platform and community hub for open-source AI, providing tools, models, and datasets for building and deploying machine learning applications.
Perplexity AI
An AI-powered answer engine that provides direct, sourced responses to questions by searching the web in real-time.
OpenAI GPT-4o
A multimodal AI model that can process and generate text, audio, and image inputs and outputs.
Superwise
An AI observability platform that helps teams monitor, manage, and optimize their models in production with a focus on business KPIs.
WhyLabs
An AI observability platform for monitoring data and model health, now with its platform open-sourced after discontinuing commercial operations.
Hugging Face
A platform for the machine learning community to collaborate on models, datasets, and applications.
Cohere
An AI platform for enterprises, providing access to advanced large language models and RAG capabilities.
Hugging Face
A platform that provides tools for building, training, and deploying state-of-the-art machine learning models.
Anyscale
A fully-managed platform for scaling AI and Python applications, built on the open-source Ray framework.
Perplexity AI
An AI-powered answer engine that provides direct, accurate answers to questions with cited sources.
OpenAI
A research and deployment company that aims to ensure that artificial general intelligence benefits all of humanity.
Writer
An enterprise-focused generative AI platform that helps businesses create consistent and on-brand content.
LangSmith
A platform from the creators of LangChain for debugging, testing, evaluating, and monitoring LLM applications.
OpenAI
An AI research and deployment company offering powerful language models like GPT-4 for various applications.
Snorkel AI
A data-centric AI platform for building and managing foundation models with enterprise data.
Arize AI
An end-to-end platform for ML observability and evaluation, helping teams monitor, troubleshoot, and improve AI models in production.
Comet ML
An MLOps platform for experiment tracking, model management, and LLM observability, helping teams build and deploy AI faster.
Hugging Face
A platform hosting a vast collection of open-source models, datasets, and tools for building with machine learning.
Replicate
A platform for running and fine-tuning open-source machine learning models in the cloud with a simple API.
Comet
An MLOps platform for tracking, comparing, explaining, and optimizing machine learning models.
Replicate
A platform for running and fine-tuning open-source machine learning models with a simple API.
AI21 Labs
An AI company specializing in natural language processing and building AI systems with a deep understanding of language.
Galileo
An enterprise-grade platform for evaluating, monitoring, and optimizing LLM applications, with a focus on production readiness.
Perplexity AI
An AI-powered answer engine that provides accurate, trusted, and real-time answers to questions.
WhyLabs
An AI observability platform that prevents AI failures by monitoring data pipelines and machine learning models in production.
Scale AI
A data-centric AI platform for managing the entire generative AI lifecycle, from data to deployment.
Anyscale
A fully managed platform for scaling AI and Python applications, built on the open-source Ray framework.
Cohere
An AI platform providing state-of-the-art large language models and RAG capabilities tailored for enterprise use cases.
Runway Gen-3 Alpha
A multimodal AI platform focused on generating and editing video from text, images, or other videos.
Google Gemini
A family of multimodal AI models (Ultra, Pro, and Nano) that can understand and operate across text, code, images, audio, and video.
Arize AI
An AI observability and LLM evaluation platform for monitoring, troubleshooting, and improving machine learning models.
TruEra
An AI observability platform providing LLM and predictive AI observability across the full lifecycle. Acquired by Snowflake.
Galileo AI Guardrails
Measures AI accuracy, offline and online, with out-of-the-box and custom evaluators.
Robust Intelligence AI Firewall
An AI Firewall that protects AI models from malicious inputs and outputs.
AI21 Labs
An AI company specializing in generative AI and large language models for enterprise solutions and consumer applications.
Amazon Titan
A family of foundation models (FMs) created by AWS and available exclusively in Amazon Bedrock, offering multimodal capabilities.
Adobe Firefly
A family of creative generative AI models designed to be commercially safe and integrated into Adobe's Creative Cloud workflows.
Helicone
An LLM observability platform and AI gateway for monitoring, evaluating, and experimenting with LLM applications.
Fiddler AI
An AI observability platform for monitoring, explaining, analyzing, and improving ML and LLM models at scale.
Microsoft Copilot
An AI assistant from Microsoft that integrates web search, large language models, and image generation into a single experience.
Dynatrace
An AI-powered platform providing unified observability, security, and business analytics for modern multi-cloud environments.
Seldon
An enterprise platform for deploying, managing, and monitoring machine learning models at scale, with a focus on governance and risk.
Meta Llama 3.1
A family of open-source large language models with vision capabilities, designed for a wide range of applications from research to commercial use.
Midjourney
An AI-powered image generation service that creates high-quality, artistic images from natural language prompts.
Databricks
A unified data and AI platform that combines data warehousing and AI into a single environment.
Amazon Bedrock
A fully managed service that offers a choice of high-performing foundation models from leading AI companies via a single API.
Verta.ai
An MLOps platform for managing, deploying, and monitoring the entire model lifecycle.
DataRobot
An end-to-end enterprise AI platform that automates the machine learning lifecycle.
Databricks
A unified data and AI platform that helps organizations build, deploy, and manage data and AI applications.
Fiddler AI
A platform for ML model monitoring, explainable AI, and fairness analysis, helping organizations build responsible and trustworthy AI.
CalypsoAI
An enterprise platform for securing and managing the use of large language models, ensuring safe and compliant adoption of AI.
MLflow
An open-source platform to manage the ML lifecycle, including experimentation, reproducibility, deployment, and a central model registry.
Anyscale
A platform from the creators of Ray for scaling ML and AI workloads from development to production.
OctoML
A platform for optimizing and deploying machine learning models for efficient inference on any hardware.
NVIDIA AI Enterprise
A suite of NVIDIA software for developing and deploying production AI.
Microsoft Azure AI
Microsoft's suite of AI services for building and deploying intelligent applications on Azure.
Google Vertex AI
A unified MLOps platform to help customers build, deploy, and scale machine learning models.
Google Vertex AI
Google Cloud's unified MLOps platform for building, deploying, and scaling machine learning models.
Amazon SageMaker
AWS's fully managed service for the entire machine learning lifecycle.
Datadog LLM Observability
An extension of the Datadog platform providing end-to-end visibility into LLM applications, from infrastructure to model performance.
IBM watsonx
An AI and data platform from IBM for building, scaling, and governing AI applications.
Logz.io
An open-source based observability platform that unifies logs, metrics, and traces, with AI-powered analytics.
Stability AI (Stable Diffusion)
An open-source AI company that develops a range of generative models for images, video, audio, and language, including the popular Stable Diffusion.
IBM watsonx
An enterprise-ready AI and data platform with a suite of foundation models and tools for building and scaling AI applications.
New Relic
A full-stack observability platform that provides monitoring for infrastructure, applications, and now, AI-powered applications.
Datadog LLM Observability
Provides end-to-end visibility for large language model (LLM) applications, from the infrastructure to the model itself.
Salesforce Einstein 1 Platform
An AI platform that integrates generative and predictive AI capabilities across the Salesforce ecosystem, grounded in customer data.
Alibaba Cloud Qwen2
A series of open-source and proprietary large language and vision models developed by Alibaba Cloud.
Amazon SageMaker
A fully managed service from AWS for the entire machine learning lifecycle.
Oracle Cloud Infrastructure AI
A suite of AI services and infrastructure from Oracle Cloud.
Mistral AI
A French company specializing in high-performance, efficient, and accessible large language models.
EleutherAI
A non-profit AI research group focused on open-source AI research and the development of large language models.
Groq
An AI company building Language Processing Units (LPUs) for ultra-fast inference of AI workloads.
Lamini
An enterprise platform for building reliable, high-performance LLMs on your private data.
MPT-30B
A 30-billion parameter open-source model from MosaicML, licensed for commercial use and outperforming GPT-3.
Banana.dev
A serverless GPU platform for deploying and scaling machine learning models for high-throughput inference.
DeepSpeed-Chat
A framework from Microsoft's DeepSpeed team for easily and efficiently training high-quality, ChatGPT-style models using RLHF.
RedPajama-INCITE
A set of open-source language models from Together AI, trained on the RedPajama dataset, which is an open-source reproduction of the LLaMA training data.
Together AI
A cloud platform providing fast and cost-effective infrastructure for training, fine-tuning, and running generative AI models.
Pythia
A suite of 16 language models from EleutherAI, all trained on the same public data in the same order, designed for scientific research on LLMs.
OctoML
A platform for running and optimizing AI models for efficient performance across various hardware.
Cerebras-GPT
A family of seven open-source GPT models from Cerebras Systems, trained to be compute-efficient.
OpenLLaMA
A permissively licensed open-source reproduction of Meta AI's LLaMA large language model.
PromptLayer
Track, manage, and share your GPT prompt engineering.
Helicone
An observability platform for LLMs that helps you monitor, debug, and analyze your language model usage.
PromptPerfect
Unlock prompt optimization for models like GPT-4, ChatGPT and Midjourney.
Stability AI StableLM
A family of open-source language models from Stability AI, available in various sizes and designed for a range of text and code generation tasks.
Cerebras
An AI company that builds wafer-scale computer systems for complex deep learning applications.
Zephyr
A fine-tuned version of Mistral-7B-v0.1 that is trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).
Microsoft Orca 2
A family of small language models from Microsoft that are taught to use different reasoning strategies for different tasks.
Microsoft Phi-3
A family of small, open models from Microsoft with the capability of models 10 times larger.
MosaicML MPT
A series of open-source, commercially usable transformers trained from scratch by MosaicML.
Databricks Dolly
An open-source, instruction-following large language model from Databricks, licensed for commercial use.
Vicuna
An open-source chatbot fine-tuned from LLaMA on user-shared conversations.
BLOOM
An open-access multilingual large language model created by the BigScience collaborative research workshop.
Cerebras
A company that builds the world's largest and fastest AI accelerators for training large-scale models.
Falcon
A family of open-source large language models available in various parameter sizes, released under the Apache 2.0 license.
SambaNova Systems
A full-stack AI platform that enables enterprises to build and deploy their own custom, high-performing AI models.
Meta Llama 3
A family of pretrained and instruction-tuned generative text models from Meta.
Google Gemma
A family of lightweight, open models built from the same research and technology used to create the Gemini models.
Qwen
A series of large language and multimodal models developed by Alibaba Cloud, with many variants distributed as open-weight models.
UpTrain
An open-source framework for evaluating and improving LLM applications by providing pre-built checks and refinement capabilities.
RAGAs
An open-source, specialized framework for evaluating Retrieval Augmented Generation (RAG) pipelines based on their individual components.
DeepEval
An open-source Python framework for unit testing LLM applications, offering a wide range of research-backed evaluation metrics.
Vellum
An end-to-end platform for building, evaluating, and deploying production-ready AI applications.
Lakera Guard
A developer-first security tool to protect LLM applications from prompt injections, data leakage, and other security threats.
Garak
An open-source tool for red teaming and vulnerability scanning of large language models, designed to find security and ethical weaknesses.
TruLens
An open-source tool for evaluating and tracking LLM-based applications, with a focus on RAG and agent evaluation.
OpenAI Evals
An open-source framework by OpenAI for creating and running evaluations to benchmark the performance of large language models.
Guardrails AI
An open-source framework for ensuring the reliability of LLM applications by specifying and enforcing structure and type guarantees.
LangSmith
A platform to debug, test, evaluate, and monitor your LLM applications.
Credo AI
An AI governance platform that empowers organizations to deliver and adopt artificial intelligence responsibly.
HiddenLayer
A comprehensive security platform for AI that secures agentic, generative, and predictive AI applications across the entire lifecycle.
Protect AI
A comprehensive AI security solution that secures AI applications from model selection and testing to runtime and beyond.
LiteLLM
An open-source library that simplifies interactions with over 100 LLM providers through a unified API.
AIM Security
NA
Prompt Security
Enables enterprises to benefit from the adoption of Generative AI while protecting from risks.
Garak
An open-source tool for scanning against the most common LLM vulnerabilities.
Vigil
A Python library and REST API for assessing Large Language Model prompts and responses for threats.
Lasso Security
An LLM-first, end-to-end security solution for LLM pioneers.
Guardrails AI
An open-source, programmatic framework for mitigating risks in LLM applications through output validation.
Braintrust
An AI observability and evaluation platform that helps teams test, evaluate, and monitor their AI products from development to production.
NVIDIA NeMo Guardrails
A toolkit for adding programmable guardrails to LLM-based conversational systems.
Arize AI
An AI observability and LLM evaluation platform for monitoring, troubleshooting, and enhancing the performance of machine learning models.
Reka AI
An AI research and product company building enterprise-grade multimodal AI models.
Lasso Security
A comprehensive security platform for generative AI, providing visibility, data protection, and governance for LLM usage.
Helicone
An open-source platform that provides logging, monitoring, and analytics for LLMs through a simple proxy-based approach.
DeepSeek
An AI research company that develops powerful open-source and API-accessible large language models, including multimodal variants.
Apple Ferret
An open-source multimodal large language model from Apple designed to understand and ground specific regions within an image.