Best LLM software

Haystack NLP Framework

Haystack is an open-source Python framework for building production NLP, semantic search, question-answering, and retrieval-augmented generation...

local.ai

LocalAI is an open-source, OpenAI-compatible API server for running large language models and related AI workloads...

Jsonformer

Jsonformer is a Python library that constrains Hugging Face language models to generate JSON matching a...

SuperAGI

SuperAGI is an open-source framework for building and operating autonomous AI agents. It targets developers who...

Faraday.dev

Faraday is a desktop application for running large language models locally and chatting with AI characters....

Vercel AI SDK

Vercel AI SDK is an open-source TypeScript toolkit for building AI-powered applications with language models, agents,...

Lyzr.ai

Lyzr is a platform for building, deploying, and managing generative AI applications and autonomous agents. It...

LLM Explorer is a web directory and comparison service for discovering large language models and their...

Klu.ai

Klu is an AI product development platform for teams building and improving LLM-powered features. It combines...

LlamaGPT

LlamaGPT is a self-hosted chatbot that runs large language models locally for users who want private,...

AutoGPT Plugins

AutoGPT Plugins is an open-source extension framework that lets developers add tools, services, and capabilities to...

Promptly AI

Promptly is a no-code platform for building, testing, and deploying AI applications and workflows. It is...

aimlapi.com

AIML API is a unified API platform that gives developers access to large language, image, audio,...

Mind Studio

MindStudio is a no-code platform for building, deploying, and monetizing AI-powered applications and workflows. It is...

RecurseChat

RecurseChat is a privacy-focused desktop AI chat application for people who want to use cloud and...

Jan.ai

Jan is an open-source desktop AI assistant for running large language models locally or connecting to...

Secret Llama

Secret Llama is a browser-based AI chat application designed for private, local conversations. It runs compatible...

Promptchains

Promptchains is a platform for designing and running workflows that combine multiple AI prompts into reusable...

Featherless AI

Featherless AI is a serverless inference platform for developers building applications with open-weight language and generative...

LM-Kit.NET

LM-Kit.NET is a .NET toolkit for integrating large language models into applications through a unified programming...

rerail.io

Rerail is a platform for testing, monitoring, and improving AI applications and agents in production. It...

Poli

Poli is an online AI chat workspace that lets users access and compare responses from multiple...

Datasaur

Datasaur is a data-labeling and annotation platform for NLP, generative AI, and large language model teams....

DIAL is an open-source platform for building, deploying, and governing conversational AI and LLM applications. It...

Prompt API

Prompt API is a hosted developer service for sending prompts to AI models and receiving generated...

Meow Playground is an online environment for experimenting with AI models and prompts. It is aimed...

Mancer App

Mancer is a hosted large language model service aimed at developers and creative writers who want...

glu

Glu is a visual platform for building AI-powered workflows that connect language models, data sources, and...

TextSynth is an online text-generation service and API for developers who need programmatic access to language...

Riku.AI

Riku is a no-code platform for building, testing, and deploying applications powered by large language models....

AI.js is a JavaScript-focused toolkit for building applications that use artificial intelligence models and services. It...

AISTUDIO

Google AI Studio is a browser-based environment for experimenting with Gemini models and building generative AI...

OpenAI Cookbook

OpenAI Cookbook is a free collection of practical examples and guides for developers building applications with...

AIModels.fyi

AIModels.fyi is a searchable directory for discovering and comparing generative AI models, providers, capabilities, and pricing....

Auto-GPT

AutoGPT is an open-source platform for building and running autonomous AI agents that can plan tasks,...

PROMPTMETHEUS

Promptmetheus is a prompt engineering workspace for designing, testing, and refining prompts for large language models....

openplayground

OpenPlayground is an open-source web interface for experimenting with generative AI models and comparing their outputs....

Camel AGI

CAMEL is an open-source framework for building and studying multi-agent systems powered by large language models....

Fine-Tuner.ai

Fine-Tuner is an online service for customizing language models with user-provided datasets. It is aimed at...