OpenAI-like API for LLMs - AI tools

LiteLLM provides a simplified and standardized way to interact with over 100 large language models (LLMs) using a consistent OpenAI-compatible input/output format.

• Free

OpenTools provides a unified API enabling developers to connect Large Language Models (LLMs) with a diverse ecosystem of tools, simplifying integration and management.

• Usage Based

AiPrice calculates OpenAI API prompt token counts and provides accurate pricing estimations. It helps developers estimate costs before making API calls.

• Freemium
• From 2$

Avian API is an enterprise-grade language model inference platform offering state-of-the-art LLMs with superior speed and competitive pricing, powered by Meta's Llama models and Nvidia H200 SXM technology.

• Usage Based
• From 3$

Gorilla is an open-source Large Language Model (LLM) developed by UC Berkeley, designed to interact with a wide range of services by invoking API calls.

• Free

Mistral AI is a research lab developing state-of-the-art open-source and commercial Large Language Models (LLMs) for developers and enterprises.

• Other

Open Source AI Gateway provides developers with a robust, production-ready solution to manage multiple LLM providers like OpenAI, Anthropic, and Gemini. It offers features like smart failover, caching, rate limiting, and monitoring for enhanced reliability and cost savings.

• Free

OpenRouter provides a unified interface for accessing and comparing various Large Language Models (LLMs), offering users the ability to find optimal models and pricing for their specific prompts.

• Usage Based

Keywords AI is a comprehensive developer platform for LLM applications, offering monitoring, debugging, and deployment tools. It serves as a Datadog-like solution specifically designed for LLM applications.

• Freemium
• From 7$

JsonGPT offers a simple API to generate structured JSON data using various AI models like OpenAI and Gemini. It streamlines AI integration by handling validation, caching, and streaming.

• Freemium

LLM Price Check allows users to compare and calculate prices for Large Language Model (LLM) APIs from providers like OpenAI, Anthropic, Google, and more. Optimize your AI budget efficiently.

• Free

Kel integrates AI capabilities into your command-line interface (CLI), enabling automation, enhanced productivity, and intelligent CLI interactions. It supports multiple large language models (LLMs) and is free and open source.

• Free

WebLLM enables running large language models (LLMs) directly within a web browser using WebGPU for hardware acceleration, reducing server costs and enhancing privacy.

• Free

BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.

• Other

A web-based tool that provides real-time token counting and cost estimation for various Large Language Models (LLMs), including OpenAI's GPT models and Anthropic's Claude models.

• Free

Inference.net provides fast, scalable, pay-per-token APIs for leading AI models like DeepSeek V3 and Llama 3.1, offering significant cost savings and easy integration.

• Usage Based

LMQL is a programming language designed for large language models, offering robust and modular prompting with types, templates, and constraints.

• Free

l1m is a proxy API simplifying structured data extraction from unstructured text and images using Large Language Models (LLMs), requiring no prompt engineering.

• Freemium

Missing Studio is an open-source AI platform designed for developers to build and deploy generative AI applications. It offers tools for managing LLMs, optimizing performance, and ensuring reliability.

• Free

Unify provides tools to build, test, and optimize LLM pipelines with custom interfaces and a unified API for accessing all models across providers.

• Freemium
• From 40$

OxyAPI provides developers with instant API access to a wide range of AI models, featuring global deployment and simple pay-as-you-go pricing.

• Usage Based

Dialoq AI is a comprehensive API gateway that enables developers to access and integrate 200+ Language Learning Models (LLMs) through a single, unified API, streamlining AI application development with enhanced reliability and cost predictability.

• Contact for Pricing