AI Solutions

Anthropic API

API

0

API access to Claude models for AI applications.

OpenAI API

API

0

API access to GPT-4, DALL-E, Whisper, and more AI models.

Cohere

API

0

Enterprise AI platform for text generation and embeddings.

AI21 Labs

API

0

Jurassic language models for enterprise AI applications.

Google AI Studio

API

0

Build with Gemini models through Google's AI platform.

Together AI

API

0

Cloud platform for running open-source AI models.

Replicate

API

0

Run open-source ML models with a cloud API.

Hugging Face

API

0

Platform for open-source AI models and datasets.

Groq

API

0

Ultra-fast AI inference with custom LPU hardware.

Fireworks AI

API

0

Fast inference platform for generative AI models.

Anyscale

API

0

Platform for scaling AI workloads with Ray.

Perplexity API

API

0

API for Perplexity's search-augmented language models.

Mistral AI

API

0

European AI company with powerful open-weight models.

Cerebras

API

0

AI compute platform with wafer-scale chips.

Modal

API

0

Cloud platform for running AI workloads serverlessly.

Banana

API

0

Serverless GPU infrastructure for ML inference.

Baseten

API

0

Platform for deploying ML models as APIs.

AWS Bedrock

API

0

Amazon's managed service for foundation models.

OctoAI

API

0

Efficient AI inference cloud for GenAI applications.

DeepInfra

API

0

Serverless inference for popular AI models.

SambaNova

API

0

Enterprise AI platform with custom hardware.

Azure OpenAI

API

0

OpenAI models hosted on Microsoft Azure.

Vertex AI

API

0

Google Cloud's unified AI platform.

RunPod

API

0

GPU cloud for AI inference and training.

Predibase

API

0

Platform for fine-tuning and serving LLMs.

Lamini

API

0

Enterprise LLM platform for fine-tuning and inference.

Deepgram

API

0

AI speech recognition and transcription API.

AssemblyAI

API

0

API for speech-to-text and audio intelligence.

Rev.ai

API

0

Speech-to-text API with high accuracy.

Pinecone

API

0

Vector database for AI applications.

Weaviate

API

0

Open-source vector search engine.

Qdrant

API

0

Vector similarity search engine and database.

Chroma

API

0

Open-source embedding database for AI apps.

Milvus

API

0

Open-source vector database for AI workloads.

LanceDB

API

0

Serverless vector database for AI applications.

Improving Language Understanding by Generative Pre-Training

API

0

AI tool from awesome-llm

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

API

0

AI tool from awesome-llm

BeHonest

API

0

A pioneering benchmark specifically designed to assess honesty in LLMs comprehensively.

Berkeley Function-Calling Leaderboard

API

0

evaluates LLM's ability to call external functions/tools.

LLaMA: Open and Efficient Foundation Language Models

API

0

AI tool from awesome-llm

PaLM 2 Technical Report

API

0

AI tool from awesome-llm

PaLM-E: An Embodied Multimodal Language Model

API

0

AI tool from awesome-llm

Language Models are Unsupervised Multitask Learners

API

0

AI tool from awesome-llm

LiveBench

API

0

A Challenging, Contamination-Free LLM Benchmark.

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

API

0

AI tool from awesome-llm

AlpacaEval

API

0

An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.

Finetuned Language Models are Zero-Shot Learners

API

0

AI tool from awesome-llm

LawBench

API

0

a benchmark designed to evaluate large language models in the legal domain.

InfiBench

API

0

a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

CompMix

API

0

a benchmark evaluating QA methods that operate over a mixture of heterogeneous input sources (KB, text, tables, infoboxes).

MathEval

API

0

a comprehensive benchmarking platform designed to evaluate large models' mathematical abilities across 20 fields and nearly 30,000 math problems.

CompassRank

API

0

CompassRank is dedicated to exploring the most advanced language and visual models, offering a comprehensive, objective, and neutral evaluation reference for the industry and research.

MixEval

API

0

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking (i.e., 0.96 correlation with Chatbot Arena) while running locally and quickly (6% the time and cost of running MMLU).

M3CoT

API

0

a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

LLMEval

API

0

focuses on understanding how these models perform in various scenarios and analyzing results from an interpretability perspective.

FELM

API

0

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

DreamBench++

API

0

a benchmark for evaluating the performance of large language models (LLMs) in various tasks related to both textual and visual imagination.

MMToM-QA

API

0

a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

PubMedQA

API

0

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

MMedBench

API

0

a benchmark that evaluates large language models' ability to answer medical questions across multiple languages.

TAT-DQA

API

0

a large-scale Document Visual Question Answering (VQA) dataset designed for complex document understanding, particularly in financial reports.

SuperLim

API

0

a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.

SciBench

API

0

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

SuperBench

API

0

a benchmark platform designed for evaluating large language models (LLMs) on a range of tasks, particularly focusing on their performance in different aspects such as natural language understanding, reasoning, and generalization.

We-Math

API

0

a benchmark that evaluates large multimodal models (LMMs) on their ability to perform human-like mathematical reasoning.

VisualWebArena

API

0

a benchmark designed to assess the performance of multimodal web agents on realistic visually grounded tasks.

WHOOPS!

API

0

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

Tune Studio

API

0

Playground for devs to finetune & deploy LLMs

Guardrails.ai

API

0

AI tool from awesome-llm

MPT-7B

API

0

AI tool from awesome-llm

Chainlit

API

0

AI tool from awesome-llm

Arthur Shield

API

0

AI tool from awesome-llm

Grok-1-314B-MoE

API

0

AI tool from awesome-llm

Weights & Biases

API

0

AI tool from awesome-llm

Llama 3.2-1|3|11|90B

API

0

AI tool from awesome-llm

MLflow

API

0

MLflow: An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.

Gemma2-9|27B

API

0

AI tool from awesome-llm

CS25-Transformers United

API

0

AI tool from awesome-llm

OneKE

API

0

AI tool from awesome-llm

ICML2022-Welcome to the "Big Model" Era: Techniques and Systems to Train and Serve Bigger Models

API

0

AI tool from awesome-llm

Princeton: Understanding Large Language Models

API

0

AI tool from awesome-llm

CS324 - Large Language Models

API

0

AI tool from awesome-llm

Alexander Rush Series

API

0

high quality and educational materials you don't want to miss.

UWaterloo CS 886

API

0

Recent Advances on Foundation Models.

Neurips2022-Foundational Robustness of Foundation Models

API

0

AI tool from awesome-llm

A Visual Guide to Mamba and State Space Models

API

0

AI tool from awesome-llm

State of GPT

API

0

AI tool from awesome-llm

A Stage Review of Instruction Tuning

API

0

AI tool from awesome-llm

The Chinese Book for Large Language Models

API

0

An Introductory LLM Textbook Based on [A Survey of Large Language Models](https://arxiv.org/abs/2303.18223).

Why did all of the public reproduction of GPT-3 fail?

API

0

AI tool from awesome-llm

GPT in 60 Lines of NumPy

API

0

AI tool from awesome-llm

Google "We Have No Moat, And Neither Does OpenAI"

API

0

AI tool from awesome-llm

Is ChatGPT 175 Billion Parameters? Technical Analysis

API

0

AI tool from awesome-llm

AI competition statement

API

0

AI tool from awesome-llm

Hands-On Large Language Models: Language Understanding and Generation

API

0

Explore the world of Large Language Models with over 275 custom made figures in this illustrated guide!

Large Language Model Training in 2023

API

0

AI tool from awesome-llm

LLM Powered Autonomous Agents

API

0

AI tool from awesome-llm

500+ Best AI Tools

API

0

AI tool from awesome-llm

Emergent Mind

API

0

The latest AI news, curated & explained by GPT-4.

Cohere Summarize Beta

API

0

Introducing Cohere Summarize Beta: A New Endpoint for Text Summarization

Scaling, emergence, and reasoning in large language models

API

0

AI tool from awesome-llm

PFA

API

0

PFA (Portable Format for Analytics) format is a standard for representing and exchanging predictive models and analytics workflows in a portable, JSON-based format.

NNEF

API

0

Neural Network Exchange Format (NNEF) is an open standard for representing neural network models to enable interoperability and portability across different machine learning frameworks and platforms.