Large Language Models – CodeRocket AI

Mistral

AI Solutions Tailored for Enterprise Success

LLM

Customize and deploy AI assistants and agents with open models, ensuring privacy and control.

Ollama

Automate with Open Models, Secure Your Data

LLM

Effortlessly automate tasks using open models while ensuring data security. Integrate with your favorite tools seamlessly.

Qwen3

Advanced Language Models for Complex Tasks

AI Agents

+4 more

Explore Qwen3's powerful language models for deep reasoning and multilingual capabilities.

Forums

Source-Backed Answers Instantly

AI Agents

+4 more

Ask questions in any GitHub repo. AI reads code to provide precise answers.

MLC LLM

Universal LLM deployment engine

LLMMLOps

MLC LLM is a universal solution that enables native deployment of any large language models with native APIs with compiler acceleration.

LMDeploy

Toolkit for compressing, deploying, and serving LLMs

LLMMLOps

LMDeploy is a toolkit for compressing, deploying, and serving LLMs. It provides efficient inference with TurboMind engine.

SGLang

Accelerate AI with High-Performance Model Serving

LLMMLOps

Deliver low-latency, high-throughput inference for AI models. Supports diverse hardware and model types with extensive community backing.

LitGPT

Scale AI with 20+ High-Performance LLMs

LLMMLOps

Access 20+ LLMs with recipes for pretraining, finetuning, and scalable deployment. Optimize performance with minimal abstractions.

LocalGPT

Chat Privately with Your Documents

LLMRAG

Interact with your documents using GPT models locally. Ensure 100% data privacy with no data leaving your device.

PrivateGPT

Unlock Insights with Private AI

LLMRAG

Connect your data sources to a secure AI for natural language queries.

AnythingLLM

AI Power at Your Fingertips, Privately

LLMRAG

Interact with documents using any LLM, locally and privately. No setup needed.

ExLlamaV2

Run LLMs Locally on Consumer GPUs

LLM

Fast inference library for local LLMs on consumer GPUs. Supports dynamic batching, smart caching, and more.

TensorRT-LLM

Optimize LLM Inference on NVIDIA GPUs

LLMMLOps

Enhance LLM performance with Python API and NVIDIA GPU optimizations for efficient inference.

Unsloth

Accelerate LLM Training with Ease

LLMMLOps

Fine-tune and train LLMs faster with open-source tools. Beginner-friendly and efficient, supporting multiple GPUs.

Axolotl

Fine-tune LLMs with ease and flexibility

LLMMLOps

Open-source framework for efficient LLM fine-tuning with diverse model support and cloud readiness.

Llama

Unleash AI Power with Multimodal Precision

LLM

Experience top AI performance with Llama 4's multimodal models, offering efficiency, scalability, and low costs for innovative applications.

GPT4All

Local AI, Maximum Privacy

LLM

Run AI models locally with no cloud dependency. Ensure data privacy and high performance on your device.

Jan

Unleash AI Power Locally and Globally

LLM

Run open-source AI models locally or connect to cloud models like GPT, Claude, and more.

LM Studio

Local AI Models, Private and Free

LLM

Run AI models like GPT-OSS and Llama privately on your computer. Free for home and work.

Text Generation WebUI

A Gradio web UI for running Large Language Models

LLM

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp, and many other backends.

Llama.cpp

Efficient LLM Inference in C/C++

LLM

Achieve high-performance LLM inference with minimal setup using C/C++. Supports diverse hardware and quantization for optimal efficiency.

Open WebUI

AI on Your Terms, Without Compromise

LLM

Run AI locally or in the cloud, connect any model, and extend with code. Protect your data with complete control.

LiteLLM

Seamless LLM Management and Tracking

LLMMLOps

Effortlessly manage authentication, load balancing, and spend tracking for 100+ LLMs in OpenAI format.

vLLM

Effortless LLM Deployment for All

LLMMLOps

Deploy AI models swiftly with high efficiency and low cost. Enjoy seamless integration and peak performance with any hardware.

LocalAI

Run AI Locally, No Cloud Needed

LLMMLOps

Experience powerful AI models on your hardware. No cloud, no limits, complete privacy.

Hugging Face Transformers

Unlock AI Potential with Open Source Models

FrameworksLLM

Advance AI with open-source models for text, vision, and more. Simplify training and inference with state-of-the-art tools.