Tools tagged with "C"

MLC LLM is a universal solution that enables native deployment of any large language models with native APIs with compiler acceleration.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs. It provides efficient inference with TurboMind engine.

Cross-platform tensor library with no dependencies, supporting quantization and diverse hardware.

Enhance LLM performance with Python API and NVIDIA GPU optimizations for efficient inference.

Deploy AI models across frameworks with dynamic batching, real-time support, and cloud integration.

Run AI models locally with no cloud dependency. Ensure data privacy and high performance on your device.

Effortlessly redirect users to your new site with ease.

Explore real-time Computer Vision with optimized tools and AI model support. Dive into learning and innovation.

Achieve high-performance LLM inference with minimal setup using C/C++. Supports diverse hardware and quantization for optimal efficiency.