Bring the notion of Model-as-a-Service to life
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Build your chatbot within minutes on your favorite device
Library for OCR-related tasks powered by Deep Learning
Tensor search for humans
Powering Amazon custom machine learning chips
An easy-to-use LLMs quantization package with user-friendly apis
The unofficial python package that returns response of Google Bard
Visual Instruction Tuning: Large Language-and-Vision Assistant
Open platform for training, serving, and evaluating language models
Database system for building simpler and faster AI-powered application
Framework that is dedicated to making neural data processing
A computer vision framework to create and deploy apps in minutes
LLMFlows - Simple, Explicit and Transparent LLM Apps
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
Run 100B+ language models at home, BitTorrent-style
Framework for Accelerating LLM Generation with Multiple Decoding Heads
Implementation of "Tree of Thoughts
Implementation of model parallel autoregressive transformers on GPUs
CPU/GPU inference server for Hugging Face transformer models