Everything you need to build state-of-the-art foundation models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Build your chatbot within minutes on your favorite device
Uncover insights, surface problems, monitor, and fine tune your LLM
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Probabilistic reasoning and statistical analysis in TensorFlow
Trainable models and NN optimization tools
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
An MLOps framework to package, deploy, monitor and manage models
Powering Amazon custom machine learning chips
A library to communicate with ChatGPT, Claude, Copilot, Gemini
A toolkit to optimize ML models for deployment for Keras & TensorFlow
Framework that is dedicated to making neural data processing
LLMFlows - Simple, Explicit and Transparent LLM Apps
Training & Implementation of chatbots leveraging GPT-like architecture
Toolkit for allowing inference and serving with MXNet in SageMaker
CPU/GPU inference server for Hugging Face transformer models