The directory contains a collection of example projects demonstrating BentoML usage and best practices.
| Example | Model | Functionality |
|---|---|---|
| quickstart | Transformers | Summarization |
| inference-graph | Text Generation, Text Classification | Distributed Services, Model Composition, Inference Graph |
| io-descriptors | Pydantic | Custom IO Types |
| model-loading-saving | Stable Diffusion | Model Store |
| monitoring/task_classification | Classification | Model Monitoring, Classification Tasks |
| sk-learn | Classification | Classification |
You can also try the following example projects.
- BentoXTTS - Convert text to speech based on your custom audio data.
- BentoSDXLTurbo - Create an image generation application and run inference with a single step.
- BentoSD2Upscaler - Build an image generation application with upscaling capability.
- BentoControlNet - Influence image composition, adjust specific elements, and ensure spatial consistency by integrating ControlNet with your image generation process.
- BentoWhisperX - Convert spoken words into text for AI scenarios like virtual assistants, voice-controlled devices, and automated transcription services.
- Sentence Transformer - Transform text into numerical vectors for a variety of natural language processing (NLP) tasks.
- BentoCLIP - Build a CLIP (Contrastive Language-Image Pre-training) application for tasks like zero-shot learning, image classification, and image-text matching.
- BentoBLIP - Leverage BLIP (Bootstrapping Language Image Pre-training) to improve the way AI models understand and process the relationship between images and textual descriptions.
- BentoLCM - Deploy a REST API server for Stable Diffusion with Latent Consistency LoRAs.
- BentoSVD - Create a video generation application powered by Stable Video Diffusion (SVD).
- BentoVLLM - Accelerate your model inference and improve serving throughput by using vLLM as your LLM backend.
- BentoBark - Generate highly realistic audio like music, background noise and simple sound effects with Bark.
- BentoYolo - Build an object detection inference API server with YOLO.
- RAG - Self-host a private RAG app using custom embedding and language models.
- BentoChatTTS - Deploy a text-to-speech model ChatTTS for dialogue scenarios like chatbots and virtual assistants.