Sleeping 3 Text Mood Checker Gradio Custom Component 🚀 3 Emoji-based sentiment UI with a custom Gradio component
view post Post 3155 Inference for generative ai models looks like a mine field, but there’s a simple protocol for picking the best inference:🌍 95% of users >> If you’re using open (large) models and need fast online inference, then use Inference providers on auto mode, and let it choose the best provider for the model. https://huggingface.co/docs/inference-providers/index👷 fine-tuners/ bespoke >> If you’ve got custom setups, use Inference Endpoints to define a configuration from AWS, Azure, GCP. https://huggingface.co/proxy/endpoints.huggingface.co/🦫 Locals >> If you’re trying to stretch everything you can out of a server or local machine, use Llama.cpp, Jan, LMStudio or vLLM. https://huggingface.co/settings/local-apps#local-apps🪟 Browsers >> If you need open models running right here in the browser, use transformers.js. https://github.com/huggingface/transformers.jsLet me know what you’re using, and if you think it’s more complex than this. See translation ❤️ 11 11 + Reply
view post Post 849 Now you can make Flux.1 your own within just 10GBs of VRAM. In our new blog post we walk you through the process step by step.Check it out here: https://huggingface.co/blog/flux-qlora See translation 🔥 3 3 + Reply