selfhosted

Oct 5th, 11:32 p.m. 9 min read

Giving Your LLM Agent Web Search Without Burning Money: Self-hosted SearXNG, Caching and Citation Checks

AI LLM Python selfhosted

32 0 0

0

Oct 4th, 5:34 p.m. 9 min read

Running 100B+ MoE LLMs on a Single RTX 4090: A Practical Guide to Expert Offloading with llama.cpp

LLM GPU selfhosted llamacpp

39 0 0

0

selfhosted

Let's register a Viblo Account to get more interesting posts.