InferBench update ⚡ one-click benchmark for local LLM engines — TTFT, tok/s, VRAM & quality, measured for real. Now it a...

InferBench update ⚡ one-click benchmark for local LLM engines — TTFT, tok/s, VRAM & quality, measured for real. Now it also generates images locally via stable-diffusion.cpp, plus a Serve mode + MCP server to expose your models. 100% local, no Docker needed. MIT.https://github.com/JoniMartin27/inferbench#llm #localllm #benchmark

Read Original

Related