inferbench — download, run & benchmark local LLMsRun and benchmark local LLMs without the setup pain. inferbench is a de...

inferbench — download, run & benchmark local LLMsRun and benchmark local LLMs without the setup pain. inferbench is a desktop app that downloads, launches and benchmarks local inference engines (llama.cpp & co) — no Python, no Node. Engine binaries auto-fetched, CUDA auto-detected.Grab the installer for Windows / macOS / Linux 👇https://github.com/JoniMartin27/inferbench/releases#llm #localllm #inference #benchmark

Read Original

Related