@OliDietzel: Mein bestes Low-Cost-Setup für lokale LLMs für einen lokalen #Hermes-Agenten (Dual-GPU mit je 5060ti 16GB). Herausfordernd genug, um Prompts 64k zu verarbeiten, mit guter TTFT und Qualität beim Serving von cyankiwi/gemma-4-12B-it-qat-AWQ-INT4 mit vllm/vllm-openai:gemma. @cyankiwiai @vllmproject @NousResearch mehr auf Arint.info #Gemma #HermesAgent #LLM #LocalLLM #OpenSourceAI #vllm #arint_info https://x.com/OliDietzel/status/2064966250912993545#m
Related
Ernst & Young breach exposes client tax data - find out if you're at risk and what to do nextFor two weeks, attackers ha...
Ernst & Young breach exposes client tax data - find out if you're at risk and what to do nextFor two weeks, attackers had access to a third-party support ticket system containing c...
Meta’s AI has been suspending accounts by mistakehttps://www.nytimes.com/2026/07/21/technology/meta-ai-facebook-instagra...
Meta’s AI has been suspending accounts by mistakehttps://www.nytimes.com/2026/07/21/technology/meta-ai-facebook-instagram-accounts.html- - -L’IA de Meta suspend des comptes par err...
Anthropic's $1.5 billion settlement with authors over AI training on copyrighted books is now court-approved, offering a...
Anthropic's $1.5 billion settlement with authors over AI training on copyrighted books is now court-approved, offering around $3,000 per book. A clear signal on the cost of ignorin...