DEV Community

#localllm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Edge0-145B Open Weights: RTX GPU vs Mac, RTX Wins

Edge0-145B Open Weights: RTX GPU vs Mac, RTX Wins

Comments
7 min read
How to Set Up Hermes Agent with Ollama and Qwen 3.8 on Windows (Free Local AI Agent)

How to Set Up Hermes Agent with Ollama and Qwen 3.8 on Windows (Free Local AI Agent)

Comments
6 min read
Benchmarking Local LLMs for LaTeX and Code Generation on Windows: What Actually Works

Benchmarking Local LLMs for LaTeX and Code Generation on Windows: What Actually Works

Comments
2 min read
Local Inference: Running Models on Your Own Machine

Local Inference: Running Models on Your Own Machine

Comments
13 min read
86.5 beats Opus on my own laptop — the Shorts walkthrough is up

86.5 beats Opus on my own laptop — the Shorts walkthrough is up

1
Comments
1 min read
How can an AI answer with no network? On-device AI explained

How can an AI answer with no network? On-device AI explained

Comments
6 min read
Configuring Ollama and Cloud Models in Prism AI: A Local-First Approach

Configuring Ollama and Cloud Models in Prism AI: A Local-First Approach

Comments
1 min read
The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs

The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs

Comments
11 min read
Quantize or Offload? A 16GB GPU Local LLM Strategy

Quantize or Offload? A 16GB GPU Local LLM Strategy

Comments
4 min read
AI CV screening on a local LLM with Ollama

AI CV screening on a local LLM with Ollama

Comments
9 min read
FreeToken: Run Frontier MoE Models on Your Own GPU, and the RAM It Takes

FreeToken: Run Frontier MoE Models on Your Own GPU, and the RAM It Takes

Comments
9 min read
I Wanted to Run a 750B Model at Home. My Hardware Said No

I Wanted to Run a 750B Model at Home. My Hardware Said No

Comments 1
8 min read
Local LLMs vs Cloud AI: Choosing the Right Solution for...

Local LLMs vs Cloud AI: Choosing the Right Solution for...

Comments
8 min read
Local LLMs as System Tooling: Running many Sub-3B Models on Edge and Budget Hardware

Local LLMs as System Tooling: Running many Sub-3B Models on Edge and Budget Hardware

Comments
7 min read
Local LLMs for Cybersecurity: Choose the Brain, Limit Its Reach

Local LLMs for Cybersecurity: Choose the Brain, Limit Its Reach

Comments
15 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.