Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
localllm
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Edge0-145B Open Weights: RTX GPU vs Mac, RTX Wins
Shamuddin
Shamuddin
Shamuddin
Follow
Nov 19
Edge0-145B Open Weights: RTX GPU vs Mac, RTX Wins
#
edge0145b
#
openweights
#
localllm
#
nvidiartx
Comments
Add Comment
7 min read
Moderation
How to Set Up Hermes Agent with Ollama and Qwen 3.8 on Windows (Free Local AI Agent)
TheCodeStreet
TheCodeStreet
TheCodeStreet
Follow
Nov 17
How to Set Up Hermes Agent with Ollama and Qwen 3.8 on Windows (Free Local AI Agent)
#
ai
#
hermes
#
localllm
#
llm
Comments
Add Comment
6 min read
Moderation
Benchmarking Local LLMs for LaTeX and Code Generation on Windows: What Actually Works
DudeSquad999 · Building Prism AI
DudeSquad999 · Building Prism AI
DudeSquad999 · Building Prism AI
Follow
Nov 16
Benchmarking Local LLMs for LaTeX and Code Generation on Windows: What Actually Works
#
ai
#
localllm
#
ollama
#
windows
Comments
Add Comment
2 min read
Moderation
Local Inference: Running Models on Your Own Machine
Internals Decoded
Internals Decoded
Internals Decoded
Follow
Nov 16
Local Inference: Running Models on Your Own Machine
#
ai
#
localllm
#
ollama
#
llamacpp
Comments
Add Comment
13 min read
Moderation
86.5 beats Opus on my own laptop — the Shorts walkthrough is up
InApp
InApp
InApp
Follow
Nov 16
86.5 beats Opus on my own laptop — the Shorts walkthrough is up
#
localllm
#
benchmarking
#
video
#
ai
1
reaction
Comments
Add Comment
1 min read
Moderation
How can an AI answer with no network? On-device AI explained
System Design Simple
System Design Simple
System Design Simple
Follow
Nov 15
How can an AI answer with no network? On-device AI explained
#
aisystems
#
ondeviceai
#
localllm
#
offlineai
Comments
Add Comment
6 min read
Moderation
Configuring Ollama and Cloud Models in Prism AI: A Local-First Approach
DudeSquad999 · Building Prism AI
DudeSquad999 · Building Prism AI
DudeSquad999 · Building Prism AI
Follow
Nov 13
Configuring Ollama and Cloud Models in Prism AI: A Local-First Approach
#
ai
#
ollama
#
localllm
#
tutorial
Comments
Add Comment
1 min read
Moderation
The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs
Benni Alencar
Benni Alencar
Benni Alencar
Follow
Nov 13
The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs
#
ai
#
localllm
#
cuda
#
opensource
Comments
Add Comment
11 min read
Moderation
Quantize or Offload? A 16GB GPU Local LLM Strategy
Renato Silva
Renato Silva
Renato Silva
Follow
Nov 12
Quantize or Offload? A 16GB GPU Local LLM Strategy
#
localllm
#
machinelearning
#
python
#
cuda
Comments
Add Comment
4 min read
Moderation
AI CV screening on a local LLM with Ollama
Behnoud mostafaie
Behnoud mostafaie
Behnoud mostafaie
Follow
for
Vekt
Nov 10
AI CV screening on a local LLM with Ollama
#
localllm
#
ollama
#
aiscreening
#
selfhosted
Comments
Add Comment
9 min read
Moderation
FreeToken: Run Frontier MoE Models on Your Own GPU, and the RAM It Takes
Muhammad Tayyab
Muhammad Tayyab
Muhammad Tayyab
Follow
Nov 6
FreeToken: Run Frontier MoE Models on Your Own GPU, and the RAM It Takes
#
opensource
#
localllm
#
mixtureofexperts
#
llminference
Comments
Add Comment
9 min read
Moderation
I Wanted to Run a 750B Model at Home. My Hardware Said No
Felix
Felix
Felix
Follow
Nov 10
I Wanted to Run a 750B Model at Home. My Hardware Said No
#
localllm
#
homelab
#
proxmox
#
moe
Comments
1
comment
8 min read
Moderation
Local LLMs vs Cloud AI: Choosing the Right Solution for...
Veduis
Veduis
Veduis
Follow
Nov 6
Local LLMs vs Cloud AI: Choosing the Right Solution for...
#
localllm
#
ondeviceai
#
privateaimodels
#
ollamaforbusiness
Comments
Add Comment
8 min read
Moderation
Local LLMs as System Tooling: Running many Sub-3B Models on Edge and Budget Hardware
Jonne Riepponen
Jonne Riepponen
Jonne Riepponen
Follow
Nov 5
Local LLMs as System Tooling: Running many Sub-3B Models on Edge and Budget Hardware
#
ai
#
localllm
#
sysadmin
#
privacy
Comments
Add Comment
7 min read
Moderation
Local LLMs for Cybersecurity: Choose the Brain, Limit Its Reach
Aleksei Aleinikov
Aleksei Aleinikov
Aleksei Aleinikov
Follow
Nov 6
Local LLMs for Cybersecurity: Choose the Brain, Limit Its Reach
#
localllm
#
cybersecurity
#
llmsecurity
#
aiagentsecurity
Comments
Add Comment
15 min read
Moderation
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account