Localllm - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Oct 4

Run Qwen3.8-Flash-Next Locally with EXL3 and TabbyAPI on 40+ GB of RAM

#ai #localllm #llm #tutorial

10 min read

Reno Lu

Oct 2

Qwen3.8-27B on one RTX 3090, and the setting its README says chat clients should leave at default

#vllm #localllm #speculativedecoding #quantization

4 min read

Sep 29

Still carrying the diagnosis

#localllm #debugging #buildinpublic #opensource

8 min read

DevLog

Sep 28

Claude CLI 401 Unauthorized Refresh Token Issue

#clitools #localllm #troubleshooting

3 min read

DevLog

Sep 27

Discord bot not responding but still running: how to catch it

#automation #localllm #macos

3 min read

Michael

Sep 23

How Much RAM Do You Need for Local LLMs on a Mac?

#llm #localllm #ai #apple

3 min read

DevLog

Sep 23

Claude Code MCP setup and usage rules

#clitools #macos #localllm

3 min read

DevLog

Sep 23

Clone your own voice with a 17-second recording

#contentops #localllm #macos

2 min read

DevLog

Sep 21

Prompt engineering: How to fix instructions that AI ignores

#promptengineering #ai #localllm

3 min read

Dmitry Amelchenko

Oct 3

Inside My llama.cpp Setup: Tuning Qwen 3.8 27B for 512K Context

#ai #llm #localllm #llamacpp

7 min read

Vishnu Hari Dadhich

Sep 14

What Happens When You Ask an LLM a Question

#ai #localllm #llmbasics #gpu

8 min read

Vishnu Hari Dadhich

Sep 14

Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPU

#ai #localllm #vllm #kubernetes

13 min read

Sep 30

Testing the 9x Smaller Local LLM Claim on a GPU-less VPS

#localllm #quantization #selfhosting #gguf

6 min read

Kevin Tang

Sep 6

I Ran DeepSeek V4 Flash Across Two DGX Sparks Over Ethernet

#ai #hardware #localllm #networking

11 min read

Tech-Gurunomics

Sep 6

VRAM and RAM for local LLMs — honest planning bands, not a GPU tier list

#localllm #llm #ollama #hardware

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.