DEV Community

#llms

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Parsing a streamed LLM response in Node.js: Server-Sent Events, split chunks and the CRLF bug

Parsing a streamed LLM response in Node.js: Server-Sent Events, split chunks and the CRLF bug

Comments
5 min read
Semantic caching for LLM apps: when reusing an answer is safe, and when it's a bug

Semantic caching for LLM apps: when reusing an answer is safe, and when it's a bug

Comments
4 min read
Limiting concurrent async calls in Node.js without a library: a 15-line promise pool

Limiting concurrent async calls in Node.js without a library: a 15-line promise pool

Comments
3 min read
Canary tokens for LLM apps: detecting system prompt leaks and injected exfiltration

Canary tokens for LLM apps: detecting system prompt leaks and injected exfiltration

Comments
4 min read
Rate limiting LLM API calls in Node.js: a token bucket for requests and tokens per minute

Rate limiting LLM API calls in Node.js: a token bucket for requests and tokens per minute

Comments
4 min read
What is the Model Context Protocol (MCP)? Tools, resources, transports and auth, explained by someone who built a server

What is the Model Context Protocol (MCP)? Tools, resources, transports and auth, explained by someone who built a server

Comments
4 min read
Why you can't average p95 latencies, and how to combine percentiles correctly

Why you can't average p95 latencies, and how to combine percentiles correctly

Comments
3 min read
Prompt injection from scraped data: guarding an LLM that writes outreach emails

Prompt injection from scraped data: guarding an LLM that writes outreach emails

Comments
4 min read
Retrying LLM API calls: exponential backoff, jitter, Retry-After and model fallbacks

Retrying LLM API calls: exponential backoff, jitter, Retry-After and model fallbacks

Comments
4 min read
Hybrid search for RAG: BM25 plus vectors, merged with reciprocal rank fusion

Hybrid search for RAG: BM25 plus vectors, merged with reciprocal rank fusion

Comments
4 min read
Every AI Agency Has a Demo. Ask What Changed After Launch.

Every AI Agency Has a Demo. Ask What Changed After Launch.

Comments
5 min read
How LLM tool calling works: the loop, the schema, and the mistakes that break agents

How LLM tool calling works: the loop, the schema, and the mistakes that break agents

Comments
3 min read
Trimming chat history to fit the context window without breaking tool calls

Trimming chat history to fit the context window without breaking tool calls

Comments 1
4 min read
How to build a fully offline RAG chatbot with Ollama, Mistral, ChromaDB and Redis

How to build a fully offline RAG chatbot with Ollama, Mistral, ChromaDB and Redis

Comments
3 min read
How to evaluate a RAG system: recall@k, MRR and groundedness, with code

How to evaluate a RAG system: recall@k, MRR and groundedness, with code

Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.