Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llms
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Parsing a streamed LLM response in Node.js: Server-Sent Events, split chunks and the CRLF bug
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 19
Parsing a streamed LLM response in Node.js: Server-Sent Events, split chunks and the CRLF bug
#
llms
#
node
#
streaming
#
aiengineering
Comments
Add Comment
5 min read
Moderation
Semantic caching for LLM apps: when reusing an answer is safe, and when it's a bug
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 19
Semantic caching for LLM apps: when reusing an answer is safe, and when it's a bug
#
llms
#
aiengineering
#
python
#
rag
Comments
Add Comment
4 min read
Moderation
Limiting concurrent async calls in Node.js without a library: a 15-line promise pool
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 19
Limiting concurrent async calls in Node.js without a library: a 15-line promise pool
#
node
#
javascript
#
performance
#
llms
Comments
Add Comment
3 min read
Moderation
Canary tokens for LLM apps: detecting system prompt leaks and injected exfiltration
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 19
Canary tokens for LLM apps: detecting system prompt leaks and injected exfiltration
#
security
#
llms
#
aiagents
#
python
Comments
Add Comment
4 min read
Moderation
Rate limiting LLM API calls in Node.js: a token bucket for requests and tokens per minute
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 19
Rate limiting LLM API calls in Node.js: a token bucket for requests and tokens per minute
#
llms
#
node
#
aiengineering
#
reliability
Comments
Add Comment
4 min read
Moderation
What is the Model Context Protocol (MCP)? Tools, resources, transports and auth, explained by someone who built a server
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
What is the Model Context Protocol (MCP)? Tools, resources, transports and auth, explained by someone who built a server
#
mcp
#
aiagents
#
llms
#
aiengineering
Comments
Add Comment
4 min read
Moderation
Why you can't average p95 latencies, and how to combine percentiles correctly
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
Why you can't average p95 latencies, and how to combine percentiles correctly
#
monitoring
#
sre
#
typescript
#
llms
Comments
Add Comment
3 min read
Moderation
Prompt injection from scraped data: guarding an LLM that writes outreach emails
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
Prompt injection from scraped data: guarding an LLM that writes outreach emails
#
aiengineering
#
llms
#
security
#
python
Comments
Add Comment
4 min read
Moderation
Retrying LLM API calls: exponential backoff, jitter, Retry-After and model fallbacks
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
Retrying LLM API calls: exponential backoff, jitter, Retry-After and model fallbacks
#
llms
#
aiengineering
#
node
#
reliability
Comments
Add Comment
4 min read
Moderation
Hybrid search for RAG: BM25 plus vectors, merged with reciprocal rank fusion
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
Hybrid search for RAG: BM25 plus vectors, merged with reciprocal rank fusion
#
rag
#
aiengineering
#
python
#
llms
Comments
Add Comment
4 min read
Moderation
Every AI Agency Has a Demo. Ask What Changed After Launch.
Israel Vásquez
Israel Vásquez
Israel Vásquez
Follow
for
Monogram
Nov 18
Every AI Agency Has a Demo. Ask What Changed After Launch.
#
ai
#
llms
#
architecture
#
softwareengineering
Comments
Add Comment
5 min read
Moderation
How LLM tool calling works: the loop, the schema, and the mistakes that break agents
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
How LLM tool calling works: the loop, the schema, and the mistakes that break agents
#
aiagents
#
llms
#
aiengineering
#
mcp
Comments
Add Comment
3 min read
Moderation
Trimming chat history to fit the context window without breaking tool calls
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
Trimming chat history to fit the context window without breaking tool calls
#
llms
#
aiagents
#
python
#
aiengineering
Comments
1
 comment
4 min read
Moderation
How to build a fully offline RAG chatbot with Ollama, Mistral, ChromaDB and Redis
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
How to build a fully offline RAG chatbot with Ollama, Mistral, ChromaDB and Redis
#
aiengineering
#
rag
#
llms
#
privacy
Comments
Add Comment
3 min read
Moderation
How to evaluate a RAG system: recall@k, MRR and groundedness, with code
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 18
How to evaluate a RAG system: recall@k, MRR and groundedness, with code
#
rag
#
llms
#
aiengineering
#
python
Comments
1
 comment
4 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account