DEV Community

Deployed Lab profile picture

Deployed Lab

Interactive AI engineering and forward deployed engineer course. Click the diagrams, break the labs, practise the customer calls. Eleven chapters free, no signup.

Location Vancouver, BC Joined Joined on  Personal website https://deployedlab.dev github website
Why your LLM is slow twice, and why it runs out of memory: prefill, decode and the KV cache

Why your LLM is slow twice, and why it runs out of memory: prefill, decode and the KV cache

Comments
3 min read
Rent the taxi or buy the car: the break-even maths for running your own model

Rent the taxi or buy the car: the break-even maths for running your own model

Comments
4 min read
Your RAG assistant got 7 of 10 right. The other 3 failed for different reasons

Your RAG assistant got 7 of 10 right. The other 3 failed for different reasons

Comments
4 min read
RAG end to end: what each stage fixes, and what breaks when it fails

RAG end to end: what each stage fixes, and what breaks when it fails

Comments 1
3 min read
Your AI said 14 days. The policy says 30. The fix is an open-book exam

Your AI said 14 days. The policy says 30. The fix is an open-book exam

Comments
4 min read
"How do I get my money back?" Why your search says 0 results, and the map that fixes it

"How do I get my money back?" Why your search says 0 results, and the map that fixes it

Comments
4 min read
Self-host an LLM or use an API? A taxi versus car break-even sum

Self-host an LLM or use an API? A taxi versus car break-even sum

Comments 1
3 min read
Tokens and context windows: why your AI bill is 19 times bigger than you expected

Tokens and context windows: why your AI bill is 19 times bigger than you expected

Comments
4 min read
Embeddings and vector databases, explained with one small piece of arithmetic

Embeddings and vector databases, explained with one small piece of arithmetic

Comments
3 min read
Why message 50 of your chatbot costs 19x more than message 1

Why message 50 of your chatbot costs 19x more than message 1

Comments
3 min read
What does a forward deployed engineer actually do?

What does a forward deployed engineer actually do?

Comments
3 min read
How much GPU memory does an LLM need? The arithmetic, step by step

How much GPU memory does an LLM need? The arithmetic, step by step

Comments
2 min read
loading...