Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
gpu
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
DeepSeek V4.1 Flash at 42 tok/s with 256K Context on RTX 5070 Ti x2 + 5060 Ti — Full Benchmark Record
KeithVal
KeithVal
KeithVal
Follow
Nov 19
DeepSeek V4.1 Flash at 42 tok/s with 256K Context on RTX 5070 Ti x2 + 5060 Ti — Full Benchmark Record
#
llm
#
ai
#
gpu
#
machinelearning
Comments
Add Comment
10 min read
Moderation
How much GPU memory does an LLM need? The whole sum, worked out on real cards
RONI DAS
RONI DAS
RONI DAS
Follow
Nov 19
How much GPU memory does an LLM need? The whole sum, worked out on real cards
#
llm
#
gpu
#
machinelearning
#
ai
Comments
Add Comment
9 min read
Moderation
Local AI on a PC: what actually works (Whisper, translation, LLMs)
CJDARKLORD
CJDARKLORD
CJDARKLORD
Follow
Nov 19
Local AI on a PC: what actually works (Whisper, translation, LLMs)
#
ai
#
machinelearning
#
localai
#
gpu
Comments
Add Comment
2 min read
Moderation
When does reserved GPU capacity beat on-demand pricing?
Viswaretas Kotra
Viswaretas Kotra
Viswaretas Kotra
Follow
Nov 19
When does reserved GPU capacity beat on-demand pricing?
#
gpu
#
cloud
#
aws
#
machinelearning
Comments
Add Comment
9 min read
Moderation
How many tokens per second should an LLM serve on one GPU?
Viswaretas Kotra
Viswaretas Kotra
Viswaretas Kotra
Follow
Nov 18
How many tokens per second should an LLM serve on one GPU?
#
llm
#
machinelearning
#
gpu
#
performance
Comments
Add Comment
8 min read
Moderation
What are the best Shadeform alternatives for buying GPU time?
Viswaretas Kotra
Viswaretas Kotra
Viswaretas Kotra
Follow
Nov 18
What are the best Shadeform alternatives for buying GPU time?
#
gpu
#
cloud
#
machinelearning
#
ai
Comments
Add Comment
9 min read
Moderation
Why can a multi-GPU job wait while GPUs are idle?
Denis Voronko
Denis Voronko
Denis Voronko
Follow
for
Nodeox
Nov 18
Why can a multi-GPU job wait while GPUs are idle?
#
machinelearning
#
ai
#
hpc
#
gpu
Comments
Add Comment
4 min read
Moderation
How Much VRAM Does Your LLM Need? The Math Behind the EverXCloud Calculator
EverXCloud
EverXCloud
EverXCloud
Follow
Nov 18
How Much VRAM Does Your LLM Need? The Math Behind the EverXCloud Calculator
#
llm
#
gpu
#
machinelearning
#
opensource
Comments
Add Comment
4 min read
Moderation
How many LLM agent sessions can one GPU serve? Measured: 8 to 256 sessions on one NVIDIA L4, every step exact
Shalendra gaur
Shalendra gaur
Shalendra gaur
Follow
Nov 18
How many LLM agent sessions can one GPU serve? Measured: 8 to 256 sessions on one NVIDIA L4, every step exact
#
ai
#
llm
#
gpu
#
performance
Comments
Add Comment
4 min read
Moderation
Custo de GPU na RunPod em reais: a conta por hora ligada
Sinal Aberto
Sinal Aberto
Sinal Aberto
Follow
Nov 18
Custo de GPU na RunPod em reais: a conta por hora ligada
#
runpod
#
gpu
#
ia
#
cloud
Comments
Add Comment
2 min read
Moderation
A slow GPU isn't a broken GPU: grading GPUs per workload in Kubernetes (measured on real A10Gs)
praveen9161
praveen9161
praveen9161
Follow
Nov 17
A slow GPU isn't a broken GPU: grading GPUs per workload in Kubernetes (measured on real A10Gs)
#
kubernetes
#
gpu
#
mlops
#
devops
Comments
Add Comment
5 min read
Moderation
PyTorch Passed Silently. The Job Would Have Failed 20 Minutes In.
Francisco Booth
Francisco Booth
Francisco Booth
Follow
Nov 17
PyTorch Passed Silently. The Job Would Have Failed 20 Minutes In.
#
gpu
#
python
#
machinelearning
#
pytorch
Comments
Add Comment
2 min read
Moderation
What is a serverless GPU, and when should you use one?
Viswaretas Kotra
Viswaretas Kotra
Viswaretas Kotra
Follow
Nov 18
What is a serverless GPU, and when should you use one?
#
serverless
#
gpu
#
machinelearning
#
mlops
Comments
Add Comment
8 min read
Moderation
LLM selbst hosten oder per Token abrechnen? Ein Rechenweg fĂĽr Teams in der EU
ENTRONYX CLOUD
ENTRONYX CLOUD
ENTRONYX CLOUD
Follow
Nov 17
LLM selbst hosten oder per Token abrechnen? Ein Rechenweg fĂĽr Teams in der EU
#
llm
#
gpu
#
machinelearning
#
german
Comments
Add Comment
5 min read
Moderation
How to Estimate Your FPS Before You Buy a Game or Upgrade Your GPU
techverio official
techverio official
techverio official
Follow
Nov 18
How to Estimate Your FPS Before You Buy a Game or Upgrade Your GPU
#
fps
#
gpu
#
pcgaming
#
guide
Comments
Add Comment
4 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account