Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llmapi
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Why does AI say "too many requests" after one message?
System Design Simple
System Design Simple
System Design Simple
Follow
Nov 19
Why does AI say "too many requests" after one message?
#
aisystems
#
ratelimiting
#
tokenbucket
#
llmapi
Comments
Add Comment
7 min read
Moderation
My eco-tier LLM calls broke JSON 6% of the time — a routing tier is a distribution of models, not a model
InApp
InApp
InApp
Follow
Oct 8
My eco-tier LLM calls broke JSON 6% of the time — a routing tier is a distribution of models, not a model
#
llmapi
#
modelrouting
#
json
#
ai
Comments
Add Comment
2 min read
Moderation
Mistral Large 4 Preview: Pricing, Benchmarks, Open Weights
Anup Karanjkar
Anup Karanjkar
Anup Karanjkar
Follow
Oct 8
Mistral Large 4 Preview: Pricing, Benchmarks, Open Weights
#
mistrallarge
#
mistralopen
#
mixtureof
#
llmapi
Comments
Add Comment
7 min read
Moderation
My LLM API Bill Hit $5K/Month. Here's What I Tried to Bring It Down to $2K.
Johny Tech
Johny Tech
Johny Tech
Follow
Oct 20
My LLM API Bill Hit $5K/Month. Here's What I Tried to Bring It Down to $2K.
#
llmcost
#
costoptimization
#
llmapi
#
ai
1
 reaction
Comments
Add Comment
6 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account