An LLM can write a rate limiter in seconds. It cannot decide how rate limiting should work in your system.
As models get faster, implementation gets cheaper. Judgement and the expertise behind it becomes the bottleneck.
Ben Shi
@hbishTechnologist.
Views/Opinions are my own.