home.social

#promptcaching — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #promptcaching, aggregated by home.social.

  1. I added prompt caching to my Anthropic Batch API workflow. The hit rate was 0%.

    Each model has a minimum cacheable token count — 4,096 for Haiku 4.5. If your cache_control block is below that, the API silently ignores it. Successful response, zero cache reads, no warning.

    My IAB taxonomy prompt was 1,064 tokens. Well under the threshold.

    Full write-up:

    mikenoe.com/posts/prompt-cachi

    #AnthropicAPI #LLM #PromptCaching #AIEngineering

  2. OPENAI API EMBRACES "PROMPT CACHING"

    OpenAI API prompt caching, starting March 22, 2026, helps AI applications save money and time by reusing prompt tokens. Learn how it works.

    #OpenAIAPI, #PromptCaching, #AITechnology, #LLM, #TechNews

    newsletter.tf/openai-api-promp

  3. OpenAI API's new prompt caching feature can save users money and time. This is because it reuses parts of prompts, like saving common phrases.

    #OpenAIAPI, #PromptCaching, #AITechnology, #LLM, #TechNews
    newsletter.tf/openai-api-promp

  4. Oh look, another genius idea from the depths of corporate innovation 🤔: cut costs with 'prompt caching' and save those precious LLM tokens 💰. Because clearly, the problem is not the convoluted explanations but *how* to make them cheaper in bulk. As if slapping a price tag on incomprehensibility is the ultimate solution 🎉.
    ngrok.com/blog/prompt-caching/ #corporateinnovation #promptcaching #costcutting #LLMtokens #techsatire #businessstrategy #HackerNews #ngated