#promptcaching — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #promptcaching, aggregated by home.social.
-
I added prompt caching to my Anthropic Batch API workflow. The hit rate was 0%.
Each model has a minimum cacheable token count — 4,096 for Haiku 4.5. If your cache_control block is below that, the API silently ignores it. Successful response, zero cache reads, no warning.
My IAB taxonomy prompt was 1,064 tokens. Well under the threshold.
Full write-up:
-
OPENAI API EMBRACES "PROMPT CACHING"
OpenAI API prompt caching, starting March 22, 2026, helps AI applications save money and time by reusing prompt tokens. Learn how it works.
#OpenAIAPI, #PromptCaching, #AITechnology, #LLM, #TechNews
https://newsletter.tf/openai-api-prompt-caching-saves-money-time/
-
OpenAI API's new prompt caching feature can save users money and time. This is because it reuses parts of prompts, like saving common phrases.
#OpenAIAPI, #PromptCaching, #AITechnology, #LLM, #TechNews
https://newsletter.tf/openai-api-prompt-caching-saves-money-time/ -
Prompt-caching – auto-injects Anthropic cache breakpoints (90% token savings)
#HackerNews #PromptCaching #AutoInject #Anthropic #TokenSavings #CacheBreakpoints
-
Prompt-caching – auto-injects Anthropic cache breakpoints (90% token savings)
#HackerNews #PromptCaching #AutoInject #Anthropic #TokenSavings #CacheBreakpoints
-
Prompt-caching – auto-injects Anthropic cache breakpoints (90% token savings)
#HackerNews #PromptCaching #AutoInject #Anthropic #TokenSavings #CacheBreakpoints
-
Prompt-caching – auto-injects Anthropic cache breakpoints (90% token savings)
#HackerNews #PromptCaching #AutoInject #Anthropic #TokenSavings #CacheBreakpoints
-
Prompt-caching – auto-injects Anthropic cache breakpoints (90% token savings)
#HackerNews #PromptCaching #AutoInject #Anthropic #TokenSavings #CacheBreakpoints
-
Strands AgentsでClaudeモデルのプロンプトキャッシュを使う方法
https://qiita.com/moritalous/items/062b06bed7b4a08f5fad?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items -
Strands AgentsでClaudeモデルのプロンプトキャッシュを使う方法
https://qiita.com/moritalous/items/062b06bed7b4a08f5fad?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items -
Oh look, another genius idea from the depths of corporate innovation 🤔: cut costs with 'prompt caching' and save those precious LLM tokens 💰. Because clearly, the problem is not the convoluted explanations but *how* to make them cheaper in bulk. As if slapping a price tag on incomprehensibility is the ultimate solution 🎉.
https://ngrok.com/blog/prompt-caching/ #corporateinnovation #promptcaching #costcutting #LLMtokens #techsatire #businessstrategy #HackerNews #ngated -
Prompt caching: 10x cheaper LLM tokens, but how?
https://ngrok.com/blog/prompt-caching/
#HackerNews #PromptCaching #LLMtokens #AItechnology #costefficiency #machinelearning