Skip to content
View original post on X: LangChainOfficial
Published
22/100

LangSmith adds cache hit rate tracking for LLM agents

AILangChain says LangSmith now tracks cache hit rates for agents, showing an overall hit rate as a single stat. Users can break the rate down by thread and chart it over time with dashboard templates.
LangChainVerified on XOfficial
@LangChain
View on X

LangSmith now tracks cache hit rates for your agents 🦜

Cached LLM calls are cheaper and faster, so it's worth knowing how often your agent actually gets a hit.

📊 View your agent's overall hit rate as a single stat
🧵 Break it down thread by thread
📈 Chart it over time with our dashboard templates

Try it out today ➡️ http://smith.langchain.com

Source details

LangChain · x.comPublished

Original title: LangSmith now tracks cache hit rates for your agents 🦜