ToolFusion

Middleware for AI agent tools with semantic caching, single-flight coalescing, deduplication, and cross-tool fusion.

ToolFusion is middleware for making tool-heavy AI agents faster, cheaper, and more reliable.

  • Implements semantic caching for repeated or near-duplicate tool requests.
  • Adds single-flight coalescing and deduplication to avoid duplicate concurrent work.
  • Explores cross-tool fusion patterns for reducing latency and cost in agentic workflows.

View the repository