Consumer, transport, gateway, middleware, backend services, registry, and data. Every request traverses the full middleware stack before reaching a backend. This enforces consistent security, observability, and policy regardless of which component is accessed.
Bud MCP Foundry delivers a layered architecture that separates concerns across consumer, transport, gateway, middleware, services, platform capabilities, registry, and data layers. Every request traverses the full middleware stack before reaching a backend service.
Below is each layer's specification, the complete middleware responsibility table, all six backend services, the unified four-tier MCP Registry, and the internals of Bifrost and federation.
AI agents are the primary programmatic consumers. They establish authenticated sessions via JWT, OAuth, or SSO tokens; discover capabilities through standard MCP methods (tools/list, resources/list, prompts/list); invoke tools via tools/call; and participate in multi-agent coordination through the A2A Service.
The platform accepts commercial AI assistants (Claude, ChatGPT, Gemini, Cursor), open-source agent frameworks (LangChain, CrewAI, AutoGen, LangGraph), custom-built agents, the React Web Dashboard for administration, programmatic REST/CLI/SDK clients, federated peer Foundries, and editor integrations via stdio MCP wrapping.
The transport layer accepts five protocols and presents a consistent invocation semantics to the middleware stack above it.
Low-latency request-response operations. Standard REST for administrative calls and synchronous tool invocations.
Uni-directional streaming for long-running tool invocations and MCP protocol sessions.
Full-duplex bidirectional communication for low-latency, interactive sessions.
MCP Streamable HTTP transport, specification version 2025-06-18. Bidirectional with session resumability.
Support via mcpgateway-wrapper for editor plugins and CLI clients. Automatically bridged to HTTP/SSE by the platform.
Built on a high-performance ASGI framework with ORJSON serialization (5-6x faster than stdlib JSON). Accepts and validates inbound connections, routes requests to the correct service endpoint, applies the middleware stack in defined order, serves OpenAPI documentation (Swagger UI), and exposes /health, /ready, and /health/security endpoints.
Execution order: CORS and compression (outermost), followed by security headers, protocol validation, token scoping, authentication, RBAC, request logging, and observability instrumentation (innermost).
Each service has a defined responsibility, its own telemetry surface, and a contract exposed through the API gateway.
Discovers peer gateways through DNS-SD / mDNS (Zeroconf), static peer lists, and peer exchange. Monitors peer health with configurable thresholds. Forwards tool invocation requests to the gateway that owns the requested tool. Aggregates responses across federated peers. Synchronizes capability catalogs.
Manages peer gateway lifecycle: registration, health monitoring, capability ingestion, decommissioning. Handles gateway-level OAuth token management and refresh flows.
The central registry and invocation engine. Registers tools with JSON Schema input validation. Invokes tools with schema validation, timeout enforcement, and error handling. Executes pre- and post-invocation plugin chains. Tracks per-tool metrics.
Multi-tenant team isolation. Manages team membership, roles, and history. Scopes tool, resource, prompt, and server visibility to specific teams. Maintains audit trails of team membership changes.
Implements Agent-to-Agent communication protocol. Registers external AI agents with endpoint URLs, capabilities, and authentication requirements. Proxies inter-agent communication. Tracks per-agent metrics.
Manages virtual MCP servers: logical groupings of tools, resources, prompts, and A2A agents exposed as cohesive endpoints. Publishes to the Skills Registry.
The registry unifies all four connectivity modes behind a single governance plane. Consumers see one catalog. Bifrost routes to the correct backend.
1,000+ third-party MCPs federated over HTTPS / SSE / Streamable HTTP. OAuth via Fernet-encrypted credentials.
Self-hosted stdio MCPs auto-bridged to HTTP/SSE. Subprocess lifecycle, keepalive, horizontal scaling, Redis session state.
Custom MCPs produced by the Ingestion → Crawler → Enhancer → Evaluator pipeline from enterprise assets.
Tools, resources, and prompts managed natively via the Skills Hub. Stored in PostgreSQL, executed by the platform's service layer.
Fine-tuned connection pooling for high-concurrency deployments. Every service emits telemetry through a common instrumentation layer.
Bifrost is the internal routing plane that abstracts multi-protocol, multi-origin MCP server connectivity into a unified dispatch layer. It is the component that makes the four-tier tool management look like one tier to consumers.
The Federation Service discovers peer gateways through three mechanisms:
Each peer is monitored with configurable thresholds. Auto-healing uses separated enabled and reachable status fields. Unhealthy peers are auto-excluded from routing until they recover, and operators can force inclusion or exclusion through the dashboard.
Tool invocation requests are forwarded to the gateway that owns the requested tool. For requests that span multiple peers (discovery, broadcast), responses are aggregated, deduplicated, and returned as a single MCP-compliant response.
Each federated peer advertises its catalog through standard MCP methods. Capability changes are propagated as change events. Composite key identity resolution prevents collisions when peers independently publish tools with the same name.
Review the security and compliance specification, the full integrations catalog, or industry-specific deployment patterns.