Availability
| Edition | Deployment Type |
|---|---|
| Community & Enterprise | Self-Managed, Hybrid |
Unified Plugin SDK
All plugins now use a single SDK (pkg/plugin_sdk) that works seamlessly in both AI Studio and Edge Gateway contexts. The SDK automatically detects the runtime environment and provides appropriate capabilities.
Key Features
- Single Import: One SDK works everywhere
- 10 Plugin Capabilities: Mix and match to build exactly what you need
- Runtime Detection: Automatic AI Studio vs Edge Gateway detection
- Service API Access: Built-in KV storage, logging, and management APIs
- Type-Safe: Clean Go interfaces, no manual proto handling
Plugin Capabilities
Plugins implement one or more of these 12 capabilities:| Capability | Where It Works | Purpose | Common Use Cases |
|---|---|---|---|
| Pre-Auth | Studio + Gateway | Process before authentication | IP filtering, request validation |
| Auth | Studio + Gateway | Custom authentication | OAuth, API keys, JWT validation |
| Post-Auth | Studio + Gateway | Process after authentication | Request enrichment, policy enforcement |
| Response | Studio + Gateway | Modify responses | Content filtering, header injection |
| Data Collection | Studio + Gateway | Collect telemetry | Export to Elasticsearch, ClickHouse |
| Custom Endpoints | Gateway | Serve custom HTTP endpoints | MCP proxy, OAuth provider, webhooks |
| Object Hooks | Studio only | Intercept CRUD operations | Validation, approval workflows |
| Agent | Studio only | Conversational AI | Chat-based agents, LLM wrapping |
| UI Provider | Studio only | Dashboard extensions | Custom dashboards, admin tools |
| Portal UI | Studio only | Portal extensions | User-facing forms, pages, dashboards |
| Config Provider | Studio + Gateway | Provide JSON Schema config | Dynamic configuration |
| Manifest Provider | Gateway only | Plugin manifest | Gateway-only plugins |
Multi-Capability Plugins
A single plugin can implement multiple capabilities. For example, a rate limiter might:- Implement Post-Auth to check limits before request
- Implement Response to update counters after response
- Implement UI Provider to show rate limit dashboard
Plugin Types Overview
While all plugins use the unified SDK, they generally fall into three categories based on their primary use case:1. Edge Gateway Plugins
Edge Gateway plugins provide middleware hooks in the LLM proxy request/response pipeline using the unified SDK. Learn more →2. AI Studio UI Plugins
AI Studio UI plugins extend the dashboard with custom WebComponents, adding new pages, sidebars, and interactive features to the admin interface. These also use the unified SDK and can combine UI capabilities with middleware hooks. Learn more →3. AI Studio Agent Plugins
Experimental Feature: Agent plugins are currently experimental. The API and behavior may change in future releases.Agent plugins enable conversational AI experiences in the Chat Interface using the unified SDK. These plugins can wrap LLMs, add custom logic, integrate external services, and create sophisticated multi-turn conversations. Learn more →
4. Object Hooks Plugins
Object Hooks are a powerful AI Studio-only capability that allows plugins to intercept and control CRUD operations on key objects before they reach the database. This is particularly useful for validation, approval workflows, and policy enforcement. Learn more →Plugin Architecture
Monolithic Plugin Architecture
A single plugin binary can run in both AI Studio and the Edge Gateway, so long as the requisite interfaces are implemented and the requirements are clear in the manifest file. This means one plugin can provide UI extensions in Studio, middleware hooks in the gateway, and even use the event bus to communicate between its Studio and gateway components in near-real-time.Scheduled Tasks
Studio plugins can register scheduled tasks — periodic calls from the host to the plugin on a configurable interval. This enables long-running background jobs such as analytics analysis, compliance checks, log scanning, or data synchronization.Process Isolation
Plugins run as separate processes, communicating with the main platform via gRPC. This provides:- Security: Plugin crashes don’t affect the main platform
- Language Flexibility: While the gRPC protocol theoretically supports any language, only Go plugins have been tested in production. If you plan to write plugins in another language, expect to do additional integration work.
- Resource Management: Plugins can be restarted independently
- Version Independence: Update plugins without platform restarts
Communication Flow
Service API (AI Studio Plugins Only)
AI Studio UI and Agent plugins can access the Service API via a reverse gRPC broker connection: The Service API provides 100+ gRPC operations for managing LLMs, apps, tools, datasources, analytics, and more. Access is controlled via permission scopes declared in the plugin manifest. Learn more about Service API →Deployment Options
Plugins support three deployment methods:file://
Local filesystem plugins for development and testing:grpc://
Remote gRPC plugins running as network services:oci://
Container registry plugins (OCI artifacts):Permissions and Scopes
AI Studio plugins declare required permissions in their manifest:Getting Started
Choose Your Plugin Type
- Need to intercept/modify LLM requests? → Edge Gateway Plugin
- Building dashboard UI features? → AI Studio UI Plugin
- Creating conversational AI experiences? → AI Studio Agent Plugin
Development Workflow
- Choose your plugin type
- Read the specific plugin guide
- Review example plugins in
examples/plugins/andcommunity/plugins/ - Use the SDK to implement required interfaces
- Build and test with
file://deployment (see Development Workflow Guide for fast iteration) - Deploy with
grpc://oroci://for production
POST /api/v1/plugins/{id}/reload) to test changes instantly without reinstalling. See the Development Workflow Guide for the fastest iteration loop.
SDK Installation
All plugins use the unified SDK:microgateway/plugins/sdk or pkg/ai_studio_sdk), see the Migration Guide for upgrade instructions.