CompletionKit
Server Details
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
- Status
- Healthy
- Last Tested
- Transport
- Streamable HTTP
- URL
- Repository
- homemade-software-inc/completion-kit
- GitHub Stars
- 1
Glama MCP Gateway
Connect through Glama MCP Gateway for full control over tool access and complete visibility into every call.
Full call logging
Every tool call is logged with complete inputs and outputs, so you can debug issues and audit what your agents are doing.
Tool access control
Enable or disable individual tools per connector, so you decide what your agents can and cannot do.
Managed credentials
Glama handles OAuth flows, token storage, and automatic rotation, so credentials never expire on your clients.
Usage analytics
See which tools your agents call, how often, and when, so you can understand usage patterns and catch anomalies.
Tool Definition Quality
Average 3.1/5 across 47 of 50 tools scored. Lowest: 1.5/5.
Each tool has a clearly distinct purpose, with descriptions that differentiate even closely related operations like 'datasets_create' vs 'datasets_create_from_url' and 'prompts_suggest_improvement' vs 'prompts_update'. No tools appear to do the same thing.
The naming pattern is overwhelmingly consistent (entity_action, e.g., 'datasets_create', 'prompts_list'). The only outlier is 'promptfoo_import', which uses a non-standard format but is a single deviation.
With 50 tools, the server is on the high side, but the comprehensive domain of managing datasets, prompts, metrics, runs, tags, and credentials justifies the count. It is borderline heavy but not excessive.
The tool set covers the full lifecycle of evaluation workflows: CRUD for all core entities (datasets, prompts, metrics, runs, tags, credentials), plus specialized operations like agreement management, judge comparison, and promptfoo import. No obvious gaps are present.
Claim this connector by publishing a /.well-known/glama.json file on your server's domain with the following structure:
{
"$schema": "https://glama.ai/mcp/schemas/connector.json",
"maintainers": [{ "email": "your-email@example.com" }]
}The email address must match the email associated with your Glama account. Once published, Glama will automatically detect and verify the file within a few minutes.
Control your server's listing on Glama, including description and metadata
Access analytics and receive server usage reports
Get monitoring and health status updates for your server
Feature your server to boost visibility and reach more users
For users:
Full audit trail – every tool call is logged with inputs and outputs for compliance and debugging
Granular tool control – enable or disable individual tools per connector to limit what your AI agents can do
Centralized credential management – store and rotate API keys and OAuth tokens in one place
Change alerts – get notified when a connector changes its schema, adds or removes tools, or updates tool definitions, so nothing breaks silently
For server owners:
Proven adoption – public usage metrics on your listing show real-world traction and build trust with prospective users
Tool-level analytics – see which tools are being used most, helping you prioritize development and documentation
Direct user feedback – users can report issues and suggest improvements through the listing, giving you a channel you would not have otherwise
The connector status is unhealthy when Glama is unable to successfully connect to the server. This can happen for several reasons:
The server is experiencing an outage
The URL of the server is wrong
Credentials required to access the server are missing or invalid
If you are the owner of this MCP connector and would like to make modifications to the listing, including providing test credentials for accessing the server, please contact support@glama.ai.
Discussions
No comments yet. Be the first to start the discussion!