Open-source CLI and MCP server for evaluating AI applications and gating releases with reliability evidence.
Last commit October 15, 2026, 26 days ago.
32 GitHub stars and 0 Honeystax upvotes. Copy the install, test the workflow, then decide if it earns a permanent slot.
You can test this quickly and remove it cleanly if it misses.
Starts at 6. Added: GitHub health not measured +10, no security policy +8, no contributing guide +4, no code of conduct +3.
AI Agent
Universal
Model
Multiple
Fastest way to find out if plumloom-autoeval-oss belongs in your setup.
Copy the install command, run a real test, and back it out cleanly if it slows you down.
claude mcp add plumloom-autoeval-oss -- npx plumloom-autoeval-ossRun this first. You will know quickly if the workflow earns a permanent slot.
claude mcp remove plumloom-autoeval-ossNo messy cleanup loop. If it misses, remove it and keep moving.
Install Location
~/ └─ .claude.json └─ mcp_servers/ └─ plumloom-autoeval-oss ← registers here
plumloom-autoeval-oss is listed on Honeystax as a MCP Server for Universal, since October 8, 2026. Its code is at github.com/AlchemyInCode/plumloom-autoeval-oss, with 32 GitHub stars. Last commit October 15, 2026, 26 days ago.
Source: GitHub repository
Source check: October 15, 2026
Upstream commit: October 15, 2026
Repository state: Not marked archived
Honeystax upvotes are community interest signals, not star ratings. GitHub stars and repository health are source measurements; editorial risk and trial-cost notes are Honeystax analysis.