Draft system prompt for support agent tone
Write initial version of the customer support persona prompt emphasizing empathy and brevity.
AI Agents
Prompt Iteration Board
Prompt Iteration Board: Refine, Compare, and Lock In Winning Prompts
Prompt engineering is iterative by nature—you draft a prompt, test it, tweak it, and compare outputs before committing to a final version. The Prompt Iteration Board gives AI teams a structured kanban board to track every prompt variant from idea to production. Instead of losing versions in chat logs or scattered docs, each prompt becomes a task that moves through drafting, testing, comparison, and approval columns. Pair it with the MCP server so your AI agent can create tasks, update statuses, and move prompts through the pipeline automatically as it runs experiments. Whether you're tuning a single system prompt or managing dozens of variants across use cases, this board keeps the process visible and auditable.
kanboard.io/templates/prompt-iteration
Template preview
Prompt Iteration Board
5 columns
Backlog
3New prompt ideas and variants waiting to be drafted or tested.
Explore few-shot examples for SQL generation
Collect 5-6 candidate examples to test few-shot prompting for the SQL query agent.
Variant: shorter instructions for summarizer
Create a condensed version of the summarization prompt to test latency and quality tradeoffs.
Drafting
3Prompts currently being written or revised before testing.
Rewrite onboarding assistant prompt v3
Incorporate feedback from last test run to reduce hallucinated steps in onboarding flow.
Add guardrail clause to refund policy prompt
Insert explicit refusal instructions for out-of-policy refund requests.
Simplify formatting instructions for report agent
Reduce verbosity in formatting rules while preserving markdown table output.
Testing
3Prompts being run against sample inputs to generate outputs for review.
Run 20-sample test on refund prompt v2
Execute batch test using the MCP server to capture outputs for manual grading.
Compare temperature 0.2 vs 0.7 on summarizer
Test both settings on same input set to evaluate consistency vs creativity.
Stress test SQL prompt with edge-case schemas
Feed unusual table structures to check for query generation failures.
Comparing
2Side-by-side review of prompt variant outputs to decide which performs best.
Score onboarding prompt v2 vs v3
Rate both variants on clarity, accuracy, and tone using shared rubric.
Review summarizer outputs for hallucination rate
Compare short vs long instruction variants for factual accuracy.
Locked
2Approved prompt versions ready for production use.
Finalize support agent prompt v4
Mark as production version after passing comparison round with highest rubric score.
Approve refund policy prompt v2
Lock this version into the agent's system prompt after guardrail testing passed.
How to run this board
Step 1
Add new prompt ideas or variants to Backlog as tasks
Step 2
Move a task to Drafting while writing or revising the prompt text
Step 3
Shift to Testing once the prompt is run through sample inputs via the MCP server
Step 4
Use Comparing to score and rank variants side by side against a rubric
Step 5
Move the winning variant to Locked and mark it as the production-ready prompt
AI agent usage
Run it with AI agents
This playbook lets an AI agent manage the full prompt iteration lifecycle using the MCP server: creating tasks for new prompt drafts, moving them through Drafting, Testing, and Comparing columns, and locking in the winning version once it passes review. The agent should always update task descriptions with test results and rubric scores so humans can audit decisions later.
# Prompt Iteration Board Agent Rules
Use the MCP tools to manage prompt tasks across columns: Backlog, Drafting, Testing, Comparing, Locked.
- New prompt ideas go into Backlog via create_task.
- When starting work on a prompt, move_task it to Drafting.
- After running a test batch, move_task the prompt to Testing and update_task with output samples.
- When comparing 2+ variants, move_task both to Comparing and log rubric scores in the task description.
- Once a variant wins, move_task it to Locked and mark it as the production prompt.
Respect the free plan limit of 25 tasks per project; archive or delete_task older locked prompts if the board fills up.Create a new task in Backlog for testing a shorter version of our SQL agent prompt.
Move the refund policy prompt from Testing to Comparing and log the rubric scores from today's run.
Show me all tasks currently in the Comparing column so I can decide which prompt variant to lock in.
Learn more about the board-centric workflow in Kanban for AI Agents or open the MCP guide.
Frequently asked questions
How many prompt tasks can I track on the free plan?
The free plan supports 1 project with up to 25 tasks total, which covers a full prompt iteration cycle for most single-use-case teams. If you're running many parallel prompt experiments, consider archiving locked prompts or upgrading to pro.
Can multiple team members work on the same prompt board?
Yes, the board and its columns are shared across your project, so teammates can move tasks through Drafting, Testing, Comparing, and Locked together, with changes visible to everyone via the kanban board.
How does the MCP server help with prompt testing?
The MCP server lets your AI agent create_task, update_task, and move_task automatically as it runs prompt experiments, so test results and comparisons get logged without manual data entry.
What happens if I exceed 25 tasks on the free plan?
You'll need to delete or archive completed tasks, such as older Locked prompts that are no longer active, or upgrade to the pro plan ($12/mo or $96/yr) for higher limits.
Can I use keyboard shortcuts or the command palette to move prompts between columns?
Yes, the kanban board supports keyboard shortcuts and a command palette for quickly moving tasks between columns like Testing and Comparing without reaching for the mouse.
Is there a desktop app for managing this board?
Yes, a macOS app is available so you can manage your Prompt Iteration Board and review task details outside the browser.
Related templates
Ready to create this board?
Sign in and use the template to create a project with columns and sample tasks.