Which test case management tools does BuildButler support?

BuildButler supports TestRail, ALM (Micro Focus / OpenText), Xray for Jira, and Zephyr Scale for Jira.

How does the TCM export work?

You define JSON rules that pattern-match CI jobs (e.g. backend/*) and map them to TCM projects, test plans, and test runs. After each build, BuildButler automatically creates or updates test cases and uploads results. Template variables like {jobName} and {buildNumber} let you name test runs dynamically.

Does BuildButler support ALM defect management?

Yes. For ALM integrations, BuildButler can automatically create defects for failing tests, reopen defects for recurring failures, and close defects when tests pass again. You control the create/reopen/resolve policies and status mappings.

What CI/CD systems does BuildButler support?

BuildButler currently supports Jenkins, TeamCity, GitHub Actions, and GitLab CI. BuildKite support is in progress.

How does BuildButler connect to Jenkins?

BuildButler connects via the Jenkins REST API using an API token. There are no Jenkins plugins to install for the Cloud version. The Local plugin installs directly in Jenkins for on-premise setups with TCM post-build steps.

Is my build data secure?

Yes. All data is encrypted in transit (TLS) and at rest. BuildButler never stores source code, credentials, or secrets. We only collect build metadata, test results, and pipeline stage information.

Can I self-host BuildButler?

Self-hosting is possible with the Jenkins Local plugin using your own Postgres database. This includes full TCM integration, analytics, and the complete BuildButler UX.

How does flaky test detection work?

BuildButler tracks every test execution over time. A test is flagged as flaky if it flips between pass and fail 5+ times in 30 runs, or has a pass rate below 80%. You can customize these thresholds in Settings.

How long does setup take?

Most teams are up and running in under 10 minutes. Install the plugin, configure your TCM export rules as JSON, and results start syncing on the next build.

Is there an API available?

Yes. BuildButler provides a REST API for programmatic access to your build data, test results, and pipeline metrics. Full documentation is available in the docs.

BuildButler

Test Case Management

TestRail, ALM, Xray, Zephyr

Jenkins, GitLab, GitHub

CI Analytics & AI Insights

CI Tests to TestRail, Automatically

Automatically export CI test results to TestRail, ALM, Xray, and Zephyr Scale. Pattern-match jobs, map to projects, and sync results without manual effort. Plus CI analytics, flaky test detection, and AI-powered insights.

Watch Demo

BuildButler TestRail Integration — automatic test result export configuration

BuildButler ALM Integration — HP ALM test case management settings

BuildButler Xray Integration — Xray for Jira test management settings

BuildButler Zephyr Scale Integration — Zephyr Scale test management settings

BuildButler Jenkins Analytics Dashboard — build trends, status by job, and build results table

BuildButler Test Analytics — combined and per-job test trend analysis across multiple jobs

BuildButler Flaky Tests — flaky test detection with pass/fail history visualization

BuildButler Build Details — pipeline stages, test results, failed tests with triage notes

BuildButler Pipeline Stages — stage duration scatter plot with build selection

BuildButler Ask AI — AI-powered chat interface for build failure analysis

CI test results where they belong

Sync test results to your TCM tools automatically. Monitor builds, detect flaky tests, and query your CI data with AI.

TCM Integration

Automatically export CI test results to TestRail, ALM, Xray, and Zephyr Scale. Pattern-match jobs to projects using JSON rules with template variables.

ALM Defect Management

Auto-create, reopen, and close defects in HP ALM based on test results. Configurable severity, status mappings, and custom field values.

Test Intelligence

Deep test result analysis with flaky test detection, test history tracking, and failure pattern recognition.

Build Analytics

Real-time build trends, success rates, and duration metrics across all your Jenkins jobs and pipelines.

Flaky Test Detection

Track every test execution over time. Flag tests that flip between pass and fail. Customize detection thresholds and view flaky history.

Ask AI

Natural language queries about your build data. Ask "why did the deploy fail?" and get instant answers.

Pipeline Visibility

Visualize pipeline stage execution, identify bottlenecks, and track stage-level duration trends.

Notifications & Alerts

Slack webhooks and email rules with pattern matching. Get alerted on build failures, unstable runs, agent offline events, and queue spikes.

JIRA Integration & Triage

Automatically create and sync JIRA tickets from failing builds and tests. Triage failures directly in BuildButler and push updates back to JIRA.

Up and running in three steps

Connect your CI, configure your TCM rules, and test results sync on every build.

Install the BuildButler Plugin

Add the Jenkins plugin or connect via GitLab/GitHub. BuildButler starts collecting build and test data from your CI pipelines automatically.

Configure TCM Export Rules

Define JSON rules to pattern-match CI jobs and map test results to TestRail projects, ALM test plans, Xray test executions, or Zephyr Scale cycles. Use template variables for dynamic naming.

Results Sync Automatically

Every build triggers an automatic export. Test cases are created or updated in your TCM tool. ALM defects are managed automatically. Plus CI analytics, flaky test detection, and AI insights.

Simple, transparent pricing

Start with 20 builds/day for free. Scale as your team grows.

Starter

Free

For individuals and small teams getting started

20 builds per day
Unlimited CI Servers
Build results & trends
Test Case Management
Flaky Test Management
JIRA Integration
Ask AI
Slack and Email Alerts
Email Support

Start Free

Professional

Contact Sales

For growing teams that need deeper insights

Unlimited builds
Unlimited CI Servers
Build results & trends
Test Case Management
Flaky Test Management
JIRA Integration
Ask AI
Slack and Email Alerts
Email Support

Contact Sales

Enterprise

Contact Sales

For organizations that need full control and scale

Everything in Pro
Enterprise Support
Email/Zoom Support
48 Hour SLA
Dedicated Database
On-premise installation

Contact Sales

Frequently asked questions

Ready to automate your test result management?

Start with 20 builds/day for free. TCM integration included on all plans.