BuildButler

Test Case Management

Push test results to external test management platforms automatically.

Push test results to external test management platforms automatically when tests are ingested. Configure credentials and mapping rules to control which jobs sync to which projects.

TestRail

TestRail settings

  • TestRail Base URL — e.g. https://yourcompany.testrail.io
  • TestRail Email — your TestRail account email
  • TestRail API Key — generate from TestRail under My Settings → API Keys
  • Job Mappings (JSON) — rules mapping job patterns to TestRail projects and test runs

Example mapping:

[
  {
    "jobPattern": "foo*",
    "project": "buildbutler",
    "testPath": "Automated Tests/API",
    "testRun": "{jobName} #{buildNumber}",
    "searchMode": "name",
    "caseType": "Automated",
    "casePriority": "Medium",
    "closeRun": false,
    "fullyQualifiedTestName": true,
    "caseFields": { "Preconditions": "value 1" }
  }
]

Xray

Coming soon

Xray settings

  • Xray Base URLhttps://xray.cloud.getxray.app (Cloud) or your Jira URL (Server)
  • Client ID / Email — Cloud: client ID, Server: email
  • Client Secret / API Token — Cloud: client secret, Server: API token
  • Job Mappings (JSON) — rules mapping job patterns to Xray projects

Example mapping:

[
  {
    "jobPattern": "my-app/*",
    "projectKey": "PROJ",
    "testPlanKey": "PROJ-100",
    "executionSummary": "{jobName} #{buildNumber}"
  }
]

Fields: jobPattern, projectKey, testPlanKey, executionSummary, testType, labels, environments.

Zephyr Scale

Coming soon

Zephyr Scale settings

  • Zephyr Scale API Base URL — e.g. https://api.zephyrscale.smartbear.com/v2
  • Jira Base URL — e.g. https://company.atlassian.net
  • API Token — your Zephyr Scale API token
  • Job Mappings (JSON) — rules mapping job patterns to Zephyr Scale projects

Example mapping:

[
  {
    "jobPattern": "my-app/*",
    "projectKey": "PROJ",
    "folderName": "Automated Tests",
    "cycleName": "{jobName} #{buildNumber}",
    "labels": ["automated"],
    "environment": "staging"
  }
]

Fields: jobPattern, projectKey, folderName, cycleName, labels, environment. Templates support {jobName}, {buildNumber}, {branch}.

ALM (Micro Focus / OpenText)

Coming soon

ALM settings

  • ALM Base URL — e.g. https://alm.company.com/qcbin
  • Username — your ALM username
  • Password — your ALM password
  • Job Mappings (JSON) — rules mapping job patterns to ALM projects

Example mapping:

[
  {
    "jobPattern": "my-app/*",
    "domain": "DEFAULT",
    "project": "MyProject",
    "testFolderPath": "Subject\\Automated Tests",
    "testSetName": "{jobName} #{buildNumber}"
  }
]

Fields: jobPattern, domain, project, testFolderPath, testSetFolderPath, testSetName.

On this page