Braintrust is automatable through its API
Braintrust · hybrid · observabilitydeveloper-tools
Braintrust is automatable today through its REST API. The API reference says it covers projects, experiments, datasets, logs, prompts, functions, scores, users, roles, and API keys. Requests use Authorization Bearer with a Braintrust API key. The US base URL is https://api.braintrust.dev, the EU base URL is https://api-eu.braintrust.dev, and self-hosted organizations use their data-plane URL. Responses are JSON. An OpenAPI document is published, and SQL query is documented at /btql. Rate limits return 429. Official SDKs are listed for TypeScript, Python, Go, Ruby, Java, and C#. The bt CLI installs from bt.dev, npm, or mise, and authenticates with BRAINTRUST_API_KEY or a saved OAuth profile. It runs evals, queries logs, syncs data, and manages functions. Braintrust also hosts an MCP server at https://api.braintrust.dev/mcp, with EU and self-hosted URLs. Clients authenticate with OAuth or a bearer API key. Documented tools query logs, author prompts and scorers, configure Topics and monitors, and run evaluations. Write tools use the authenticated account's permissions. Zapier, Make, Power Automate, and n8n catalog pages were not opened. Computer-use viability is unassessed. API, MCP, and CLI each score 8. The API is the best path because the CLI and MCP use the same platform credentials, and an HTTPS client does not need a local binary or an MCP transport.
Best path today: api · Overall automatability: 8/10
Modalities
| Modality | Status | Detail |
|---|---|---|
| API | yes | restopenapibearer coverage: partial · docs |
| SDK | yes | pythontypescriptgorubyjavacsharp official: yes |
| MCP | yes | verdict: official |
| Integrations | unknown | |
| CLI | yes | |
| Extensibility | unknown | webhooks: unknown |
| Data access | export: json · import: json | |
| RPA / UI automation | unknown | web-dom No repeatable UI probe was run. Braintrust Cloud is a web application, and self-hosted data planes are also documented. The documented machine paths are the REST API, the bt CLI, and the hosted MCP server.
|
| Computer use | unknown | measured verdicts only — "unknown" means not yet probed by us |
Scores
| api | mcp | integrations | cli | rpa | computer use | overall |
|---|---|---|---|---|---|---|
| 8 | 8 | — | 8 | — | — | 8 |
Evidence
| Fact | Tier | Source | Date |
|---|---|---|---|
homepage | declared | source | 2026-10-16 |
name | declared | source | 2026-10-16 |
vendor | declared | source | 2026-10-16 |
license | declared | source | 2026-10-16 |
deployment | declared | source | 2026-10-16 |
modalities.api.exists | declared | source | 2026-10-16 |
modalities.api.kinds[0] | declared | source | 2026-10-16 |
modalities.api.kinds[1] | declared | source | 2026-10-16 |
modalities.api.auth[0] | declared | source | 2026-10-16 |
modalities.api.coverage | declared | source | 2026-10-16 |
modalities.api.docs | declared | source | 2026-10-16 |
modalities.sdk.exists | declared | source | 2026-10-16 |
modalities.sdk.official | declared | source | 2026-10-16 |
modalities.sdk.languages | declared | source | 2026-10-16 |
modalities.mcp.first_party | declared | source | 2026-10-16 |
modalities.mcp.verdict | declared | source | 2026-10-16 |
modalities.cli.exists | declared | source | 2026-10-16 |
modalities.data_access.export[0] | declared | source | 2026-10-16 |
modalities.data_access.import[0] | declared | source | 2026-10-16 |
modalities.agent_docs.llms_txt | declared | source | 2026-10-16 |
verdict.scores.api | declared | source | 2026-10-16 |
verdict.scores.mcp | declared | source | 2026-10-16 |
verdict.scores.cli | declared | source | 2026-10-16 |
freshness.watch[0].url | declared | source | 2026-10-16 |
freshness.watch[1].url | declared | source | 2026-10-16 |
freshness.watch[2].url | declared | source | 2026-10-16 |
freshness.watch[3].url | declared | source | 2026-10-16 |
Related tools
Other products in this database that share a category with Braintrust.
Last verified 2026-10-16 · volatility high · JSON record