Braintrust is automatable through its API

Braintrust · hybrid · observabilitydeveloper-tools

Braintrust is automatable today through its REST API. The API reference says it covers projects, experiments, datasets, logs, prompts, functions, scores, users, roles, and API keys. Requests use Authorization Bearer with a Braintrust API key. The US base URL is https://api.braintrust.dev, the EU base URL is https://api-eu.braintrust.dev, and self-hosted organizations use their data-plane URL. Responses are JSON. An OpenAPI document is published, and SQL query is documented at /btql. Rate limits return 429. Official SDKs are listed for TypeScript, Python, Go, Ruby, Java, and C#. The bt CLI installs from bt.dev, npm, or mise, and authenticates with BRAINTRUST_API_KEY or a saved OAuth profile. It runs evals, queries logs, syncs data, and manages functions. Braintrust also hosts an MCP server at https://api.braintrust.dev/mcp, with EU and self-hosted URLs. Clients authenticate with OAuth or a bearer API key. Documented tools query logs, author prompts and scorers, configure Topics and monitors, and run evaluations. Write tools use the authenticated account's permissions. Zapier, Make, Power Automate, and n8n catalog pages were not opened. Computer-use viability is unassessed. API, MCP, and CLI each score 8. The API is the best path because the CLI and MCP use the same platform credentials, and an HTTPS client does not need a local binary or an MCP transport.

Best path today: api · Overall automatability: 8/10

Modalities

ModalityStatusDetail
APIyesrestopenapibearer
coverage: partial · docs
SDKyespythontypescriptgorubyjavacsharp
official: yes
MCPyes
verdict: official
Integrationsunknown
CLIyes
Extensibilityunknown
webhooks: unknown
Data access
export: json · import: json
RPA / UI automationunknownweb-dom
No repeatable UI probe was run. Braintrust Cloud is a web application, and self-hosted data planes are also documented. The documented machine paths are the REST API, the bt CLI, and the hosted MCP server.
Computer useunknown
measured verdicts only — "unknown" means not yet probed by us

Scores

apimcpintegrationsclirpacomputer useoverall
88—8——8

Evidence

FactTierSourceDate
homepagedeclaredsource2026-10-16
namedeclaredsource2026-10-16
vendordeclaredsource2026-10-16
licensedeclaredsource2026-10-16
deploymentdeclaredsource2026-10-16
modalities.api.existsdeclaredsource2026-10-16
modalities.api.kinds[0]declaredsource2026-10-16
modalities.api.kinds[1]declaredsource2026-10-16
modalities.api.auth[0]declaredsource2026-10-16
modalities.api.coveragedeclaredsource2026-10-16
modalities.api.docsdeclaredsource2026-10-16
modalities.sdk.existsdeclaredsource2026-10-16
modalities.sdk.officialdeclaredsource2026-10-16
modalities.sdk.languagesdeclaredsource2026-10-16
modalities.mcp.first_partydeclaredsource2026-10-16
modalities.mcp.verdictdeclaredsource2026-10-16
modalities.cli.existsdeclaredsource2026-10-16
modalities.data_access.export[0]declaredsource2026-10-16
modalities.data_access.import[0]declaredsource2026-10-16
modalities.agent_docs.llms_txtdeclaredsource2026-10-16
verdict.scores.apideclaredsource2026-10-16
verdict.scores.mcpdeclaredsource2026-10-16
verdict.scores.clideclaredsource2026-10-16
freshness.watch[0].urldeclaredsource2026-10-16
freshness.watch[1].urldeclaredsource2026-10-16
freshness.watch[2].urldeclaredsource2026-10-16
freshness.watch[3].urldeclaredsource2026-10-16

Related tools

Other products in this database that share a category with Braintrust.

Last verified 2026-10-16 · volatility high · JSON record