{
 "categories": [
  "observability",
  "developer-tools"
 ],
 "deployment": "hybrid",
 "evidence": [
  {
   "date": "2026-09-29",
   "fact": "homepage",
   "note": "LangChain presents LangSmith as an agent and LLM observability platform with tracing SDKs and self-hosted deployment.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "deployment",
   "note": "Enterprise hosting options are Cloud, Hybrid, or Self-Hosted. Developer and Plus are Cloud.",
   "source": "https://www.langchain.com/pricing",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "license",
   "note": "Developer is $0 per seat per month with 5,000 base traces included. Plus is $39 per seat per month. Enterprise is custom.",
   "source": "https://www.langchain.com/pricing",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.api.exists",
   "note": "LangChain documents a LangSmith REST API for tracing, datasets, experiments, annotations, and related platform features.",
   "source": "https://docs.langchain.com/langsmith/smith-api-ref",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.api.kinds[0]",
   "note": "The reference calls the surface a REST API and shows HTTPS GET https://api.smith.langchain.com/api/v1/workspaces.",
   "source": "https://docs.langchain.com/langsmith/smith-api-ref",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.api.auth[0]",
   "note": "Each request sends X-Api-Key with a LangSmith API key.",
   "source": "https://docs.langchain.com/langsmith/smith-api-ref",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.api.coverage",
   "note": "Personal access tokens inherit the user's permissions. Service keys scope to workspaces or the organization. The API reference names tracing, datasets, experiments, and annotations. This pass did not open every route.",
   "source": "https://docs.langchain.com/langsmith/create-account-api-key",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.sdk.exists",
   "note": "The LangSmith homepage says teams integrate with Python, TypeScript, Go, or Java SDKs.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.sdk.official",
   "note": "The API key guide tells developers to install the LangSmith SDK with pip install langsmith or npm install langsmith and set LANGSMITH_API_KEY.",
   "source": "https://docs.langchain.com/langsmith/create-account-api-key",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.sdk.languages[0]",
   "note": "The homepage lists a Python SDK.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.sdk.languages[1]",
   "note": "The homepage lists a TypeScript SDK.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.sdk.languages[2]",
   "note": "The homepage lists a Go SDK.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.sdk.languages[3]",
   "note": "The homepage lists a Java SDK.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.mcp.first_party",
   "note": "LangSmith hosts a remote MCP server. The Cloud quickstart URL is https://api.smith.langchain.com/mcp. Auth is OAuth 2.1 with dynamic client registration, or X-Api-Key.",
   "source": "https://docs.langchain.com/langsmith/langsmith-remote-mcp",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.cli.exists",
   "note": "LangChain documents the LangSmith CLI for projects, traces, runs, datasets, evaluators, experiments, threads, and sandboxes, with --format json and an API-key or OAuth login.",
   "source": "https://docs.langchain.com/langsmith/langsmith-cli",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.extensibility.webhooks",
   "note": "The observability homepage says monitoring can configure alerts via webhooks or PagerDuty when metrics cross thresholds.",
   "source": "https://www.langchain.com/langsmith",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.data_access.export[0]",
   "note": "The CLI exports traces and datasets and can print JSON with --format json. langsmith trace export writes trace files.",
   "source": "https://docs.langchain.com/langsmith/langsmith-cli",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.data_access.import[0]",
   "note": "langsmith dataset upload reads a JSON file such as data.json into a named dataset.",
   "source": "https://docs.langchain.com/langsmith/langsmith-cli",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "modalities.agent_docs.llms_txt",
   "note": "Opened a text/plain documentation index that describes docs for LangSmith, Fleet, and LangChain open-source packages.",
   "source": "https://docs.langchain.com/llms.txt",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "verdict.scores.api",
   "note": "The REST reference establishes the host, the X-Api-Key header, and the resource families. It does not itself list every route, so the score stays at 7.",
   "source": "https://docs.langchain.com/langsmith/smith-api-ref",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "verdict.scores.mcp",
   "note": "The hosted server documents useful tools for traces, prompts, datasets, experiments, and billing. Self-hosted MCP needs a signing JWKS, and the page says Codex CLI OAuth does not work.",
   "source": "https://docs.langchain.com/langsmith/langsmith-remote-mcp",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "verdict.scores.cli",
   "note": "The CLI is documented for agents, supports JSON output, API-key auth, and a raw API wrapper across traces, datasets, experiments, and sandboxes.",
   "source": "https://docs.langchain.com/langsmith/langsmith-cli",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "freshness.watch[0].url",
   "note": "Opened the LangSmith Remote MCP guide, including the Cloud URL, OAuth, the API-key header, and the tool list.",
   "source": "https://docs.langchain.com/langsmith/langsmith-remote-mcp",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "freshness.watch[1].url",
   "note": "Opened the LangSmith CLI guide, including install, auth, JSON output, and the command groups.",
   "source": "https://docs.langchain.com/langsmith/langsmith-cli",
   "tier": "declared"
  },
  {
   "date": "2026-09-29",
   "fact": "freshness.watch[2].url",
   "note": "Opened the LangSmith API reference, including the host and the X-Api-Key example.",
   "source": "https://docs.langchain.com/langsmith/smith-api-ref",
   "tier": "declared"
  }
 ],
 "freshness": {
  "last_verified": "2026-09-29",
  "volatility": "high",
  "watch": [
   {
    "type": "docs",
    "url": "https://docs.langchain.com/langsmith/langsmith-remote-mcp"
   },
   {
    "type": "docs",
    "url": "https://docs.langchain.com/langsmith/langsmith-cli"
   },
   {
    "type": "docs",
    "url": "https://docs.langchain.com/langsmith/smith-api-ref"
   }
  ]
 },
 "homepage": "https://www.langchain.com/langsmith",
 "id": "langsmith",
 "license": "freemium",
 "modalities": {
  "agent_docs": {
   "llms_txt": true
  },
  "api": {
   "auth": [
    "api-key"
   ],
   "coverage": "partial",
   "docs": "https://docs.langchain.com/langsmith/smith-api-ref",
   "exists": true,
   "kinds": [
    "rest"
   ]
  },
  "cli": {
   "exists": true
  },
  "computer_use": {
   "issues": [],
   "viability": "unknown"
  },
  "data_access": {
   "export": [
    "json"
   ],
   "import": [
    "json"
   ]
  },
  "extensibility": {
   "scripting": [],
   "webhooks": true
  },
  "integrations": {
   "make": "unknown",
   "n8n": "unknown",
   "power_automate": "unknown",
   "zapier": "unknown"
  },
  "mcp": {
   "first_party": true,
   "third_party": [],
   "verdict": "official"
  },
  "rpa": {
   "drivability": "unknown",
   "notes": "No repeatable UI probe was run. Traces, datasets, and experiments are documented through the REST API, the LangSmith CLI, and the remote MCP server.\n",
   "ui_stack": [],
   "vendor_support": []
  },
  "sdk": {
   "exists": true,
   "languages": [
    "python",
    "typescript",
    "go",
    "java"
   ],
   "official": true
  }
 },
 "name": "LangSmith",
 "platforms": [
  "web"
 ],
 "related": {
  "alternatives": [
   "langfuse",
   "posthog",
   "datadog"
  ],
  "our_products": []
 },
 "schema_version": 1,
 "score_version": 1,
 "status": "active",
 "vendor": "LangChain",
 "verdict": {
  "best_path": "cli",
  "scores": {
   "api": 7,
   "cli": 8,
   "computer_use": null,
   "integrations": null,
   "mcp": 7,
   "overall": 8,
   "rpa": null
  },
  "summary": "LangSmith is automatable today through the LangSmith CLI. This record is LangSmith Cloud, BYOC, and self-hosted LangSmith for traces, datasets, experiments, prompts, and related workspace data. It is not Langfuse. The CLI installs from https://cli.langsmith.com/install.sh, Homebrew, or a GitHub release. `langsmith auth login` uses a browser, with `--no-browser` for headless setup. `LANGSMITH_API_KEY` or `--api-key` also authenticates. `--format json` prints machine-readable output. Documented commands cover projects, traces, runs, threads, datasets, examples, evaluators, experiments, sandboxes, and a raw `langsmith api` wrapper that injects the API key. The REST API host in the reference is https://api.smith.langchain.com. Requests send X-Api-Key. Personal access tokens inherit the creating user's permissions. Service keys scope to a workspace or the organization. Official SDKs are documented for Python, TypeScript, Go, and Java. The product homepage says monitoring alerts can use webhooks or PagerDuty. LangChain hosts a remote MCP server. The Cloud quickstart URL is https://api.smith.langchain.com/mcp. Interactive clients use OAuth 2.1 with dynamic client registration. Programmatic clients send X-Api-Key. Named tools include thread history, prompts, runs, datasets, experiments, and billing usage. Self-hosted remote MCP on v0.16 or later stays unavailable until a signing JWKS is set. The docs say OpenAI Codex CLI OAuth does not work against this server. Developer is $0 per seat with 5,000 base traces per month. Plus is $39 per seat per month. Enterprise adds hybrid and self-hosted deployment. https://docs.langchain.com/llms.txt is a documentation index that includes LangSmith. Connector catalogs were not opened. Computer-use viability is unassessed. The CLI scores 8 and is the best path. The API and MCP each score 7.\n"
 }
}