/docs/computer-use

Computer-use

Current pattern for tracing agents that drive browsers, desktops, or mobile devices. Use steps, tool calls, metadata, and screenshot attachments.

Status

Dedicated Playwright/browser-use/computer-use recorder helpers are not published yet. The supported path today is to log each action as a step or tool call and attach screenshots or frame artifacts.

What to record

Action name: click, type, scroll, navigate, wait, tool_result.
Action metadata: selector, coordinates, URL, target window, and rationale.
Pre-action and post-action screenshots as attachments.
Any model rationale or tool result that explains the action.

Manual recording pattern

from theta_observability import TraceClient

client = TraceClient()

with client.trace(name="checkout-flow", run_type="computer-use") as t:
    with t.step(name="click_checkout", type="tool") as s:
        s.set_metadata(selector="#checkout-btn", action="click")
        s.log_tool_call(
            name="browser.click",
            arguments={"selector": "#checkout-btn"},
            result={"ok": True},
            latency_ms=120,
        )
        s.attach_image("screenshots/after-click.png")

client.flush()

Dashboard behavior

Screenshots and action metadata render inside the same trace detail view as every other run. When dedicated replay helpers ship, this page should be updated with the helper import and exact installation path.

← MCP server

Browser sessions →