Bytebot SOP

Appearance

Usage ​

All usage assumes Bytebot is running locally via Docker Compose (see Install).

Option A: Web UI (no code) ​

Open http://localhost:9992 in your browser. Type a plain-English task description in the task box and submit it. Bytebot opens its virtual desktop, controls the mouse and keyboard, and completes the task. You can watch it work in real time via the live desktop view.

Example tasks you can type directly:

Go to Wikipedia and create a summary of quantum computing
Research flights from NYC to London and create a comparison document
Take screenshots of the top 5 news websites
Read the uploaded contracts.pdf and extract all payment terms and deadlines

Option B: REST API -- create a task programmatically ​

Python ​

python
import requests

# Simple task
response = requests.post('http://localhost:9991/tasks', json={
    'description': 'Download the latest sales report and create a summary'
})
task = response.json()
print(task)

# Task with a file upload
with open('contracts.pdf', 'rb') as f:
    response = requests.post(
        'http://localhost:9991/tasks',
        data={'description': 'Review these contracts for important dates'},
        files={'files': f}
    )
print(response.json())

curl ​

bash
curl -X POST http://localhost:9991/tasks \
  -H "Content-Type: application/json" \
  -d '{
    "description": "Search for flights from NYC to London next month",
    "priority": "MEDIUM"
  }'

Option C: Direct desktop control API ​

The desktop control API at localhost:9990 lets you send raw computer-use actions without going through the AI agent layer.

bash
# Take a screenshot of the virtual desktop
curl -X POST http://localhost:9990/computer-use \
  -H "Content-Type: application/json" \
  -d '{"action": "screenshot"}'

# Click at specific screen coordinates
curl -X POST http://localhost:9990/computer-use \
  -H "Content-Type: application/json" \
  -d '{"action": "click_mouse", "coordinate": [500, 300]}'

Multi-application workflow example ​

Bytebot is not limited to the browser. A task like this works across multiple real applications:

Download last month's bank statements from our three banks and consolidate them into a single spreadsheet

Bytebot will open the browser, navigate to each bank portal, handle login (including 2FA if you have a password manager installed in the desktop), download the files, open a spreadsheet application, and consolidate the data.

Key UI features ​

  • Live Desktop View -- watch Bytebot move the mouse and type in real time.
  • Takeover Mode -- take manual control of the virtual desktop mid-task.
  • File Uploads -- drop files onto a task for Bytebot to process.
  • Persistent Environment -- programs you install in the virtual desktop stay installed for future tasks.