Metadata-Version: 2.4
Name: agent-testing-cli
Version: 0.1.4
Summary: TestMu A2A CLI for testing chat, voice, and phone caller agents
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Requires-Dist: httpx<1,>=0.27
Requires-Dist: keyring<26,>=25
Requires-Dist: pydantic<3,>=2.7
Requires-Dist: rich<14,>=13.7
Requires-Dist: textual<1,>=0.60
Requires-Dist: typer<1,>=0.12
Provides-Extra: dev
Requires-Dist: pytest<9,>=8; extra == "dev"
Requires-Dist: pytest-asyncio<1,>=0.23; extra == "dev"
Requires-Dist: respx<1,>=0.21; extra == "dev"
Provides-Extra: build
Requires-Dist: pyinstaller<7,>=6.5; extra == "build"

# TestMu Agent Testing CLI

TestMu Agent Testing CLI is a command-line tool for testing chat, voice, and
Phone Caller agents from your terminal. Discover projects and test resources,
run evaluations, retrieve results, and automate test runs in CI/CD.

## Requirements

- Python 3.10 or newer
- A TestMu account with access to Agent Testing

## Install

Install the latest published version:

```sh
pip install agent-testing-cli
```

Check the available commands:

```sh
agent-testing-cli --help
```

## Authenticate

Before you sign in, see [Get started with TestMu Automation](https://www.lambdatest.com/support/docs/getting-started-with-testmu-automation/) to obtain your username and access key.

Sign in locally. Enter your TestMu username and access key when prompted:

```sh
agent-testing-cli login
```

Check sign-in status:

```sh
agent-testing-cli auth status
```

For CI/CD, store these values as protected secrets and set both environment variables:

```sh
export LT_USERNAME="YOUR_USERNAME"
export LT_ACCESS_KEY="YOUR_ACCESS_KEY"
```

## Discover Test Resources

```sh
agent-testing-cli projects
agent-testing-cli --project PROJECT_ID scenarios
agent-testing-cli --project PROJECT_ID suites
agent-testing-cli --project PROJECT_ID endpoint-profiles
```

Use `--json` when a script or CI/CD job reads the output:

```sh
agent-testing-cli --json projects
```

## Run Tests

For a Phone Caller run, `--project PROJECT_ID` identifies the TestMu project
and `--suite SUITE_ID` identifies the suite to run:

```sh
agent-testing-cli --project PROJECT_ID run --suite SUITE_ID
```

Use `--yes` to confirm a run without an interactive prompt:

```sh
agent-testing-cli --project PROJECT_ID run --suite SUITE_ID --yes
```

Run a Chat evaluation:

```sh
agent-testing-cli --project PROJECT_ID run \
  --workflow WORKFLOW_ID \
  --suite SUITE_ID \
  --yes
```

Do not use `--wait` with a Chat evaluation.

Run a suite from a supported TestMu result URL:

```sh
agent-testing-cli run --url "SUITE_URL" --yes
```

Run multiple suite URLs in one command:

```sh
agent-testing-cli run --url "SUITE_URL_1" "SUITE_URL_2" "SUITE_URL_3" --yes
```

## Retrieve Results

```sh
agent-testing-cli results --suite SUITE_ID
agent-testing-cli call --id CALL_ID
```

## Interactive Terminal Interface

Open the interactive terminal user interface (TUI):

```sh
agent-testing-cli tui
```

Use `agent-testing-cli --help` for the complete command and option reference.
