Archestra Dev E2e
Testing & Qualityarchestra-dev-e2eArchestra Dev E2e is an Agent Skill for testing & quality published in the archestra-ai/archestra repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Use when writing, debugging, or running Archestra Playwright e2e tests, API/UI fixtures, WireMock-backed tests, local/CI e2e setup, or test selectors.
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Inspect the Agent Skill at https://github.com/archestra-ai/archestra/blob/HEAD/.claude/skills/archestra-dev-e2e/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/archestra-dev-e2e, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
Archestra E2E Testing
Use this skill for files under platform/e2e-tests/ and for frontend/backend changes that require Playwright coverage.
Run commands from platform/ unless specifically instructed otherwise.
Commands
pnpm test:e2e
tilt trigger e2e-test-dependencies
tilt trigger e2e-test-dependencies starts WireMock and seeds test data to the database.
In development, e2e tests use the development database. Local data can make e2e tests fail locally.
Check WireMock health at http://localhost:9092/__admin/health.
WireMock environment variables
Use port 9092 for the Tilt e2e dependency setup:
ARCHESTRA_OPENAI_BASE_URL=http://localhost:9092/v1
ARCHESTRA_ANTHROPIC_BASE_URL=http://localhost:9092
ARCHESTRA_GEMINI_BASE_URL=http://localhost:9092
Local and CI setup
- Local e2e dependencies deploy through
dev/Tiltfile.test, which installs thehelm/e2e-testschart (helm upgrade --install e2e-tests) and port-forwards WireMock to9092. - CI uses a kind cluster and Helm deployment.
- CI kind config is
.github/kind.yaml. - CI Helm values are
.github/values-ci.yaml. - CI NodePort services use frontend
3000, backend9000, and metrics9050. - CI e2e checks include
drizzle-kit check, codegen, and database migrations.
Fixtures
- Use the Playwright fixtures pattern.
- API fixtures live in
e2e-tests/tests/api-fixtures.ts— import relative to the spec's location (./api-fixturesfromtests/,../api-fixturesfrom a subdirectory liketests/llm-proxy/). They includemakeApiRequest,createAgent,deleteAgent,createApiKey,deleteApiKey,createToolInvocationPolicy,deleteToolInvocationPolicy,createTrustedDataPolicy, anddeleteTrustedDataPolicy. - UI fixtures live in
e2e-tests/fixtures.ts— import relative to the spec's location (../fixturesfromtests/). They includegoToPageandmakeRandomString. - Pure API tests (no browser needed) belong in the backend vitest suite as route tests, not in Playwright (#6155). Keep Playwright specs for flows that exercise the UI.
Example:
import { test } from "./api-fixtures";
test("API example", async ({ request, createAgent, deleteAgent }) => {
const response = await createAgent(request, "Test Agent");
const agent = await response.json();
// test logic...
await deleteAgent(request, agent.id);
});
Locator best practices
Prefer Playwright's recommended locators over raw locator() calls. In priority order:
page.getByRole()- accessible elements by ARIA role, such as buttons, links, and headings.page.getByText()- text content.page.getByLabel()- form controls by label.page.getByPlaceholder()- input elements by placeholder.page.getByTestId()- custom test IDs usingE2eTestIdconstants from@archestra/shared.
Avoid raw CSS selectors, XPath selectors, and arbitrary timeouts. Use Playwright auto-waiting instead.
// good
await page.getByRole("button", { name: /Submit/i }).click();
await page.getByLabel(/Email/i).fill("[email protected]");
await page.getByTestId(E2eTestId.CreateAgentButton).click();
// avoid
await page.locator(".submit-btn").click();
await page.locator("#email-input").fill("[email protected]");
await page.waitForTimeout(1000); // use auto-waiting instead