FAQ

Do I need to know Python or JavaScript? No. You write tests in plain English; Synthesize generates the code. Knowing the target framework helps when reading generated output, but isn't required.

What frameworks are supported? Six built in: Robot Framework, Playwright, Cypress, Selenium, Cucumber/Behave, and pytest. More via plugins, including building your own.

What do I need to run it? Python 3.10+, pip install synthesize-ai, and either an Anthropic API key or a Synthesize account.

How accurate is the AI generation? With well-written context in your .synth files, generated tests are typically usable as-is. The quality review gate (synthesize review) catches structural issues, and self-healing handles the drift that breaks tests over time.

How does self-healing work? When a test fails, Synthesize analyzes the failure, classifies it (broken locator, timing, assertion), attempts a fix, and reports a confidence score. Modes range from supervised (propose only) to auto and aggressive.

Is my test data secure? Test generation and execution run locally on your machine. LLM calls go over encrypted connections. Secrets scanning (synthesize security secrets) helps prevent credential leaks in your test code, and self-hosted deployment is available for enterprises.

Can I use it without a Synthesize account? Yes. Set ANTHROPIC_API_KEY and enable auth.offline_mode in synth.yaml. All local features work; account-backed features (team collaboration, Studio) don't apply.

Can I migrate my existing tests? Yes — synthesize import converts existing Robot Framework and Gherkin/Cucumber tests into .synth files, with optional AI enrichment. You can also generate tests from OpenAPI specs (synthesize spec generate) or directly from source code (synthesize analyze scan).

How do I control LLM costs? Response caching, model routing (fast models for simple tasks), and synthesize cost report for visibility. See the models section in Configuration.

What's the difference between the CLI and Studio? The open-source CLI (pip install synthesize-ai) is the full local toolchain. Synthesize Studio is the hosted web platform that adds a browser-based editor, real-time execution, dashboards, and team features. The CLI works standalone.

Where do I report bugs or request features? Lanier-Developments/ContactUs — issue templates are set up for bugs, features, and questions.