Common Issues
Test fails with 'Element not found'
Test fails with 'Element not found'
Fix: Make test description more specific. Instead of “Click submit”, use “Click the blue Submit button at bottom of form”.AI needs clear targeting. Add unique identifiers in descriptions.
Test works in dashboard but fails in CI
Test works in dashboard but fails in CI
Fix: Check environment variables. Add secrets (API keys, auth tokens) in dashboard Settings → Environment.Also verify base URL matches your staging/production environment.
Generated code has wrong assertions
Generated code has wrong assertions
Fix: Be explicit in test description. Say “Verify order total equals $49.99” not just “Check total”.Re-run test generation with clearer requirements.
Browser session times out
Browser session times out
Fix: Tests have 5-minute timeout. Break long flows into multiple shorter tests.Example: Separate “login” and “checkout” into two tests.
GitHub bot not commenting
GitHub bot not commenting
Fix: Verify GitHub App has “Pull requests: Read & Write” permissions.Reinstall app if needed: github.com/apps/rehearsal-ai
Test is flaky (passes sometimes, fails others)
Test is flaky (passes sometimes, fails others)
Fix: Add explicit waits. In test description: “Wait for spinner to disappear, then click Next”.Rehearsal auto-adds waits, but complex apps need hints.
Can I test localhost apps?
Can I test localhost apps?
Yes. Use ngrok or similar tunnel. Point test to public URL.Or contact us about self-hosted runners: support@rehearsal.ai
How do I handle authentication?
How do I handle authentication?
Two options:
- Include login in each test description
- Use test setup with saved cookies (contact support for this feature)
Pricing & Limits
Free tier:- 10 tests/month
- 50 test runs/month
- Community support
- Unlimited tests
- Unlimited runs
- Priority support
- Custom test suites
- Self-hosted runners
- SSO/SAML
- SLA guarantees
- Dedicated support
Getting Help
- Email: support@rehearsal.ai
- Discord: discord.gg/rehearsal
- Docs: https://docs.rehearsal.ai
Response time: < 2 hours for Pro/Enterprise, < 24 hours for Free tier.