DERIV
SentinelBot addresses a fundamental limitation of traditional QA: brittle automation scripts and manual testing processes that fail to scale with modern, fast-moving web applications. Conventional test suites require constant maintenance, break with minor UI changes, and struggle to simulate real user behavior. SentinelBot replaces this approach with AI-driven, agentic testing that adapts dynamically as applications evolve. Instead of relying on predefined test cases, SentinelBot combines AI-based reasoning with Playwright browser automation to explore applications autonomously, making context-aware decisions about what to test next. The platform simulates multiple user personas including first-time users, elderly users, impatient users, and adversarial users to uncover usability issues, accessibility violations, performance regressions, and security edge cases that scripted tests and human testers frequently miss. Each test run navigates real workflows end-to-end, captures high-resolution screenshots and session videos as evidence, measures performance and accessibility metrics, and categorizes issues by severity with contextual root-cause analysis. SentinelBot also addresses a major pain point in QA automation: flaky tests. It intelligently detects unreliable failures, automatically re-runs critical scenarios, and validates results to distinguish genuine bugs from transient issues such as network instability. SentinelBot is built as a modular, production-ready system consisting of a React-based dashboard, a FastAPI backend, Supabase database and a scalable autonomous test runner. It supports continuous monitoring, historical regression detection by comparing results across runs, and real-time Slack alerts for critical issues. By reducing false positives, minimizing manual QA effort, and catching regressions early, SentinelBot enables engineering teams to ship higher-quality software faster and with greater confidence.
Category tags:"Clarify and strengthen differentiation from existing AI-driven testing tools While the solution is well-articulated and clearly valuable, its core concept overlaps significantly with existing AI-powered QA platforms (e.g., self-healing tests, autonomous exploration, persona-based testing). To increase originality, the team should explicitly articulate what SentinelBot does meaningfully differently—for example, a novel exploration strategy, a unique learning loop across runs, or a specific class of failures it excels at detecting. A concrete comparison table or a clearly stated “why we win” narrative would sharpen the product’s identity. Ground the agentic behavior in concrete, measurable outcomes The agentic testing approach is compelling, but currently described at a high level. The project would benefit from more specificity around how decisions are made and how success is measured. For example, the team could define exploration coverage metrics, show before/after defect detection rates versus scripted tests, or present a real case study demonstrating bugs that would not have been caught by traditional automation. This would strengthen technical credibility and make the value more tangible. Prioritize a focused initial use case to sharpen business impact The platform aims to solve many problems at once—usability, accessibility, performance, security, and flaky tests—which risks diluting the message. Given the strong business potential, the team could improve clarity by identifying a single primary wedge (e.g., catching flaky regressions in CI or uncovering accessibility issues pre-release) and showing how SentinelBot delivers outsized value there. This focus would make the product easier to adopt and easier to evaluate against alternatives. Overall, the project is well-presented and commercially relevant, and with clearer differentiation, sharper metrics, and a tighter initial focus, it could stand out more strongly in a crowded space."
Mallika Rao
Engineering Leader
"Good presentation and demo. This solution clearly identified the problems with QA and developed solution that automated critical workflows. One suggestion would be about creating trust in this automation process to enable adoption. Stricter evaluation steps for this agentic solution need to be developed beyond cost and cycle time that evaluate the accuracy & correctness based on guardrails, success rate, human escalation, etc."
Hari Kanagala
Group Product Manager AI