Do I have to write Playwright selectors to get started?
No. A mapping session records real clicks, types, drags and navigations as you drive your app, or you describe a goal in plain English and the operator reads the screen with OCR and picks the next visible label. Either way, the flow becomes real Playwright test code you can read and edit — selectors included — so you're never stuck depending on OCR at test time.
What does "every decision stamped with the model id" mean?
When the agent decides the next click instead of you, that decision is logged with the exact model that made it (for example decided_by: deepseek/deepseek-chat), plus its token cost. Nothing the agent decides is anonymous, and run cost is visible, not billed as an opaque "AI credit."
What is the PASS / FAIL / UNMEASURED verdict?
Most runners only have pass and fail, so anything a check can't actually observe — a page that never loaded, a drifted viewport, a flaky network hop — gets forced into one of those two boxes, usually FAIL. qareef's runs carry a third state, UNMEASURED, for exactly that case. More in the blog post.
How does "turn any old website into an API" work?
Record the flow once — search, log in, pull a record — and parameterise the inputs. The flow becomes plain Playwright that runs on request or on a schedule; each run returns what it read as structured output together with the screenshot and trace that prove where it came from. No API on the target site is required. Details on the website → API page.
Does qareef solve CAPTCHAs?
No, never. If a site challenges the agent, the run stops, records the screen as evidence, and hands it to a person. qareef automates the work a person is already allowed to do in a browser; it does not defeat access controls. More on the legacy system automation page.
Is qareef open source?
The core — flow runtime, engine adapter, OCR-driven operator, OCR/pixel measurement, the LLM adapter with cost logging, and evidence-first document storage — is being built in the open under packages/core, MIT-licensed. The hosted app (Flows, Runs, Bugs, Requests, Maintenance, the IDE, Automate jobs) is not part of that core.
What do I need to run it myself?
Node 22, Playwright, and either a Mac (for on-device Apple Vision OCR) or a 27B-class vision model reachable over the network — plus an OpenRouter key for the cheap text model that decides what to click. Full list on the docs page.
How is this different from other AI-driven QA platforms?
Most closed "coverage as a service" platforms pair a managed cloud runner with dedicated human QA engineers. qareef looks similar at the surface — flows, runs, bugs, maintenance — but its automation core is open source, it uses an OCR-reading operator instead of requiring stable DOM selectors up front, and every model decision is cost-logged and attributed. It does not (yet) offer a managed human-verification service. Full, sourced comparison on the compare page.