This is a launch post, so let me be honest about why this product exists.
We kept watching the same thing happen on shipping teams. The team would push a Friday-night fix, the deploy would go green in CI, every Playwright test would pass, every screenshot diff would come back clean. Then on Monday morning a customer would DM a screenshot of the signup button cut in half on a Pixel 5 — and nobody on the team could reproduce it on their laptop.
The reason is depressing once you see it: "works on my machine" is even more true now than it was in 2010. Modern CI runs Chrome in a Linux container at a desktop viewport. Lighthouse runs Chrome in a Linux container at a simulated mobile viewport. Visual regression tools run Chrome in a Linux container at a recorded viewport. All of them check what they were told to check. None of them look at the page the way a visitor on a phone does.
Real visitors are using two-year-old Androids on intermittent connections, with a system font that doesn't match yours, with an OS that aggressively pauses background tabs, with a webview that the manufacturer hasn't updated in eight months. That's the test environment. CI is the wishful one.
The gap we kept hitting
If you've shipped a marketing site in the last two years, you've felt this. It looks like:
- Hero CTA is clipped on iPhone SE because the headline ate one extra line at that exact viewport.
- Cookie banner covers the page on a Galaxy A14 with no dismiss button — your CSS assumed the banner script loaded before paint, but on a slow network it didn't.
- Pricing table runs off the right edge on a 360-pixel Android, so the last column can't be reached. The team can't reproduce it because they all test on wide laptop screens.
- Video modal opens blank because a config request 404'd. The console said so, but nobody had the console open on a phone.
None of these show up in Lighthouse. None of them show up in your visual regression diff. They show up only when someone opens the page at that device's size, in that device's browser engine, and uses it like a customer would.
The two options teams already had
Until recently, you had two ways to catch this kind of bug.
Option A: a manual QA team with a device lab. This works. It also costs you a permanent headcount plus a closet full of phones plus the operational overhead of keeping them all charged and updated. Most companies under a hundred engineers won't do this, and the ones that do get bottlenecked on QA-team capacity before the engineering team is.
Option B: a device-cloud test-script suite. Real hardware in the cloud, but you have to write and maintain the tests. Coverage scales with engineering time you don't have, and a framework migration can invalidate scripts you wrote months ago.
Both options assume the QA bottleneck is finding bugs. From years of watching shipping teams, we became convinced the actual bottleneck is something earlier: nobody is even looking at the rendered page at phone size before it ships. Not because they don't want to. Because the cost of looking is too high.
What Canaryflux does instead
We took the opposite shape of constraint. Instead of asking the team to write tests, we ask the team to paste a URL. The scanner does the rest:
- Opens that URL on a set of device profiles — iPhone, Pixel, Galaxy, iPad and desktop screen sizes, with the exact list depending on your plan. iPhone, iPad and Mac pages are drawn by WebKit, the engine inside Safari, and the rest by Chromium. It's emulation, not a lab of physical phones.
- Captures full-page screenshots, console errors, and network failures from each one.
- Clicks up to two main links or buttons, never one that sends a form, to catch post-click bugs — the broken modals and zero-state screens that screenshot tests miss because they only photograph the landing state.
- Sends the captures to a vision LLM with a tightly-tuned QA prompt that grades each finding by severity and writes a one-line suggested fix.
- Runs a second verification pass to cut false positives so you're not drowning in noise.
What you get back is a list of ranked findings, each one with a screenshot of the actual bug, the device it surfaced on, and a suggested fix. In our internal scans against public marketing sites, a typical run surfaces a handful of findings — sometimes more on busier pages.
Paste a URL. Get the report in a few minutes. No SDK to install, no snippet to embed, no DNS changes. If your site renders HTML, we work with it.
What we got wrong, and what we changed
The first version of Canaryflux just dumped raw model output into a list. We thought "device profiles + AI vision" was the whole product. It wasn't. Most of the list was noise. Much of every output was the model hedging — "this could be a layout issue" — and much of the rest was things that were technically present but not user-impacting.
The fix was the verification stage. Every candidate finding goes through a second pass with a stricter prompt and the screenshot re-examined. If the second pass can't find the bug in the visible evidence, the finding is dropped or marked as uncertain. That single change dropped the typical scan from a couple dozen noisy candidates down to a handful of confirmed findings — and the handful is the part you actually want to read.
Update, November 2026: what changed since this post
We launched deliberately small. Since then we've added:
- Logged-in scans on Pro and Studio: paste a test account's session cookie or
Authorizationheader into a project, and its scans run signed in. - More than one page per scan: 2 on Pro, 4 on Studio.
- Safari's engine: iPhone, iPad and Mac pages are now drawn by WebKit, the engine inside Safari.
- Projects you share with teammates and clients, each with a role.
- Comparing a scan with the previous one of the same page: what's new, what got fixed, what's still there.
Scans still run when you start them, from the dashboard: there are no scheduled scans and no Slack or other integrations today.
If you're a team that ships a marketing site
Canaryflux is built for you specifically. Not for native-app QA, not for full integration testing, not as a replacement for your CI suite. As a thing you run after every deploy to make sure the page you just shipped looks right on the phones your customers actually own.
The Free plan gives you three scans a month. Paste a URL — your own site, a staging deploy, a client's site you have permission to test — and see what comes back.
We'd rather you find the bug than your customer.