How Shopify took mobile E2E test stability from 50% to 98%
Shopify's mobile E2E suite got so flaky it was blocking more good PRs than bad ones, so they pulled it from pull-request checks entirely. Rather than keep patching Appium, they wrapped it in an opinionated, builder-style API that forces an assertion on every step and uses computer vision to find elements the way a user does — not by crawling the view hierarchy. Stability climbed from 50% to 98%. The lesson: stop bailing out a framework that keeps manufacturing the same failures, and rebuild the layer above it.