No newer posts
Published: 26 Nov 2025
Will anyone read this?
A lesson in experimentation and UX design.
I recently watched a driver use Sidecar for the first time.
For context, when Sidecar first runs, or when a new major release launches, Sidecar shows release notes. With the iOS 26 update, I made the release notes appear as a half sheet by default, taking advantage of the new glass effect.
Back to the new driver though. They installed and launched Sidecar, the release notes appeared…and they immediately swiped them away 😭 I had an immediate flashback to the “Devs watching QA test the product” video.
To be fair, it’s well understood that people rarely read documentation, much less release notes. But it got me thinking: was the half-sheet presentation part of the problem?
Turns out it was.
#
The experiment
I recently started using Statsig, which has been an awesome tool for this.
I set up a simple A/B test: 50% of drivers would see the release notes as a half-sheet (the control), and 50% would see them full-screen (the test).
The question I wanted to answer was “Are drivers more likely to read the release notes to the end if the sheet is presented full-screen?”
I created a simple ratio metric that measures the % of drivers who scroll to the bottom of the content and ran the experiment for about a week.
#
The results
Drivers are 39.7% more likely to read everything when the notes are presented full-screen.
The half-sheet group had a ~5.5% completion rate while the full-screen group hit ~8%. This confirms both that very few people read the release notes, but also that the experiment caused more people to read them than otherwise would have.
Digging into the results a bit more it’s also interesting to see that the effect is strongest among non-members, with ~48% of non-members being more likely to read the full notes vs only ~6.5% of members.
#
My takeaway
The “less intrusive” choice was also less effective, and people who might have otherwise read the release notes were bouncing off before they had a chance to read them. I’ll very likely be promoting the full-screen variant for release notes as a result.
This is one of those changes I didn’t give a ton of thought to when I made it originally, but as I start to ramp up focus on the new user experience I’m excited to keep trying different experiments like this.
Drive safe, and happy thanksgiving to those in the states!
– Jeff
No newer posts
