in Case study
Icon Designing and A/B Testing
We selected the three most promising icons to A/B test from ten designs.
Testing Results
The new icon designs did not significantly change the install rate. However, it’s always important to optimize the icon as it has a strong impact on both the “Featured” and “Ranking” store pages.
![Balloony Land icons Balloony Land icons](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_icons.jpg)
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_phone1.png)
cvr: 7.03%
526 users
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_phone2.png)
cvr: 6.16%
584 users
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_phone3.png)
cvr: 6.11%
524 users
![Balloony Land Screenshots Balloony Land Screenshots](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_results.jpg)
A/B Test Iterations with New Screenshots
We decided to improve screenshots and to focus mostly on the first two as this is what draws the most attention from users browsing the app store page.
We created multiple App Store landing page variations using the winning icon. Below are three examples, including the winning combination of icon and screenshots.
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_phone4.png)
cvr: 40.21%
97 users
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_phone5.png)
cvr: 38,17%
117 users
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_phone6.png)
cvr: 36.26%
91 users
RESULTS
BEFORE ASO
![balloony_graph1 Balloony Land graphique](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_graph1.png)
We drove hundreds of users from Facebook to the initial landing page and got disappointing results. Only 5% of users showed an intention to install the app.
AFTER ASO
![Balloony Land graphique Balloony Land graphique](https://www.pocketwhale.com/wp-content/uploads/2018/12/balloony_graph2.png)
The impact of the A/B test is astonishing: 40% of the users we drove from Facebook showed an intention to install the app.
- The Amount of users who showed an intention to install the app
IN THE CASE OF BALLOONY LAND, WE MANAGED TO LOWER THE COST OF ACQUISITION BY
90%
![Balloony Land Smartphone Balloony Land Smartphone](https://www.pocketwhale.com/wp-content/uploads/2017/11/balloony_phone7.png)
![Magnus Alm](https://www.pocketwhale.com/wp-content/uploads/2018/02/magnus_alm-2.jpg)