Testing Home Dashboard App
Turning observations into insights
Telstra needed to find out whether the onboarding experience for their Telstra Home Dashboard™ App would resonate with their audience. Was it intuitive, easy to use and friendly?
Design Thinking | Usability Testing | Facilitation | Insight Analysis | Reporting
How could we help Telstra uncover insights and test their hypothesis around how their users interact with the new app onboarding experience?
Telstra Home Dashboard™ mobile application enables users to set up, troubleshoot and track their Wi-Fi at home, without the need for calling a telco. Telstra came to BlueMelon for support in evaluating their new onboarding customer experience, gathering user insights and communicating the learnings to the product team.
It all started with a 1:1 session with each stakeholder, unpacking what scenarios and tasks needed to be covered and identifying the challenges that we may encounter throughout the session.
To make this successful we needed to screen participants with specific requirements – recruit them, take the team to a testing studio where we could record, test and invite some of the product team to watch the sessions in the “Observation room”.
After identifying what we needed to measure, we designed and customised a specific set of tasks for users to perform, built working prototypes, recruited suitable participants, sourced a location and equipment and organised a schedule for the day.
BlueMelon facilitated 1 hour 1:1 episodic usability testing sessions with the participants, where they experienced our working prototypes along the full Wi-Fi set up experience. Tests were conducted on both Android and IOS devices and involved interactions with multiple Telstra products in a real-world environment. Internal stakeholders were invited to attend the sessions or watch a live stream. Sessions were also captured from three perspectives for later analysis.
Prototypes are a great way to capture quick user insights, identify iterations and re-test if needed - without having to incur into high development expenses.
In order to understand the experience of certain features that had not just been developed, the BlueMelon team created clickable prototypes that showcased the intention of the experience. The prototypes helped us to gain insights around:
- Sequencing (does the next step make sense?)
- Level of complexity to complete a task
- Visual style (Do the icons and graphics make sense?)
After the on-site usability testing sessions, our digital experience team conducted insight synthesis sessions to categorise findings and identify patterns. These findings were consolidated into a comprehensive report for Telstra, covering our methodology, user insights, wins, measures (NPS & LTR distribution, System Usability Scale and Microsoft Desirability Test) and most importantly our recommendations for the product team. Using a BPI rating, specific findings and recommendations for improvement were prioritised by ranking results against four components – Severity, Commonality, Frequency and Business Importance.
BlueMelon helped Telstra gain a rich understanding of how users respond to the app’s new onboarding experience and how to make the customer experience easier.
The research brought further internal awareness at Telstra and helped the product team prioritise features, plan product roadmap and iterate on current experience.
Today the Onboarding experience allows users to successfully setup products using the app. It has become the top-rated app at Telstra, rated 4 stars in both App Store and Google Play.
The Go-To Content Partner for Product Marketing Managers Around the Globe