Week 16 - The research cocktail š¹šµļø
Week one for me as Lead User Researcher at Made Tech.
In need of a hard truth š®
During my years as a researcher within design teams I have often seen clients and stakeholders eagerly looking for anything that will allow them to make confident product decisions. Thatās especially true when it comes to assessing designs, as theyāre often seen as a subjective interpretation of a solution.
This need, in combination with the democratisation of (big) data has led to teams all around the world using numerical data as the most reliable way to inform decisions. Big Data and analytics are āhard factsā and presumably serve asĀ the indisputable basis for making objective product decisions whereas ātraditionalā researchā is seen as offering āsofterā data.
Hereās a quote I found online that kind of sums this up:
āMetrics are the internetās heroin and weāre a bunch of junkies mainlining that black tar straight into the jugular of our organizations. They make our products easy to quantify. They attach something concrete onto the inherently mushy experience visitors go through when using our digital doohickies.āĀ Ā Louder than ten
The answer is not in the data š¤„
You might think that thatās a controversial statement, especially coming from a researcher (and yes, it is a bit clickbaity š„ø ), but we canāt and shouldnāt let data take our decisions for us. Data, qualitative or quantitative, can only give us direction and inspiration. Thereās no piece of data that will get you to the truth because thereās no such thing as an objective truth. And that is mainly because all data are gathered, analysed, synthesised and modeled by humans and humans carry biases (more on biases in another instalment).
So, what can we do to make sure that the decisions we make based on our data are solid?
Triangulate to dig deeper ššŖ
Many times Iāve had discussions with clients, stakeholders and team members about which type of data is better, quantitative or qualitative. And itās a conversation that can, nerdily, become quite heated. The answer is...none. No type of data is better than the other because they do different things and answer different questions. All types gather behavioural data to try and predict, map and anticipate human actions but, generally speaking, qualitative research explores what people think, feel and do while quantitative research gives a measure of how many people think, feel or behave in a certain way. Quantitative methods provide a ābig pictureā of the current situation but fail to explain the reasons behind the measured scores. On the other hand, qualitative methods have the capacity to unveil the reasons behind the outcomes but struggle to provide the ābig pictureā.
For example, if in one of your forms you have a high dropout rate in one of the steps you wonāt be able to know why your users drop off at that point unless you observe them trying to fill in that form in some type of interview setting.Ā
Mix your methodsš¹
Trust me, I understand how dangerously close I am to a dad joke by calling this a research cocktail š , the research community and academia calls āMixed methods research and in my experience, it gives you the most enlightening results. Next time you want to predict or explain user behaviour (and time and budget allows) try to think how you can get more than one type of data or how you can use multiple methods to get a more complete picture and I promise you you wonāt be disappointed.Ā
If youāre keen to understand more about the different types of data and how they can help, hereās a quick video:
Canāt wait to meet more of you over the next couple of weeks!
Have an amazing weekend,
Spyri