Incorporating user group acceptability, preference, and feedback into the development and evaluation of digital health technologies is crucial for ensuring these solutions are effective, user-friendly, and aligned with the needs and values of the target population. This process is fundamental to the National Institute for Health and Care Excellence (NICE) evidence standards framework for digital health technologies. Particularly Standard 2, which emphasizes the importance of involving users in the development of health and social care guidelines. This involves systematically gathering and incorporating user feedback throughout the development process. By doing so, digital health technologies are more likely to be accepted, utilised effectively, and have better outcomes.
Methods to Incorporate User Preferences
1. Qualitative Methods
Individual & Group Preference Exploration Methods
Interviews, Delphi panels and focus groups are traditional yet powerful qualitative methods to gather in-depth insights into user preferences and experiences. These methods allow researchers to explore complex issues in detail, understand the reasons behind preferences, and identify potential barriers to acceptability. Delphi groups provide a methodology in which you can derive consensus. Some example applications include:
Conducting interviews with users of digital health apps, to uncover specific usability issues and feature requests.
Focus groups to facilitate discussions about the user experience, leading to the discovery of common concerns and collective preferences.
Delphi panel groups to provide a methodology in which you can derive consensus on acceptability.
Ethnographic Studies
Ethnographic studies involve observing users in their natural environments. This method helps to understand the context in which digital health technologies are used and uncover unspoken preferences and behaviours. For example:
By observing how users interact with digital health technologies in their daily lives, researchers can gain insights into usability issues and areas for improvement, ensuring the technology fits seamlessly into their routines.
2. Quantitative Methods
Surveys and Questionnaires
Surveys and questionnaires are widely used to gather quantitative data on user preferences. These tools can be distributed to large populations, making them suitable for collecting data from diverse user groups. Example applications include:
Structured surveys with both closed and open-ended questions to capture specific preferences regarding the features of a digital health app, ease of use, and overall satisfaction.
Analysing survey data, with subgrouping, helps to identify trends and common themes across different user demographics.
Preference Elicitation Methods
Quantitative techniques to understand the trade-offs users are willing to make between different features of an intervention. For example, discrete choice experiments (DCE) present users with a series of hypothetical scenarios and ask them to choose their preferred option, however require large sample sizes. Novel preference elicitation methods such as threshold techniques offer a mechanism that requires a lower sample to assess preferences and acceptability. Example applications include:
DCEs can help determine which aspects of a digital health technology are most valued by users, such as interface design, data privacy features, or the integration of specific health monitoring tools.
Threshold Technique can identify the minimum acceptable level of effectiveness or maximum acceptable cost for a digital health technology from the user's perspective
Best Practices for Utilising Preference Research Methods
Incorporating User Preferences: A Case Study
A study published in the Journal of Medical Internet Research by Sanchez et al. (2022) highlights the importance of involving patients in the development of digital health technologies. The study found that active engagement of users in the design process led to the creation of more user-friendly and effective digital health solutions. Key findings from the study include:
Customization and Personalization: Users expressed a preference for digital health technologies that could be customized to their individual health needs and preferences.
User Education and Support: Participants highlighted the importance of providing educational resources and support to help them use digital health technologies effectively.
Privacy and Security: Concerns about data privacy and security were paramount, with users preferring technologies that offer robust data protection measures.
Conclusion
Incorporating user group acceptability, preference, and feedback is a cornerstone of developing effective digital health technologies. By employing a range of qualitative and quantitative approaches, researchers can ensure that technologies are user-centred and aligned with the needs of the target population. Adhering to the principles outlined in the NICE framework, particularly Standard 2, ensures that user involvement is systematic and meaningful, ultimately leading to better health outcomes and greater user satisfaction.
At DHT.health we have expertise in user experience and preference research. Our team members have previously been involved in research for the IMI PREFER initiative.
We'd love to learn more about your product and your evidence generation needs. Use the button below to set up a call with a member of our experienced team.
References
Barony Sanchez RH, Bergeron-Drolet LA, Sasseville M, Gagnon MP. Engaging patients and citizens in digital health technology development through the virtual space. Front Med Technol. 2022 Nov 25;4:958571. doi: 10.3389/fmedt.2022.958571
NHS Innovation Service. Qualitative Research: Collecting Data on Your Digital Technology. Retrieved from https://www.digitalregulations.innovation.nhs.uk/regulations-and-guidance-for-developers/all-developers-guidance/qualitative-research-collecting-data-on-your-digital-technology/
NICE. (2022). How to meet the standards. Retrieved from https://www.nice.org.uk/corporate/ecd7/chapter/how-to-meet-the-standards
DHT Health. (2024). Patient Preference Exploration Methods. Retrieved from https://www.dht.health/post/patient-preference-exploration-methods
Comments