Authors: Benjamin Naccache, Laure Mesquida, Jean-Philippe Raynaud, Alexis Revet
Categories: Research, Adolescent, Anorexia nervosa, Eating disorders, Focus groups, Mobile applications, Qualitative research, Smartphone, User centered design, mHealth
Source: BMC Psychiatry
Anorexia Nervosa (AN) is a key target for E-Health programs considering the many barriers hindering patients’ access to care and the disorder’s severity. Although these programs have become more common and effective, they often have low adherence, especially among youth. This can hinder their implementation and effectiveness in real-world settings. User experience partly overlaps with the acceptability field and may provide insight into factors affecting adherence and adoption of E-Health programs. This study aimed to explore early acceptability and user experience of a companion app prototype for adolescents with AN using user-centered design methods.
We developed a prototype containing self-help material and emotions and behaviors evaluation and management features. Then we conducted a mixed evaluation combining semi structured focus group interviews and questionnaires in a clinician group and an AN patient group. We analyzed data using thematic analysis and descriptive statistics.
The app’s overall appeal was adequate. The user experience questionnaire revealed the weakest dimensions, including novelty, dependability, and efficiency versus stimulation (i.e., ability to induce motivation to use the product) and perspicuity (i.e., easy to understand, to get familiar with). The qualitative data analysis revealed three central acceptability, features, and use. We identified acceptability barriers and facilitators such as the importance of design and customization, especially for adolescents. Psychoeducation was a major feature for participants, as patients highlighted the difficulties they encountered when seeking disorders-related information.
This study shows the importance of including users in the different stages of an e-health intervention development, in order to identify their needs, general use and compliance patterns, to improve adherence and adoption of the program and its effectiveness.
Keywords: Anorexia nervosa, Eating disorders, Smartphone, Mobile applications, mHealth, Focus groups, User centered design, Qualitative research, Adolescent
Anorexia nervosa (AN) has one of the highest premature mortality rates among psychiatric disorders [1–3]. It may lead to multiple psychiatric and somatic complications [4] and have a significant impact on quality of life [5]. Despite the severity of this disorder and while many studies have highlighted the importance of early diagnosis and interventions to improve recovery prospects [6, 7], there are many barriers that may delay AN’s diagnosis and treatments. These barriers include the lack of training and resources of primary care professionals about eating disorders (EDs) or limited access to EDs services because of geographical barriers, long waiting lists and rigid admission rules [8, 9]. Moreover, the impact of COVID-19 has exacerbated these problems of access to care. Indeed, pandemic-related restrictions induced many disruptions in usual care conditions, such as face-to-face therapies, combined with an increase in EDs-related demands for care [10–12].
In this context, the widespread distribution of smartphones, and thus the day-to-day interventions and assessment opportunities they provide through applications, makes them relevant devices in improving patients’ care [13]. Digital interventions have proven their effectiveness in treating psychiatric disorders [14–16] and several studies have shown the effectiveness of online E-Health ED programs in decreasing ED behaviors, attitudes and beliefs [17]. Their effects appear to be based on enhancing motivation to change [18, 19] and increasing patients’ commitment within therapy [20]. Furthermore, these interventions seem to be cost-effective ways of increasing the accessibility and availability of mental health care services for individuals with ED symptoms [21, 22].
Even though online E-Health ED programs become more common, recent reviews showed that smartphone applications targeting ED, especially AN, are still rare and poorly evaluated [17, 23–25]. They also highlighted that existing applications failed to incorporate all smartphone capabilities that could deliver an entirely personalized intervention. Aiming to determine which components of web-based self-help interventions are associated with ED symptoms improvement, Barakat et al. [17] found that using different media channels is a beneficial feature of the interventions, while automated feedbacks (i.e., reminder, personalized message, summary of self-monitoring input data, etc.) appear to be associated with less improvement. Conversely, some authors showed that personalized feedbacks are prone to enhance digital interventions’ effectiveness [26, 27]. Smartphones apps allow a more flexible and personalized use of feedbacks, rendering this type of digital intervention efficient and easy to commit to. These are important features to consider while developing E-health programs to guarantee the best user experience possible. Digitally copying content from a manual is not enough to create engaging interventions, and E-health programs often have a high drop-out rate [15–17, 22, 28, 29], especially among children and adolescents [30], which undermines their effectiveness. Taking into account that there is an ever-growing number of apps available on the market, adopting a new one and using it over time becomes a challenge. One out of four mobile apps is never used once installed and 26% of all apps are discarded after a single use [31, 32]. Factors contributing to the adoption of an e-health intervention also need to be taken into account from the development’s very beginning [30] and user experience seems to play a major part in whether a product is adopted or not [33]. A product’s adoption, being the first step in users’ commitment to it, is necessary if we hope to spread its use on a larger scale, which is one of the great benefits of using new technologies.
To build a functional product, an app’s creation process requires several important steps before programming. The first stage is the identification and definition of the theoretical frame [34]. This step aims to precisely build the app’s functionalities, based on a sturdy theoretical model, and relying on empirical data, which is essential to create an efficient final product [27, 35]. In the second step, evaluating user experience during a short period of time, simulating the app’s first use, allows to modify the program before developing it further based on users’ expectations, to facilitate its adoption in real-life conditions [15, 36, 37]. Qualitative evaluation is a relevant tool in user-centred design allowing to better approach users’ experience [34, 38].
By following these two steps, we first developed an AN companionship app prototype for teenagers. Then, we conducted a questionnaire and qualitative study in a group of expert practitioners and a group of patients suffering from AN, aiming to evaluate the app’s early acceptability as well as users’ needs and experience.
The app would offer an unguided self-help program combined with psychoeducation features used in cognitive-behavioral therapy (CBT) and motivational interview strategies. Although self-help programs in AN are still scarce compared to other EDs, some studies have suggested that they could be relevant tools in enhancing usual “face-to-face” treatment’s efficiency, or in preventing AN relapse [39, 40]. Moreover, using motivational strategies could also improve this type of program’s efficiency in increasing motivation to change [41] (Fig. 1).
Fig. 1 Design and features of the application prototype made using Axure RP9 Software (9.0.0.3727). Picture (A) shows the psychoeducational module. Picture (B) shows the symptoms management module. Picture (C) shows the emotional evaluation module. Picture (D) shows the gamification system using trophies. Icon made by Freepik from www.flaticon.com
The app would offer a guide in evaluating and managing negative emotions and behaviors focused on weight loss. It is based on several models that showed that emotional dysregulations are linked to AN and play a role in creating and maintaining the disorder [42, 43]. In AN patients, emotional dysregulation is characterized by the lack of knowledge and strategies in managing efficiently and with flexibility negative affects, having difficulties in identifying precisely its emotions and using inadequate emotion management strategies. Several studies stressed the relevance of offering strategies aiming to minimize or tolerate emotions for those patients, as well as to encourage and help identify precisely the patient’s emotions [42–45]. This module would thus offer useful skills for emotion management, based on what is used in CBT, therapy that has proven to be efficient in treating AN [46, 47]. It would also rely on what is suggested in dialectical behavior therapy, for which recently developed programs [48], focusing on excessive emotional control, have shown to be effective in AN treatment [48, 49]. Emotional evaluation was done using a French translation of the Positive and Negative Affect Schedule (PANAS) [50, 51], which is an auto-evaluating questionnaire made of two 10-items scales enabling to measure positive and negative emotions. It has been modified to better fit the app’s functions.
Gamification elements consist of the use of game design elements in non-game contexts [52, 53]. Many studies have highlighted the importance of gamification elements to offer engaging experience that improve user’s participation and motivation to change [52, 54, 55]. Although these strategies are being implemented in mental health fields to improve patients’ commitment and the intervention’s effectiveness, they still are seldom used in EDs [53]. Therefore, we have put forward different gamification elements in this prototype, such as feedback on achieved improvement, the possibility to win trophies when the patient uses the app, and the opportunity to personalize its companion by unlocking special content.
Enrollment was conducted in November 2020 and group interviews took place from December 2020 to January 2021. The study’s design required two the first was made of seven practitioners with prior experience in ED treatment who were enrolled from Toulouse Teaching Hospital. The second group was made up of eight inpatients, aged 12 to 18, suffering from AN as defined by DSM-5 criteria. We aimed to have a homogeneous patient population with experience about psychiatric care. Patients with suicidal thoughts or major restrictive symptoms with denial of the disorder were excluded due to their overwhelming symptoms.
The qualitative data were collected through semi-structured group interviews lasting an average of 100 min and taking place at the Toulouse University Hospital. The interviews were conducted by a child psychiatrist (LM) and a resident in psychiatry (BN). They were digitally recorded and then transcribed. Their main objective was to explore and encourage different perspectives on user experience offered by the prototype, using the impulses of group dynamics. The first part of the interview was a 10 to 20 min individual testing time, during which participants could explore the app prototype. The aim was to reproduce the user’s first experience at the time of the app’s installation. Afterwards, the participants completed a questionnaire evaluating user experience. Then, a discussion time was organized, during which the moderator guided the participants’ debate using questions previously defined in the study’s interview guide.
Patients’ sociodemographic characteristics were collected through questionnaires distributed at the interview’s beginning. Additional data on disease, weight, height, smartphone ownership were collected from the patient population. For practitioners, data on profession and ED patients care experience were also collected.
The User Experience Questionnaire (UEQ), created by Laugwitz, et al. [56, 57], is made of 26 items evaluating different user experience dimensions, namely attractiveness, the product’s instrumental aspects (using perspicuity, efficiency, and dependability sub-scales) and non-instrumental aspects (using stimulation and novelty sub-scales).
User experience is a recent concept, defined as the combination of elements related to the way people use an interactive product. User experience design process enables to guarantee that the designer’s point of view matches the user’s ones [34]. The two main user experience research models have been developed by Hassenzahl’s [58] and Mahlke and Thüring’s [59]. According to these authors, the perceived quality of a system would be built from their instrumental and non-instrumental qualities perception. Instrumental qualities are all elements linked to what makes the product functional. They are related to usability notions (i.e., aspects concerning the interface) and perceived usefulness, as found in the acceptability field. Non-instrumental qualities are a product’s characteristics that go beyond technical functionalities, aiming to meet user’s needs and desires, to stimulate him. For Mahlke and Thüring [34, 60], these two elements bring about emotional reactions that will impact user experience. Thanks to smartphones-related characteristics, users can easily test a mobile app and immediately feel a certain level of satisfaction. According to several research models concerning the adoption of new technologies [32, 33], satisfaction is one of the main links between the intent to use and the continuous use of a mobile app. This satisfaction in itself proceeds from user experience [33, 34].
We used these models to create the interview’s questionnaire (Table 1).
The data collected during focus groups were analyzed thematically using the NVivo 12 (12.6.0.959) software. The interviews were recorded on a dictaphone and were later transcribed verbatim. First, every transcription was read several times without undergoing thematization. Then, after focusing on the research’s objectives, the transcription underwent a continuous thematization, in light of these objectives, without any theme grouping. Each theme was designed to describe what was transcribed without interpretation or generalization. A themes list was constructed simultaneously. Afterwards, starting from the second transcription analysis, recurrences were grouped under one theme. Once all of the corpus had undergone thematization, themes were analyzed according to their focal, opposition, recurrence, or junction point. BN conducted the analyses and codes were then discussed during group meetings which both enriched the analysis and served as a quality control process. This allowed us to construct the major phenomena trends’ overview in the form of a thematic arborescence [61]. Although we achieved a degree of data redundancy, we did not reach data saturation. The methodological criteria were checked retrospectively according to the COREQ (Consolidated criteria for Reporting Qualitative research) checklist [62].
The quantitative data collected by the UEQ was described using means and confidence intervals (CIs) and compared to a benchmark determined by M. Schrepp et al. [57] using the analysis tools they provided.
The patient group was comprised of eight individuals with a mean age of 15.5 years (standard deviation; SD = 1.07) (Table 2). They were all female inpatients suffering from AN with a mean BMI of 14.69 kg/m^2^ (SD = 1.78). Most of them were in high school (n = 7), one did not provide data about her education. All of them had smartphones. The clinician group was comprised of seven individuals (n = 4 females, n = 3 males) with a mean ED patient care experience of 6.64 years (SD = 5.09). There were three psychiatrists, one pediatrician, one nutritionist physician, one psycho-motor therapist and one nurse.
The prototype’s overall first impression, measured by its attractiveness, was in the “above average” category set by the benchmark, with a score of 1.5 (CI = 1.022–1.978) (Fig. 2). Its non-instrumental aspect was measured using novelty and stimulation subscales, indicating scores of 0.88 (CI = 0.267–1.449) and 1.40 (CI = 0.890–1.910), respectively. Compared with the benchmark, this novelty score was defined as “above average”, even though the Inventive/Conventional and Creative/Dull items had the most negative critics. The stimulation score was “good”. The prototype’s instrumental aspect was measured using the following perspicuity, with a score of 1.80 (CI = 1.291–2.309), which is considered “good”; efficiency, with a score of 1.09 (CI = 0.607–1.571), considered as “above average”; dependability, with a score of 1.31 (CI = 0.917–1.695), considered as “above average”. The item with the most negative critics was Inefficient/Efficiency.
Fig. 2 User Experience Questionnaire (UEQ) results compared to the UEQ benchmark. The UEQ offers a benchmark, which contains data from 452 product evaluations done with the UEQ (with a total of 20,190 participants). It is updated once a year. It classifies a product into five Excellent: the result for the evaluated product is in the range of the 10% best results; Good: 10% of the results in the benchmark data set are better than the result for the evaluated product and 75% of the results are worse; Above 25% of the results in the benchmark are better and 50% of the results are worse; Below 50% of the results in the benchmark are better and 25% of the results are worse; Bad: the result for the evaluated product is in the range of the 25% worst results
For some patients, the app’s design and graphics were important in deciding whether to install the app, even though it did not matter as much afterwards (Fig. 3). Generally, whereas professionals were rather satisfied by the design, patients’ opinions were less positive. Some thought that it was not very modern or attractive. Both groups mentioned that external factors, like disorder-related ones or prejudices against the tool, could hinder its disorder-induced phone disinterest, shame, denial, or disbelief in the app’s efficiency; whereas trusting the app’s data and believing in its usefulness could favor its installation. Participants insisted on their expectations that such a tool had to be well-known and recommended by primary care workers, favoring its installation. Clinicians talked about the importance of visibility, imagining an app with free access on all platforms, and easily found through search engines. Some patients said they had already tried to search for apps without finding one that suited them, thus creating expectations regarding this tool. For one patient these negative experiences could conversely cause reluctance in using the app.
Fig. 3 “Acceptability” axis thematic arborescence describing main themes and subthemes with percentage of the highest group’s coding rate per theme
For both group it turns out that feedback (i.e., sound alerts and notifications) could play a positive part in facilitating long-term commitment, by sending reminders to use the app, improving the user’s relationship with it, and simply by making it seem pleasant and encouraging. It seemed important that they were adjustable, specifically in their activation. Indeed, participants feared that if they became too frequent or invasive, they could endanger the user’s commitment. Both groups also worried that notifications could remind patients of their disorder. The app’s and the companion’s personalization features were perceived positively as an investment support and were expected. For patients and clinicians, the companion must be adapted to the target public’s age. If not, it could limit their commitment, especially in adolescents. Some participants felt that the app’s absence of testimonies was a positive feature, limiting the risk of comparing oneself with others and guaranteeing the app’s personal nature. Comments about gamification features were mixed. Some found them to be acceptable, “motivating” or even “gratifying”, whereas others were worried about trophies potentially inducing obsessive behaviors, with the risk of over-engaging to the point of cheating. Comments about browsing were also mixed in clinicians. Some found the app “simple to use” “intuitive”, whereas others felt “lost”. Among those who felt lost, some felt stimulated to explore and use the app, and recognized it as a positive aspect, while those who felt as though they did not control the app thought it could be “annoying”. Patients were comfortable browsing the app and reported no specific concern about it. Some participants worried that using the app could expose their disorders, especially when some features (like notifications) were activated. They feared that this could potentially increase the patient’s sense of shame surrounding the disorder, towards him/herself or others, endangering the commitment to the app. Meanwhile, some patients expected the app to feel “secure” “reassuring” and “not judging”. Finally, participants said that using mandatory formulation could impede commitment. Some professionals felt it was necessary to use a light tone and incorporate some humor.
Most participants said they expected to be able to communicate and to be helped by the app through solutions suggestion when they felt overwhelmed by their symptoms (Fig. 4). Several patients said the proposed communication with the automated companion was acceptable, and expected a personalized discussion, needing to be “listened to” and “understood”. For one clinician the robot allowed a continuous presence. Some patients said that it was difficult for them to implement solutions when they were only suggested via words. They needed to be guided when they felt anxious, with, for example, audio tracks, music or links to videos that could be directly available through the app. They expected features that would allow them to shift their focus from their symptoms, using distractions, meditation, or relaxation apps, enabling them to open up to new experiences. Some even mentioned ways to limit their internet access, preventing them from encountering information that could exacerbate their symptoms. However, these expectations were nuanced by other patients, who declared preferring to keep the app’s features under control. For clinicians, this tool was useful in helping to find solutions mentioned during consultation, including in stressful situations, where it can be difficult to do so. Some participants suggested that recalling several times possible solutions could help patients acquire new reflexes. Nevertheless, some of them highlighted that proposing too many solutions, or using links that could inadvertently lead to symptoms or disorder-related unhelpful websites could jeopardize the commitment to the app. Patients said that their search history, impacted by previous searches, may accentuate these risks.
Fig. 4 “Features” axis thematic arborescence describing main themes and subthemes with percentage of the highest group’s coding rate per theme
For both groups, the app’s feature concerning disorder-related information was one of the most important. Several patients said they had trouble looking for information about their disorder, having faced diverse and unclear information, or even incorrect information that could lead to false beliefs. Some patients said that internet or social media browsing about their disorder could accentuate food obsessions or their sense of guilt. For some patients this feature’s advantage was to access reliable information. Clinicians saw the opportunity to give information prior to the first consultation or during follow-up, hoping to facilitate the discussion. The groups expected the app to address different themes. Patients looked for medically reliable information about food and dietetics, and information that went “beyond food symptoms”, such as items concerning self-esteem. Clinicians expected disorder-related data, information about malnutrition’s physical consequences and items helping patients find out where they stand in their in symptoms’ evolution. Finally, both groups said they expected to find data helping patients face the loss of dietary cues and offering social skills and assertiveness strategies. The issue of giving parents information was raised solely by practitioners. They were divided between the advantages of letting parents access the app and the ones of leaving the patient in charge of sharing, or not, pieces of information they had learned. Some clinicians feared patients could feel invaded in their privacy and thus lose the upside of the app’s personal dimension. Others worried that too much information could induce confusion, and that patients might use this kind of information to hide their symptoms.
Participants also expected a lot from the motivational content. Patients expected the app to collect personal information such as personality traits, personal values, objectives and life projects that could be modifiable through time. They also expected the app to intervene directly, either by “reminding” patients of this personal motivating content, or in sharing encouraging messages, quotes or media.
Participants also expected to be able to define objectives. They were perceived as motivation to change in themselves, by the rewards they could bring about, and by highlighting benefits changes could provoke. Whereas patients said they expected the app to generate challenges, that could be personalized and changeable, clinicians insisted that it would more relevant that these challenges be presented by the patients themselves. Several participants said the objectives should be short-termed and centered around symptoms or the openness towards others and activities. Patients suggested that long-term objectives, such as life plans, could be motivating. For both groups, recurrent and user-adjustable notifications about the objectives’ evolution could be useful. Some patients insisted nonetheless that these challenges should not produce any kind of pressure, whether in their formulation, their follow-up or in the rewards they can entail.
Participants expressed mixed opinions about how the app should be involved in patient care (Fig. 5). Some thought it would be beneficial that the app be linked to a clinician, by facilitating exchanges and the possibility of alerting faster when there is trouble. Others feared this kind of assistance could be intrusive as patient may use the app in a personal way and feared the loss of such privacy. Moreover, some clinicians imagined patients might expect practitioners to use this app and be available through it, thus creating hardships for patients anxiously waiting if answers are not provided. Patients expected to have the opportunity to talk about app use during consultation times, while keeping the amount of information they wished to share under control. The unguided nature of this app could allow this tool to be patient-centered, according to the clinician. It was expected that it could help screening patients early, and referring them towards proper care while encouraging them to play an active role in their treatment, by giving them contacts of suitable establishments (i.e., primary care workers, assistance help line, associations, dedicated facilities). Thus, it was necessary for clinicians to remind patients as soon as users installed the app that it was not a substitute for appropriate clinician-provided care. Patients bore in mind that this tool did not replace a “face-to-face” follow-up, even though some feared having this app would hold them back from asking for help by keeping them trapped in the app. For participants from both groups this app was seen as a tool essentially made for patients in the early stages of the disorder, that could provide initial assistance when treatment is not yet implemented. Some clinicians doubted it would offer added value in an ongoing follow-up. Conversely, one patient reported that it could be helpful between consultations.
Fig. 5 “Use” axis thematic arborescence describing main themes and subthemes with percentage of the highest group’s coding rate per theme
Participants had different opinions concerning the potential time spent using the app. Some clinicians said it would probably be used sparsely, with the possibility of getting bored of the features. For other clinicians, some features like emotions’ evaluation and disorder-related information, if conveyed gradually, could be used for longer. Finally, clinicians thought the app could be used every now and then, according to the patient’s needs. Patients imagined using it occasionally, when they needed information, help or motivation. For them, this app’s use was not thought as consistent over a specific time-period, but dependent on the disorder’s evolution, and may diminish when the symptoms do.
This study focused on an essential step in app development by evaluating its early acceptability and user experience in its initial phase. In general, the app’s overall attractiveness was adequate, but the UEQ results showed weaker dimensions in user experience, including novelty, dependability, and efficiency, which matched some participants’ comments. Efficiency score was low on the UEQ, which participants confirmed by expressing mixed beliefs. Qualitative data showed that when participants thought the app was effective, it promoted its adoption, whereas it hindered it when they thought it was ineffective, which is consistent with current literature [28, 30]. Moreover, several models about apps adoption highlight that the perceived efficiency of a product is one of the key elements guiding the intent to use, which is essential in deciding whether or not to adopt a product [32, 33]. Participants’ expectations included that the app needed to be properly broadcasted (online and on different apps stores), and recommended by health workers. Indeed, Kim et al. [33] in their multi-stage adoption model state that social influence (i.e., how strongly an individual believes that important others think he or she should use the technology), which is also a key element in the intent to use, could influence positively the perceived efficiency. Spreading the app’s use could thus improve its credibility and expected efficiency [28]. Besides, it seems that being recommended by a health worker is the best way to boost an app’s adoption [63]. Concerning novelty, patients did not find the aesthetic very modern or appealing, which hindered the installation of the app. Clinicians, in contrast, were satisfied with the aesthetic. The low dependability score could be related to difficulties experienced by clinicians when navigating in the app, as well as patients’ opinions about design that fell short of their expectations. The app’s aesthetics and design are also key elements in its adoption process, still according to some comprehensive models of apps adoption. Indeed, on one hand, they take part in the user experience which contributes to the satisfaction during use, turning the intent to use into adoption [31–34]. On the other hand, aesthetics and design also seem to guide users as early as the app’s search or exploration, through screenshots displayed on stores, influencing the decision to install the app [31]. The study’s qualitative data shows the different expectations, towards these two dimensions, between adolescent users and adult clinicians. This highlights the importance of including users in the app development process as early as possible to better understand their needs and preferences [29, 38, 55]. This is particularly true for adolescents, who have always known these tools and use them daily. They will express different, often higher, expectations than adults, specifically about customization features [15, 30].
The qualitative data revealed many expectations for this application. Patients and clinicians agreed on the importance of the psychoeducation feature. Patients highlighted the difficulties they faced when they looked for information about the disorder, such as too much information, guilt-inducing information or even false information that could reinforce false beliefs or symptoms. These experiences are consistent with the Arts et al. Study that showed that AN online information was often of variable quality and difficult to read [64]. Even more, and especially for adolescents, not understanding the disorder and the need for treatment is a real obstacle in implementing appropriate treatment [9]. It was therefore expected that having a single source of reliable data on the disorder or on dietary facts would limit this risk and facilitate communication with caregivers. Patients also expected to be able to choose items about self-esteem and social skills, so the app would be relevant during disorder’s later stages. The user’s ability to choose elements that represent situations with which they identify seems, according to other studies [29, 30, 34, 55], to be a personalization feature that improves engagement and adherence.
Participants have also brought forward that there are internal factors, specific to the disorder, that could hinder the app’s adoption. Patients thus highlighted that shame and denial could be limiting factors. Feelings of shame were comprised of two dimensions. On one hand, they said that exposing oneself on account of owning an app dedicated to ED could be embarrassing through the eyes of others, for example because of untimely notifications, or the phone being looked “over” the shoulder. On the other hand, shame could be induced by reminding patients of their disorders, of the difficulties they face, reinforcing the distorted way they see themselves, which is an essential part of the disorder. Social influence, as was discussed earlier, is a major parameter in building the intent to use [32, 33]. It can therefore be influenced negatively by shame and disorder-related stigmas, which are well-known barriers to the search for help and treatment in EDs [8, 9], and more generally in mental health care. We can thus see how important it would be that the app felt safe and “without judgement”. Beyond these considerations, the app’s design allowing it to not being instantly labelled as a mental health app dedicated to EDs could improve the sense of security and intimacy patients are looking for and avoid self-stigmatization reinforcement. Choosing carefully the app’s title could also be important. For example, Huang et al. [65] who studied apps aiming to alleviate anxiety found that apps with a title referring directly to anxiety disorders or symptoms had a lower installation rate than those of which the title was not symptoms-related.
Gamification features were well accepted and could even be perceived as motivating and enjoyable. However, some participants expressed worries about some elements that could bring about obsessions or pressure. This underscores the importance of carefully choosing gamification mechanisms and how they are implemented to better meet patients’ needs and symptoms, avoiding adverse effects [52, 53, 66]. However, when properly implemented, these features can be great assets, still underused, in improving interventions’ efficiency and commitment to [13, 54, 55].
There were different points of view between clinicians and patients about the app’s use. Clinicians envisioned a short-term use, mainly in searching for help surrounding the disorder. They mostly expected the app to help screen patients and direct them towards proper care. Besides, it seems like short-term interventions are usually more efficient, maybe because apps tend to be less used over time [13]. Finally, some clinicians did not think this app would be useful in a “face-to-face” setting, or thought it could increase patients’ expectations, thus creating the risk of disappointment. Lindgreen et al. [67] showed that using this type of tool during consultations could also create distress for clinicians and lower their work satisfaction. Indeed, in this study, clinicians felt like they might not have the necessary technological skills, or that there could be a gap between patients’ expectations and theirs, thus potentially damaging the therapeutic relationship or alliance and diminishing patients’ trust in their clinicians. This shows how important it is to think about objectives and use recommendations for patients but also for clinicians, to avoid adding a burden to their practice. Patients seemed to expect a strong sense of intimacy with the app. Most imagined using it occasionally, if necessary, but expected a follow-up throughout the disorder’s evolution. They could thus come look for information or personal motivations (i.e., life projects, personal values) depending on their needs at that precise moment. Patients expressed needing more than text coping strategies, such as links to different media via the app. This concurs with Barakat’s et al. [17] results, stating that using several media types was associated with a better ED symptoms improvement. Furthermore, it seems that, during the pandemic, difficulties in regulating one’s emotions that ED patients face could have played a major part in ED symptoms aggravation in that period [10]. COVID-19’s impact on health care systems also shows the importance of developing new methods in helping ED patients when health care becomes less accessible [10, 11]. Finding efficient ways to distribute these coping strategies, thanks to the different medias they can provide, seems to be an e-health interventions’ relevant challenge.
This study’s main limitation was the selection only hospitalized patients were recruited. This limits the results’ generalization to different stages of the disorder but, nonetheless, offers information about users’ needs at the start of the disorder and in already coordinated care. A second limitation was the small number of participants, so these results cannot be considered definitive or stable because we did not reach data saturation. However, we did not aim to be exhaustive, but rather to get an overview of important topics to address when developing an app, keeping in mind the flexibility a fast implementation needs. Many studies have insisted on the importance of using alternative methods in e-health intervention evaluation [15, 36, 38, 55]. Indeed, traditional evaluation methods, such as randomized controlled trials, are not compatible with development process, because of their long implementation timeline and the fast-evolving users’ expectations and technological progresses. Rapid and iterative testing methods with results implementation involving users in their development allow this flexibility. Tools used during this study are an example of these kinds of tests. More than allowing to punctually evaluate the app, they can assist in building a reference to better monitor different versions’ evolution and improvement features that must be implemented over time [36]. Traditional methods are still relevant in evaluating sparse data, like efficiency, once this process is over [15].
Developing new technologies in AN accompaniment could enable to bypass some of the barriers they face when trying to access specific care. These solutions are not however usually very engaging for users, particularly in adolescent population which have different expectations than adults. This study shows the importance of including users in the different stages of an e-health intervention development. It identifies needs, general patterns of use and adherence, which may be very different from those envisioned by clinicians. Patients’ expectations were mainly centered around getting reliable information as well as an emotional and motivational accompaniment. Clinicians mostly expected the app to help health workers screen and evaluate patients, rather than for follow-up. Several barriers to the app’s adoption were outlined, especially by the patients, such as design and aesthetics, or doubt in these tools’ efficiency. However, suggestions for improving the adoption of the application were made, like internet broadcasting and professional recommendation, and making the app design non-stigmatizing. These findings could help to make the right changes in order to meet users’ needs, which could significantly improve the program’s adoption and adherence, and thus its effectiveness. Developing a mobile app is a continuous process that should regularly include these evaluations, until its efficiency is properly evaluated.
Not applicable.
BN and AR designed the study and wrote the protocol. BN and LM conducted the interview. BN, LM and AR collected and analyzed the data. BN produced the first draft of the manuscript. AR drafted portions and substantively edited all drafts of the manuscript. JPR contributed to the interpretation of data and critically revised the manuscript for important intellectual content. All authors contributed to and have approved the final manuscript and agree to be accountable for all aspects of the work.
No specific funding was received to conduct this research.
The dataset supporting the findings of this study is available from the corresponding author, BN, upon reasonable request. The data are not publicly available due to legal and ethical restrictions.
According to French law, this study was conducted in compliance with the French National Commission for Informatics and Liberties (Commission nationale de l’informatique et des libertés, CNIL) standards and the General Data Protection Regulation. It was registered by Toulouse University Hospital (RnIPH 2020–154) and the CNIL (2206723 v 0). All participants gave written informed consent.
All participants gave written informed consent.
The authors have no competing interest to declare related to this study. This study is academic (University of Toulouse).
The dataset supporting the findings of this study is available from the corresponding author, BN, upon reasonable request. The data are not publicly available due to legal and ethical restrictions.