Publications

2026

1. IR iConf

   Collaborating with large language models in literature screening for a systematic review of college students’ GenAI literacy

   Wonchan Choi, Joyce Lee, Besiki Stvilia, Yan Zhang, and Hyerin Bak

   Information Research: an international electronic journal, 2026

   Abs DOI

   Introduction. Literature screening is among the most time- and labour-intensive phases of systematic literature reviews (SLRs). Although large language models (LLMs) have been explored for screening, prior work has focused on medical and environmental domains and mainly benchmarked LLMs against human coders, offering limited guidance on collaborative integration in SLRs. Method. This study evaluated 12 GPT model-prompt configurations in an SLR of 1,616 publications. Two human coders screened a 10% sample (n = 162) to create a gold standard for model comparison. Performance was assessed using balanced accuracy, recall for inclusion, time efficiency, and cost efficiency. Disagreements between humans and models were analysed. Analysis. Bootstrap tests compared performance across configurations. Open coding identified error types in human-model disagreements. Group discussion resolved discrepancies. Results. GPT-5 Zeroshot and GPT-4o-mini Fewshot achieved the highest performance (accuracy = 0.990 and 0.946; recall = 1.000 and 0.933). GPT-4o-mini was faster and cheaper but more prone to overly rigid rule application. Error analysis identified 10 mismatches, leading to two corrections of human miscoding. Conclusion. LLM-assisted screening can reduce workload, improve efficiency, and correct human errors in SLR. Practical guidelines for prompt design and confidence thresholds can position LLMs as collaborative tools in SLRs.

2. IR iConf

   Dimensions of information search strategies: a study of blind and visually impaired users in mobile digital library environments

   Iris Xie, Wonchan Choi, Hyun Seung Lee, Ning Chiao Wang, and Bo Hyun Hong

   Information Research: an international electronic journal, 2026

   Abs DOI

   Introduction. This study intends to characterize blind and visually impaired (BVI) users’ information search strategies through analysing the dimensions of search tactics and strategies in their interactions with digital libraries (DLs) in the mobile environments. Method. This study recruited 120 BVI participants representing users of four types of mobile devices: iPhone, iPad, Android phone, and Android tablet. Multiple data collection methods were employed to collect data: prequestionnaires, post-system questionnaires, think-aloud protocols, transaction logs, and post-system and post-search interviews. Analysis. Qualitative and descriptive analysis were applied to identify dimensions of information search strategies: intentions, actions, and entities. NVivo was used for qualitative analysis. Additionally, inter-coder reliability for the dimensions was calculated. Results. The initial results of the study identified 13 types of intentions, 14 types of actions, and 15 types of entities. While the intentions encompass cognitive and behavioral goals, the actions focus on access-related activities. The entities range from device/screen readers, DL features/structure, and collections/items. The combination of diverse dimensions constitutes various information search strategies in the mobile DL contexts. Conclusion. The identified intentions, actions, and entities that constitute search strategies can be further mapped to the unique contexts of BVI users, DL systems, and mobile environments.

3. TEL

   

   Perceived importance and predictive power: Key criteria for judging information credibility on social Q&A platforms

   Wonchan Choi and Hyun Seung Lee

   The Electronic Library, 2026

   Abs DOI PDF

   Purpose. This study investigated how users assess the credibility of information on social question-and-answer (Q&A) platforms. The study builds on a social Q&A-specific web credibility framework (Choi et al., 2023), integrating a two-dimensional model of credibility—trustworthiness and expertise (Hovland et al., 1953)—and three types of web credibility cues and heuristics—author or community, content, and design (Fogg, 2003). Methodology. Using online survey data from 598 users, we employed exploratory factor analysis to identify 10 credibility criteria across three categories: author or community, content, and design. One-sample t-tests assessed the perceived importance of these criteria, and multiple regression analyses examined their associations with two core credibility dimensions—trustworthiness and expertise—while controlling for user characteristics. Findings. Although the identified criteria were rated highly overall in conceptual importance (M = 3.92), only six—community reputation, appropriate design, moderation, engaging design, reference reliability, and decency—were significantly associated with perceived trustworthiness, expertise, or both. In contrast, traditionally valued criteria related to answer quality or author characteristics had limited predictive power. These findings support a refined, empirically grounded eight-criterion framework for credibility in social Q&A environments. Originality. This study offers a data-driven update to a 21-criterion credibility model, identifying the most influential criteria in terms of conceptual importance and applicability in evaluating the trustworthiness and expertise of information on peer-based, collaborative platforms. Also, it suggests potential to extend the framework to emerging environments such as generative artificial intelligence, where criteria like reference reliability remain relevant.

4. JASIST

   Investigating the interactions between individuals with disabilities and information retrieval systems: A review of help-seeking situations, search tactics, and design recommendations

   Iris Xie, Wonchan Choi, Hyun Seung Lee, Bo Hyun Hong, and Shengang Wang

   Journal of the Association for Information Science and Technology, 2026

   Abs DOI

   People with disabilities face barriers when engaging with information retrieval (IR) systems due to designs that overlook their needs. This systematic literature review explores research for individuals with disabilities interacting with IR systems. Relevant theories concerning disabilities were examined, and the gap model was used as the theoretical framework that guided the review. This review covers relevant research published from 2000 to 2023, focusing on user groups with sensory, cognitive, and motor impairments. The main topics are help-seeking situations encountered by these user groups in various IR systems due to system design not meeting user needs, and search tactics applied by users with different types of disabilities corresponding to various help-seeking situations. Design recommendations for IR systems and platforms were also examined. Key limitations in existing research and the authors’ reflections are highlighted, including a lack of theories on the interactions between people with disabilities and IR systems, imbalanced research on and misclassification between different types of impairments, unclear distinctions between accessibility and usability, unexplored IR issues in mobile environments, and inadequate existing IR system designs, along with the challenges posed by one-size-fits-all design. Further research opportunities are also proposed.

2025

1. ASIST ConfProc

   GenAI competencies in higher education: An analysis of existing literacy frameworks

   Wonchan Choi, Hyerin Bak, Besiki Stvilia, and Yan Zhang

   Proceedings of the Association for Information Science and Technology, 2025

   Abs DOI PDF Poster

   As part of a larger project to develop a generative artificial intelligence (GenAI) literacy framework and toolkit for higher education, this poster presents an analysis of seven literacy frameworks relevant to GenAI literacy in academic contexts. Through thematic analysis, we identified 10 competencies essential for GenAI-literate students in higher education. These competencies are organized into four progressive stages: (1) understanding GenAI at conceptual and technical levels and its capabilities and limitations; (2) using GenAI tools purposefully, effectively, and appropriately; (3) analyzing and evaluating various GenAI models and tools for performance and societal, ethical, and legal impacts, and (4) customizing or creating GenAI tools to address specific needs and generate innovative applications or theoretical insights. We discuss key implications of the results and next steps for developing a GenAI literacy framework for higher education.

2. ASIST ConfProc

   Developing an Information Credibility Scale for Social Media and AI-generated Content: Insights from Expert and User Reviews

   Wonchan Choi, Liya Zhu, and Hyun Seung Lee

   Proceedings of the Association for Information Science and Technology, 2025

   Abs DOI PDF Poster

   This study initiated the development of a new scale to measure perceptions of information credibility on the web, distinguishing between trustworthiness and expertise as core dimensions. Building on a previous analysis of the literature on credibility assessments of information on social media, we generated a pool of 15 items, six for trustworthiness and nine for expertise. Following established scale development guidelines, we refined the scale through expert reviews and cognitive interviews with users. Experts (n = 2) rated most items as highly relevant and offered suggestions for refinement, such as including new items. Users (n = 9) confirmed item clarity but raised concerns about certain terms and perceived objectivity. These preliminary findings support the scale’s relevance and will inform revisions for subsequent validation. Ongoing work will expand participant feedback and move toward large-scale empirical testing.

3. ASIST ConfProc

   Researching Health Information Behaviors: Landscape, AI’s Role and Its Impact

   Xinchen Yu, Yan Zhang, Wonchan Choi, and Annie T. Chen

   Proceedings of the Association for Information Science and Technology, 2025

   Abs DOI Slides

   Health information behavior research occupies a central position within the field of Library and Information Science (LIS), given its emphasis on the complex interaction between health-related information, human, and technology. While health information behavior research has been steadily progressing over time, it has undergone significant evolution with the advancement of digital technologies such as artificial intelligence. The goal of this panel is to bring together scholars who have actively contributed to health information behavior research, with a specific focus on the integration of Artificial Intelligence (AI) into health-related information and information behavior settings. Additionally, we will present our research on the current landscape of health information behavior, the applications of AI in researching health information behavior, its limitations, and its societal impact. These insights will spark discussions among participants and help foster a deeper understanding of the opportunities and the responsible use of AI technologies in health information behavior research.

4. JASIST

   

   College students’ credibility assessments of GenAI-generated information for academic tasks: An interview study

   Wonchan Choi, Hyerin Bak, Jiaxin An, Yan Zhang, and Besiki Stvilia

   Journal of the Association for Information Science and Technology, 2025

   Abs DOI PDF

   The study explored college students’ use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI-generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students’ motivation and ability to assess the credibility of GenAI-generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter- and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI-generated information. This study provides theoretical and empirical findings regarding students’ use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.

2024

1. Image

   Help-seeking situations related to visual interactions on mobile platforms and recommended designs for blind and visually impaired users

   Iris Xie, Wonchan Choi, Shengang Wang, Hyun Seung Lee, Bo Hyun Hong, Ning-Chiao Wang, and Emmanuel Kwame Cudjoe

   Journal of Imaging, 2024

   Abs DOI PDF

   While it is common for blind and visually impaired (BVI) users to use mobile devices to search for information, little research has explored the accessibility issues they encounter in their interactions with information retrieval systems, in particular digital libraries (DLs). This study represents one of the most comprehensive research projects, investigating accessibility issues, especially help-seeking situations BVI users face in their DL search processes. One hundred and twenty BVI users were recruited to search for information in six DLs on four types of mobile devices (iPhone, iPad, Android phone, and Android tablet), and multiple data collection methods were employed: questionnaires, think-aloud protocols, transaction logs, and interviews. This paper reports part of a large-scale study, including the categories of help-seeking situations BVI users face in their interactions with DLs, focusing on seven types of help-seeking situations related to visual interactions on mobile platforms. Moreover, corresponding design recommendations are also proposed. Additionally, the limitations of the study and future research are discussed.

2. ASIST ConfProc

   College students’ metaphors for ChatGPT: An exploratory study

   Jiaxin An, Hyerin Bak, Wonchan Choi, Yan Zhang, and Besiki Stvilia

   Proceedings of the Association for Information Science and Technology, 2024

   Abs DOI PDF

   The introduction of ChatGPT has sparked significant interest and presented both great opportunities and challenges to higher education. While more students are using ChatGPT, little is known about their mental models for and sensemaking of the system, including the metaphors they use to understand the system. In this exploratory study, we interviewed 25 students at three universities in the US during the summer of 2023 to identify the metaphors they use for ChatGPT. Through qualitative analysis of the interview transcripts, we found that participants commonly used metaphors to make sense of ChatGPT. They compared ChatGPT to humans and popular technologies or tools, with Google being the most frequently mentioned. These findings highlight the potential for metaphor-based design and the development of AI literacy programs.

3. ASIST ConfProc

   Reflective and formative indicators of information credibility on social media

   Wonchan Choi, Liya Zhu, and Hyun Seung Lee

   Proceedings of the Association for Information Science and Technology, 2024

   Abs DOI PDF Poster

   As part of a larger project to develop a scale for measuring web credibility perceptions, this poster reports on preliminary findings of a literature analysis to identify reflective and formative indicators of information credibility on social media. Of 90 papers found by a systematic database search and screening, this poster examines 20 papers focused on information credibility on microblogs (e.g., Twitter, Weibo) as a popular source for online users’ information seeking. Our analysis identified 22 reflective indicators (e.g., fair, accurate) and 31 formative indicators (e.g., reputable, attractive), eight (e.g., trustworthy, unbiased) of which overlapped. Given the intertwined, often blurred border between these two sets of items, the coding scheme developed in the present study can help determine the relevance and type of the items. Future research directions are discussed.

2023

1. IPM

   Developing a platform-specific framework for web credibility assessment: A case of social Q&A sites

   Wonchan Choi, Besiki Stvilia, and Hyun Seung Lee

   Information Processing & Management, 2023

   Abs DOI PDF

   Social question-and-answer (Q&A) sites have the potential to serve as a useful source of online information based on their content-focused and collaborative nature. Although previous research has examined various attributes of high-quality information on social Q&A sites (e.g., best answers), relatively less attention has been paid to what affects users’ credibility assessments of information in the social Q&A context. The present study developed a social Q&A platform-specific framework for web credibility assessment, including 21 criteria under six types of web credibility, based on a literature analysis and case study of two online Q&A communities, Stack Exchange and Wikipedia Reference Desk. Using the selected sites’ policies and guidelines (n = 46) as the source of evidence, the case study revealed that content-related attributes (e.g., evidence-based, pertinence) were most frequently identified (12 of 21 criteria) as potential cues and heuristics for web credibility assessments of social Q&A sites, followed by author-related (five of 21; e.g., reputation) and design-related (four of 21; e.g., engaging design) factors. Design-related criteria were rarely included in previous models of web credibility on social Q&A or similar peer-knowledge production platforms. However, our findings showing that both Stack Exchange and Wikipedia Reference Desk have policies regarding all four design-related criteria in our framework—engaging design, moderation, design appropriateness, and ease of use—indicate the potential influences of design features on users’ web credibility assessment on social Q&A sites.

2. AS

   An exploration of robot-mediated tai chi exercise for older adults

   Zhi Zheng, Hyunkyoung Oh, Mayesha Mim, Wonchan Choi, and Yura Lee

   Applied Sciences, 2023

   Abs DOI PDF

   In this fast-aging society, many older adults fail to meet the required level of exercise due to trainer shortages. Therefore, we developed a robot tutor to investigate the feasibility of robot-mediated exercise for older adults. Twenty older adults participated in an experimental study. A pre-exercise survey was used to assess their background. Each participant experienced a 30-min robot-led Tai Chi exercise followed by a post-exercise survey to evaluate the easiness of following the robot and expectations for future robot design. Participants’ Tai Chi performances were evaluated in terms of completion and accuracy. Associations between the surveys and the performance were also analyzed. All participants completed the study. Fifteen out of the twenty subjects had at least one chronic condition, and most practiced Tai Chi before the study but had never interacted with a robot. On average, the participants scored 93.09 and 85.21 out of 100 for movement completion and accuracy, respectively. Their initial movement accuracy was correlated with their attitude towards exercise. Most subjects reported that they could follow the robot’s movements and speeches well and were interested in using a robot tutor in the community. The study demonstrated the initial feasibility of robot-led Tai Chi exercise for older adults.

3. ASIST ConfProc

   Exploring applications and user experience with generative AI tools: A content analysis of reddit posts on ChatGPT

   Wonchan Choi, Yan Zhang, and Besiki Stvilia

   Proceedings of the Association for Information Science and Technology, 2023

   Abs DOI PDF Slides

   As part of a larger project, this paper reports on preliminary findings of a study exploring use cases of ChatGPT and associated behaviors and experiences among users of an online forum. Posts on a ChatGPT-related forum on Reddit (n = 452) were analyzed using qualitative content analysis. This paper reports on themes relevant to this study, including the types of tasks for which users used ChatGPT, user experiences, and perceived impacts of ChatGPT. ChatGPT was often used to facilitate various writing tasks (e.g., writing an essay), academic tasks (e.g., finding scientific references for a research paper), everyday tasks (e.g., creating a meal plan), and conversational purposes (e.g., having a simulated conversation about a past event). Users expressed positive (e.g., excited, amazed) and negative (e.g., fooled, concerned) feelings toward the technology. They raised various issues and problems with ChatGPT at the content (e.g., inaccuracy, incompletes) and system (e.g., unavailability, instability) levels. Users discussed the perceived impacts of ChatGPT on individuals (e.g., unemployment) and society (e.g., AI divide). Study findings can inform the design of policies and guidelines for mitigating AI problems and promoting the effective and ethical use of emerging AI technologies.

4. ASIST ConfProc

   Preliminary findings on developing a scale for credibility assessment on interactive web platforms

   Wonchan Choi and Liya Zhu

   Proceedings of the Association for Information Science and Technology, 2023

   Abs DOI PDF Poster

   This poster introduces an ongoing project to develop a scale for measuring information credibility on current and newly emerging interactive web platforms. The poster reports on preliminary findings from an initial phase in the project to generate an item pool based on an analysis of existing scales for credibility (n = 3) and empirical studies in the library and information science literature on web credibility assessments in the social media context (n = 19). Results show that in most papers analyzed (16 of 19; 84.2%), credibility was conceptualized as a one‐dimensional construct and often measured with only one item (e.g., credible, believable), despite the common view among scholars that credibility is a high‐level, multifaceted concept. The analysis also identified 59 semantically distinct items as an initial pool, which will be validated and tested with empirical data in subsequent project phases.

2022

1. ACR

   Design matters in web credibility assessment: Interactive design as a social validation tool for online health information seekers

   Wonchan Choi, Sang-Yeon Kim, and Manman Luo

   Asian Communication Research, 2022

   Abs DOI PDF

   This study explored what makes users perceive a website as a credible source of health information and how web credibility assessment, in turn, influences their health information-seeking behaviors. Exploratory factor analysis was conducted with survey responses from college students (N = 141) who assessed credibility markers of a website they normally visit to address health concerns. A 4-factor solution emerged as the best summary of the data: (a) content, (b) interaction design, (c) information design, and (d) source. Identified components were used in a linear model to explore the effects of different web credibility types on perceptual, attitudinal, and behavioral outcomes. Alongside content-related attributes (e.g., recency of the information), interaction design-related elements (e.g., ability to interact with other users) were significantly associated with most dependent variables examined in the study (e.g., trust in the information on the site, willingness to follow the advice, and willingness to recommend the site to others). Current results imply that users count on not only content-related cues or heuristics, but also interactive design features as helpful tools for mobilizing social resources (e.g., fellow users) to validate online health information. Theoretical and practical implications of the study findings and future research directions are discussed.

2. JASIST

   

   Associations between mastery of life and everyday life information-seeking behavior among older adults: Analysis of the Pew Research Center’s information engaged and information wary survey data

   Wonchan Choi, Min Sook Park, and Yura Lee

   Journal of the Association for Information Science and Technology, 2022

   Abs DOI PDF

   Given the aging world, it is important to understand older adults’ everyday life information seeking (ELIS), which plays a vital role in healthy aging in later life. The present study analyzed national survey data collected by the Pew Research Center in 2016 based on Savolainen’s ELIS model. The model’s core concept, mastery of life, was measured in terms of general coping style to find information (cognitive vs. affective) and expectations about the findability of necessary information (optimistic vs. pessimistic). Weighted multiregression analyses were conducted to examine the associations between mastery of life and ELIS behavior of older Americans (65 years or older) in terms of breath and depth of interest in everyday topics, holding other sociocultural and demographic factors constant. The results showed a cognitive, as opposed to affective, coping style was associated with a wider range of ELIS topics and a deeper level of interest in political and cultural topics. However, whether an individual had an optimistic or pessimistic perspective toward information seeking was not associated with the variety or depth of interest in everyday topics. Neither dimension was related to the depth of interest in sports topics. Practical, theoretical, and methodological implications of the findings are provided.

3. Gerontechnology

   Understanding the research landscape of information and communication technology integration in dementia-focused assistive technologies: Mining literature from 1970 to 2020

   Min Sook Park, Yura Lee, and Wonchan Choi

   Gerontechnology, 2022

   Abs DOI PDF

   Background: As our society gets older, the implications of information and communication technologies (ICT)-based healthcare have increased. Although the adoption of ICTs has dramatically changed the landscape of the health sector since the early 1950s, the benefits that ICTs could bring to dementia care have been relatively unexplored. Objective: This paper mined the research articles for insights into how relationships between ICTs and assistive technologies (ATs) in dementia care have been developed historically and should be cultivated in the future. Method: Using text-mining techniques, 2,030 journal articles regarding ATs in relation to ICTs in dementia care published from 1970 to 2020 were analyzed. The literature was retrieved from the Web of Science, PubMed, PsycINFO, and IEEE Xplore digital library. Results: Despite the active integration of ICTs in many other sectors, the literature demonstrated that research regarding ICT integration in ATs for dementia interventions occurred only after the 1990s. The analysis results also indicate that studies have moved toward supporting the aging-in-place of people with dementia, encompassing major research interests such as assisting with daily activities of living, modifying the home, and promoting recreational activities. A research gap was also identified in technology adoption to support the social interactions of those with dementia, which is a key part of enhancing the quality of life. Conclusion: The research that addressed ICT integration with ATs for dementia care has been evolving and moving from issues of safety and security to maintaining autonomy of people with dementia in their own place.

4. JAG

   Respite service use among dementia and nondementia caregivers: Findings from the National Caregiving in the US 2015 Survey

   Yura Lee, Wonchan Choi, and Min Sook Park

   Journal of Applied Gerontology, 2022

   Abs DOI

   This study examined factors related to respite service use among caregivers and further tested the moderating effect of dementia caregiver status in these relationships using nationally representative U.S. data. Logistic regression analyses were conducted among 1203 caregivers (276 dementia and 927 nondementia caregivers). Caregivers’ race and ethnicity as a predisposing factor, caregivers’ self-rated health as an enabling factor, and care recipients’ living arrangement and functional limitations as need factors were significantly related to respite service use. Moreover, dementia caregiver status moderated the association between enabling factors (i.e., household income, work status, and self-rated health) and respite service use. Our findings imply that dementia caregivers may be more in need of respite service use than nondementia caregivers when they have limited enabling factors (e.g., lower household income, nonworking status, poorer health). Policy and practice efforts that specifically support enabling factors are suggested to promote more respite service use among dementia caregivers.

5. iConf Proc

   Developing a theoretical framework for web credibility assessment—A case of social Q&A sites: preliminary findings

   Wonchan Choi and Besiki Stvilia

   iConference Proceedings, 2022

   Abs HTML PDF Video Poster

   As part of a larger study, this poster reports on preliminary findings of efforts to develop a theoretical framework for assessing the credibility of information on social question-and-answer (Q&A) sites. A literature analysis was conducted to identify relevant criteria for assessing web credibility on social Q&A sites, which were then mapped to an existing framework of web credibility assessment. Specifically, 21 criteria identified by the literature analysis were categorized into one of six types of web credibility assessments—operator (author) trustworthiness, operator (author) expertise, con-tent trustworthiness, content expertise, design trustworthiness, and design expertise—to develop an information platform type-specific framework of in-formation credibility. Results show that existing criteria used in the literature have focused primarily on content-related attributes (eg, evidence-based, structural completeness, and semantic clarity and comprehensive-ness), but less on operator (author)-related attributes (eg, credentials) or de-sign features (eg, interactive design, appropriateness of design, ease of use). Implications of the findings and future research directions are discussed.

2021

1. IJMI

   A feature-oriented analysis of developers’ descriptions and user reviews of top mHealth applications for diabetes and hypertension

   Shengang Wang, Hyun Seung Lee, and Wonchan Choi

   International Journal of Medical Informatics, 2021

   Abs DOI

   Background and objective: Diabetes and hypertension are two prevalent and related chronic conditions. To inform the design and development of mobile health applications (mHealth apps) for people living with multiple chronic conditions, this paper examines features mentioned in developers’ descriptions and user reviews of mHealth apps, along with users’ attitudes toward associated features. Materials and methods: Eleven top apps for diabetes and hypertension were identified from Google Play as of January 2020. Based on a stratified sampling strategy, 1,100 user reviews were selected to form the final dataset. Developers’ descriptions were also collected for analysis. Using the grounded theory approach, we developed a feature-oriented coding scheme, which was used to identify three levels of features mentioned in app descriptions and user reviews: feature group (the highest level), feature type (the second level), and individual feature (the lowest level). Users’ attitudes toward app features mentioned in user reviews were also analyzed. Results: Most top-rated apps for diabetes and hypertension under study were multifeatured, incorporating self-management, information sharing, and decision support features. At the feature-group level, most informative user reviews commented on features related to self-management, followed by decision support and information sharing. The four most frequently mentioned feature types were data entry, data export/import, data visualization, and assessment. Users expressed overwhelming positive attitudes toward app features across all feature categories. Based on users’ assessments of existing features and requests for additional features, design implications for app development are provided. Conclusions: Despite the diversity of app features provided by mHealth apps and users’ primarily positive attitudes toward existing app features, more comprehensive and personalized features are expected by app users to satisfy their health needs. Beyond identifying app features in user reviews, future research may seek more in-depth feedback from real-life patients for app development and design using methods like interviews and focus groups, to further enhance the overall quality of relevant mHealth apps to better support users.

2020

1. JASIST

   Older adults’ credibility assessment of online health information: An exploratory study using an extended typology of web credibility

   Wonchan Choi

   Journal of the Association for Information Science and Technology, 2020

   Abs DOI PDF

   Credibility assessment is a crucial component in the process of peopleʼs health information seeking, especially in the web context. Finding “credible” health information from a plethora of information on the web may be more challenging for older adults, who have relatively less experience with the Internet. This article reports on the findings of an exploratory study of older adultsʼ credibility assessments of online health information. The data collected through semistructured interviews with 21 older adult Internet users in the United States were analyzed based on the extended typology of web credibility (Choi & Stvilia, 2015, Journal of the Association for Information Science and Technology, 66, 2399–2414). The findings of the study revealed that older adults paid closer attention to operator-related credibility cues and heuristics when judging the credibility of health information on the web, followed by content- and design-related ones. Also, the findings suggest that participants who were younger and used the Internet more frequently employed a wider variety of cues and heuristics to evaluate the credibility of online health information. Based on these findings, both theoretical and practical implications of the research and future research directions are discussed.

2. JAMIA

   A systematic review of mobile health technologies to support self-management of concurrent diabetes and hypertension

   Wonchan Choi, Shengang bias Wang, Yura Lee, Hyunkyoung Oh, and Zhi Zheng

   Journal of the American Medical Informatics Association, 2020

   Abs DOI PDF

   Objective: This article reports results from a systematic literature review of the current state of mobile health (mHealth) technologies that have the potential to support self-management for people with diabetes and hypertension. The review aims to (a) characterize mHealth technologies used or described in the mHealth literature and (b) summarize their effects on self-management for people with diabetes and hypertension from the clinical and technical standpoints. Materials and Methods: A systematic literature review was conducted following PRISMA guidelines. Online databases were searched in September 2018 to identify eligible studies for review that had been published since 2007, the start of the smartphone era. Data were extracted from included studies based on the PICOS framework. Results: Of the 11 studies included for in-depth review, 5 were clinical research examining patient health outcomes and 6 were technology-focused studies examining users’ experiences with mHealth technologies under development. The most frequently used mHealth technology features involved self-management support (n = 11) followed by decision support (n = 6) and shared decision-making (n = 6). Most clinical studies reported benefits associated with mHealth interventions. These included reported improvements in objectively measured patient health outcomes (n = 3) and perceptual or behavioral outcomes (n = 4). Discussion: Although most studies reported promising results in terms of the effects of mHealth interventions on patient health outcomes and experience, the strength of evidence was limited by the study designs. Conclusion: More randomized clinical trials are needed to examine the promise and limitations of mHealth technologies as assistive tools to facilitate the self-management of highly prevalent comorbidity of chronic conditions, such as diabetes and hypertension.

3. ASIST ConfProc

   Validating an extended typology of web credibility assessment

   Wonchan Choi, Manman Luo, and Sang-Yeon Kim

   Proceedings of the Association for Information Science and Technology, 2020

   Abs DOI PDF

   This methodology poster introduces an ongoing study seeking to validate an extended typology of web credibility assessments proposed by Choi and Stvilia (2015) using online surveys. The study focuses on health-related topics as an important subject domain for web credibility assessments. The poster describes the study’s theoretical background and methodology, especially the process of developing and testing the online survey questionnaire, which consists of 89 questions in five sections: internet use and experience, health information seeking, web credibility assessment, outcomes of web credibility assessment, and demographic factors. A pretest of the online survey questionnaire was conducted with eight doctoral students, in which each participant answered the questions and provided feedback on the survey design. Pretest results and future research directions are discussed.

2019

1. LISR

   Older adults’ health information behavior in everyday life settings

   Wonchan Choi

   Library & Information Science Research, 2019

   Abs DOI PDF

   Health information seeking is an important part of older adults’ everyday lives as they cope with their health conditions. Semi-structured interviews conducted with 21 older adults in the United States were analyzed using Savolainen’s everyday life information seeking (ELIS) model, especially its key concepts such as way of life and mastery of life. The interview data revealed that except for health care providers, a spouse or partner was mentioned as a credible interpersonal source of health information among older adults in a marital or romantic relationship. Characteristics of older adults’ health information behavior in the ELIS context were identified based on types of way of life and mastery of life. For example, those who had more varied types of hobbies, including cognitive, affective, and social hobbies, were exposed to diverse people as they performed their daily routine, potentially resulting in different sources of useful health information. In couple relationships, those with an optimistic as opposed to pessimistic attitude toward a problem-solving situation played the information provider role rather than information receiver role.

2. HIJ

   mHealth technologies for osteoarthritis self-management and treatment: A systematic review

   Wonchan Choi, Hua Zheng, Patricia Franklin, and Bengisu Tulu

   Health Informatics Journal, 2019

   Abs DOI PDF

   Osteoarthritis is a common chronic disease that can be better treated with the help of self-management interventions. Mobile health (mHealth) technologies are becoming a popular means to deliver such interventions. We reviewed the current state of research and development of mHealth technologies for osteoarthritis self-management to determine gaps future research could address. We conducted a systematic review of English articles and a survey of apps available in the marketplace as of 2016. Among 117 unique articles identified, 25 articles that met our inclusion criteria were reviewed in-depth. The app search identified 23 relevant apps for osteoarthritis self-management. Through the synthesis of three research themes (osteoarthritis assessment tools, osteoarthritis measurement tools, and osteoarthritis motion monitoring tools) that emerged from the current knowledge base, we provide a design framework to guide the development of more comprehensive osteoarthritis mHealth apps that facilitate self-management, decision support, and shared decision-making.

3. InnoAging

   Challenges in self-management among older adults with hypertension and diabetes

   Hyunkyoung Oh, Yura Lee, Wonchan Choi, and Zhi Zheng

   Innovation in Aging, 2019

   Abs DOI

   The World Population Prospects 2019 reports that the proportion of people who aged 65 and above takes up 9 per cent globally in 2019, reaching up to 16 per cent by 2050. Asia has the fastest rise: from 1 in 9 people aged 65 and above to 1 in 4 in 2050. Rapid growth in older adults has strong implications for diseases and healthcare expenditure. For Singapore, the transition from ‘ageing society’ (7% seniors) in 1999 to ‘super-aged society’ (20% seniors) in 2026 is projected to take 27 years, much faster than Japan’s 36 years. We used the Singapore Multi-Ethnic Cohort (MEC) of 14,465 subjects aged 21 to 94, and the Future Elderly Model (FEM) microsimulation model to project disease burden and hospitalization expenditures to 2050. We found that Chinese females had the highest life expectancy of 86.0 years, followed by Indian and Malay females with 80.4 and 75.6 years respectively. In all racial groups, women lived longer than men by 5-7 years. Cumulative hospitalization expenditures of older adults aged 51+ was US\69,500 for Chinese, US\67,600 for Malays and US\86,100 for Indians; US\71,200 for males and US$70,700 for females. The increased hospitalization spending for all three ethnic groups was due to the underlying manifestation of chronic diseases, including diabetes, hypertension, heart disease and stroke. Variations in environmental risk factors such as diet, cigarette smoking and physical activity across ethnic groups may contribute to racial differences in chronic diseases and disability. Therefore, targeted interventions are needed to reduce racial disparities.

4. ASIST ConfProc

   Assessing the informativeness of user reviews on mobile health applications for chronic diseases

   Shengang Wang, Hyun Seung Lee, and Wonchan Choi

   Proceedings of the Association for Information Science and Technology, 2019

   Abs DOI PDF

   With advances in mobile health (mHealth) technology and growing ownership of smartphones, mHealth applications have great potential to support patients’ self-management of chronic diseases such as diabetes and hypertension. Informative consumer reviews on app stores (e.g., Google Play) are a useful source of information for app developers to understand users’ needs and for users to select a pertinent app over similar alternatives. This poster reports preliminary findings of a study that explores factors affecting the informativeness of consumer reviews using a feature-centered rating scale. The results show that consumer ratings and the length of consumer reviews are both correlated with informativeness. These findings will contribute to filtering informative reviews for future in-depth analyses of app features.

5. ASIST ConfProc

   Analyzing divergent methodologies for political fact checking: United States and South Korea

   Wonchan Choi and Maria Haigh

   Proceedings of the Association for Information Science and Technology, 2019

   Abs DOI PDF Poster

   In this work in progress, we explore methods employed by professional journalists to fact-check political claims and debunk inaccurate (“fake”) news stories. We content-analyzed 150 articles evaluating political claims and debunking fake news published by two media companies, the Washington Post (United States) and JTBC (South Korea), during the periods surrounding the recent presidential elections in their respective countries. Overall, the most common types of claims evaluated included false claims made by politicians or political groups about their opponents’ positions and numerical and nonnumerical facts. The most frequently used methods for debunking such false claims included consulting with an independent expert in the given topic domain and checking government statistics or documents. There were some variations in the types of false claims focused and debunking methods used between the two fact-checking organizations.

2017

1. AH ConfProc

   A framework to design mHealth apps for supporting self-management of chronic disease

   Bengisu Tulu, Wonchan Choi, Hua Zheng, and Patricia Franklin

   2017 AcademyHealth Annual Research Meeting, 2017

   Abs HTML Poster

   Research Objective: We present a framework that guides the design of mobile health applications (mHealth apps) that support patients’ self-management of chronic health conditions and symptoms. Study Design: To assess the state of research and market place in utilizing mHealth technology for managing osteoarthritis (OA), a common chronic disease that causes considerable burden in terms of patients’ quality of life and costs for medical treatments, we conducted a systematic review on the literature and a survey of online app stores. Specifically, we conducted in-depth review of 25 articles that mentioned both mHealth technologies and OA management; we also analyzed 23 relevant apps for OA management available in the market place (e.g., Google Play). Population Studied: Literature and mobile apps for OA management Principal Findings: Based on our literature and app analyses, we suggest that three modules should be implemented in an app for any type of chronic disease including OA, namely (a) Self-Management, (b) Decision Support, and (c) Shared Decision-Making. Conclusions: The three modules described in the framework can work together to support patients’ self-management of chronic health conditions and symptoms. Implications for Policy or Practice: We believe this framework can help designers develop better mobile health apps that support patients’ self-management and informed shared decision-making in the treatment process with their clinicians.

2. AMCIS ConfProc

   Effects of user interface design and task complexity level on user experience in an mHealth application

   Wonchan Choi and Bengisu Tulu

   AMCIS 2017 Proceedings, 2017

   Abs HTML Poster Slides

   User interface (UI) is a crucial component of any application, including mHealth apps, as UI directly affects the user–app interaction, which then determines the concrete user experience with the app. This paper presents the results of an experimental study that examines the effects of data entry UI types and task complexity on user experience within the context of a mobile app. We used a 2 (touch technique: tap vs. slide) X 2 (target direction: vertical vs. horizontal) X 2 (task complexity: simple vs. complex) design. Our findings indicate that UI design in terms of touch technique and target direction, as well as task complexity have a significant impact on the task completion time. As for error rate, however, we did not find any significant differences by UI design or task complexity level.

3. HICSS ConfProc

   Effective use of user interface and user experience in an mHealth application

   Wonchan Choi and Bengisu Tulu

   Proceedings of the 50th Hawaii International Conference on System Sciences, 2017

   Abs HTML PDF Slides

   The effect of user interface (UI) design decisions on system usability has been discussed in information system literature. These discussions evolved into investigating the effectiveness of UI and how it affects a system user’s performance, as well as his or her perception of the system as a whole. This paper investigates the role of UI design on facilitating effective use in the context of mobile applications. Based on the Effective Use Theory, we test four different UIs developed for frequent data input tasks in a mobile platform using a controlled experiment and a follow-up survey. Our findings indicate that UI design in terms of touch technique (tap vs. slide) and target direction (vertical vs. horizontal) has a significant impact on the task completion time, as well as the app UIs’ perceived usability and likability. We discuss both theoretical and empirical implications of the results and suggest future research directions.

4. eGEMs

   Using mHealth app to support treatment decision-making for knee arthritis: patient perspective

   Hua Zheng, Bengisu Tulu, Wonchan Choi, and Patricia Franklin

   eGEMs, 2017

2016

1. Concordium ConfProc

   Using mHealth app to support TKR decision making for knee arthritis patients

   Hua Zheng, Bengisu Tulu, Wonchan Choi, and Patricia D. Franklin

   Concordium 2016, 2016

   Abs HTML

   Introduction: Arthritis of the knee is the most common physical disability in US adults. For advanced knee arthritis patients, total knee replacement (TKR) is a surgical intervention that can effectively eliminate pain and improve physical function. Before choosing TKR, patients and clinicians must consider the risks and benefits of TKR and determine if the likely outcomes will meet the patient’s individual goals. Patient-reported outcome (PRO) measures have been widely used in orthopedic clinical research to summarize the patient’s arthritis pain severity and functional limitations before and after TKR. Methods: We developed an Android-based smart phone app for knee arthritis patients to assess arthritis symptoms and individual readiness for TKR surgery. Tailored, patient-centered outcome prediction models from the FORCE-TJR cohort provide refined outcome estimates. Patient focus groups and clinician interviews were conducted to obtain patients’ and clinicians’ feedback on their preferred graphic displays of data, questions, and evaluation results. Laboratory and field usability testing are beginning to finalize the app content and format. Findings: Three patient focus groups were conducted between December 2015 and February 2016. Conclusions: An mHealth app was designed to disseminate tailored patient-centric outcome predictions developed from a contemporary national TKR cohort with refined usability and display features to meet the needs of knee arthritis patients faced with surgical treatment decisions.

2. AMCIS ConfProc

   Developing an mHealth application for osteoarthritis patients

   Wonchan Choi, Bengisu Tulu, Hua Zheng, and Patricia Franklin

   AMCIS 2016 Proceedings, 2016

   Abs HTML Poster

   Given the prevalence of osteoarthritis (OA) and the potential usefulness of mHealth technologies for OA self-management and treatment decisions, the authors attempt to develop an mHealth App that is particularly focused on OA. As part of a larger project, the authors have conducted two focus groups exploring OA patients’ perceptions of pain data input user interfaces (UIs), pain scale, and requirements for the mHealth App on OA. The preliminary findings from the focus groups revealed that the patients preferred the Tap-Horizontal UI the most, while the Tap-Tap-Tap type of UIs were always rated lower than other types of UIs in the study. In regard to the pain scale, most participants highlighted that including numeric rating scales along with the corresponding wording would help them gauge their pain levels more accurately. Lastly, the focus group discussions and free sketch session generated useful ideas around the functional requirements and design insights.

3. MJLIS

   Publication and citation patterns of Korean LIS research by subject areas

   Kiduk Yang, Jongwook Lee, and Wonchan Choi

   Malaysian Journal of Library and Information Science, 2016

   Abs DOI PDF

2015

1. JASIST

   Web credibility assessment: Conceptualization, operationalization, variability, and models

   Wonchan Choi and Besiki Stvilia

   Journal of the Association for Information Science and Technology, 2015

   Abs DOI PDF

   This article reviews theoretical and empirical studies on information credibility, with particular questions as to how scholars have conceptualized credibility, which is known as a multifaceted concept with underlying dimensions; how credibility has been operationalized and measured in empirical studies, especially in the web context; what are the important user characteristics that contribute to the variability of web credibility assessment; and how the process of web credibility assessment has been theorized. An agenda for future research on information credibility is also discussed.

2. LISR

   Mobile wellness application-seeking behavior by college students—An exploratory study

   Besiki Stvilia and Wonchan Choi

   Library & Information Science Research, 2015

   Abs DOI PDF

   This research explored the mobile wellness application-seeking behavior of college students. In particular, it examined what sources students used to obtain wellness information, what wellness applications students used and for what purposes, how they learned about those applications, and what factors influenced their decision to choose a particular wellness application from multiple alternatives. The results indicated that students most often used websites as sources of wellness information, followed by mobile applications, family and friends, and then physicians. Students most often learned about wellness applications from search engines and application stores. Physicians were the least mentioned source of learning about mobile wellness applications. The most popular application type was calorie and activity trackers. In addition, when asked to rate the importance of various mobile application characteristics in their decision to select a particular wellness application, students rated usability-related characteristics the highest, followed by application cost and content quality. This study contributes to current research and practice in mobile wellness application design and the provision of mobile wellness services. In particular, it can inform application designers and intermediaries about which mobile wellness applications students use, and how students search for and select those applications.

3. JKSLIS

   Looking beyond the numbers: Bibliometric approach to analysis of LIS research in Korea

   Kiduk Yang, Jongwook Lee, and Wonchan Choi

   Journal of the Korean Society for Library and Information Science, 2015

   Abs DOI PDF

   Bibliometric analysis for research performance evaluation can generate erroneous assessments for various reasons. Application of the same evaluation metric to different domains, for instance, can produce unfair evaluation results, while analysis based on incomplete data can lead to incorrect conclusions. This study examines bibliometric data of library and information science (LIS) research in Korea to investigate whether research performance should be evaluated in a uniform manner in multi-disciplinary fields such as LIS and how data incompleteness can affect the bibliometric assessment outcomes. The initial analysis of our study data, which consisted of 4,350 citations to 1,986 domestic papers published between 2001 and 2010 by 163 LIS faculty members in Korea, showed an anomalous citation pattern caused by data incompleteness, which was addressed via data projection based on past citation trends. The subsequent analysis of augmented study data revealed ample evidence of bibliometric pattern differences across subject areas.

4. Dissertation

   New framework of web credibility assessment and an exploratory study of older adults’ information behavior on the Web

   Wonchan Choi

   Doctoral Dissertation, Florida State University, 2015

   Abs HTML

   This dissertation research aims to provide a better understanding of people’s credibility assessment of online information (i.e., Web credibility assessment), which is an important part of their information behavior. In particular, this research focuses on older adults as a research population as they are a less studied user group in the literature on information credibility. Considering the ever increasing presence of older adults on the Web and their needs for health information in their daily lives, this research explores older adults’ credibility assessment of online health information within the context of everyday life information seeking (ELIS). The methodology employed in this research consists of a qualitative meta-study (Phase I) and semi-structured interviews (Phase II). In Phase I, the researcher analyzed 84 primary research reports on information credibility, identifying conceptual typologies of important facets of credibility assessment such as conceptualization, operationalization, variability (user characteristics and contexts), and process. Based on these conceptual typologies, the researcher proposed a new, extended framework of Web credibility assessment, named WC framework, that contains three main components, Assessment of WC—i.e., conceptualization and operationalization to measure Web credibility; Variability of WC—i.e., variables regarding individual and context; and Process of WC—i.e., the overall process of Web credibility assessment. In Phase II, the researcher conducted semi-structured interviews with twenty-one older adults whose ages ranged from 61 to 80 (M = 70.3) in the manner of one-on-one, in-person.

5. iConf Proc

   A new framework for Web credibility assessment

   Wonchan Choi and Besiki Stvilia

   iConference 2015 Proceedings, 2015

   Abs HTML PDF Poster

   This poster reports on a study that used a literature analysis to develop a new, extended conceptual framework for Web credibility assessment. The proposed framework conceptualizes the relationship among the key dimensions of credibility (i.e., trustworthiness and expertise), related measures, and objects of those measures (i.e., source, message, and media) that have been identified in the literature. The framework will be tested through empirical data. In particular, an online survey questionnaire will be developed in accordance with the new framework and distributed to college students for data collection. The outcomes of this study will include the new framework and survey questionnaire that could be used as reusable knowledge resources in development of credibility assessment models in different online contexts.

2014

1. iConf Proc

   College Students’ Value Structure of Choosing and Using Mobile Health/Wellness Applications: Preliminary Findings

   Wonchan Choi and Besiki Stvilia

   iConference 2014 Proceedings, 2014

   Abs HTML PDF Poster

   This work-in-progress poster reports on the preliminary findings regarding college students’ value structure of how to choose and utilize mobile health/wellness applications. We have conducted surveys and follow-up interviews with college students who have been using mobile health/wellness applications. In this poster, we analyzed the survey data from sixteen participants and the interview data from five participants (three females and two males). The analysis showed that the most important purposes of using mobile health/wellness applications for college students were recording and managing personal health information/records and keeping up with their fitness plans. For selection criteria, easy to navigate, easy to use, quality of content, customizability, and ratings from other users seemed to play the most important role in college students’ choices of certain mobile applications among alternatives.

2. ASIST ConfProc

   How do college students choose mobile health/wellness applications?

   Wonchan Choi and Besiki Stvilia

   Proceedings of the American Society for Information Science and Technology, 2014

   Abs DOI PDF

   This poster reports on the findings from interviews with fifty college students regarding what mobile health and wellness applications students used and how they choose those applications. In terms of application types, calorie and daily activity counters, such as MyFitnessPal and Lose It!, were most popular for the participants in the study, followed by running trackers, such as Nike+ Running and MapMyRun, and exercise/workout trackers, such as Fitness Buddy and Ab Workouts. Students seemed to prefer free applications and they evaluated and chose applications both indirectly (i.e., based on third party information and recommendations) and directly (i.e., through use).

2013

1. ASIST ConfProc

   Guidelines for older-adult-friendly online tutorial for Facebook: Content, design, and training principles

   Wonchan Choi, Julia Carranza, and Melissa Fox

   Proceedings of the American Society for Information Science and Technology, 2013
2. ASIST ConfProc

   Difference in citation rates by subject areas of LIS in Korea

   Jongwook Lee and Wonchan Choi

   Proceedings of the American Society for Information Science and Technology, 2013
3. ASIST ConfProc

   Use of mobile wellness applications and perception of quality

   Wonchan Choi and Besiki Stvilia

   Proceedings of the American Society for Information Science and Technology, 2013
4. ASIST ConfProc

   The sonzogno digital library project

   Sanghee Oh, Wonchan Choi, and Silvia Valisa

   Proceedings of the American Society for Information Science and Technology, 2013
5. CHI ConfProc

   What makes online health information credible for older adults? An exploratory study

   Wonchan Choi

   In CHI’13 Extended Abstracts on Human Factors in Computing Systems, 2013

2012

1. iConf Proc

   The impact of the public library on early reading achievement: using the Early Childhood Longitudinal Study (ECLS) 1st grade student sample

   Jung Hoon Baeg, Wonchan Choi, Dong Joon Lee, and Jisue Lee

   In Proceedings of the 2012 iConference, 2012
2. iConf Proc

   Senior citizens’ credibility assessment of online health information: a proposal of a mixed methods study

   Wonchan Choi

   In Proceedings of the 2012 iConference, 2012

2008

1. JKSLIS

   Trends in Integrated Electronic Resource Management in Academic Libraries

   Durk-Hyun Chang and Wonchan Choi

   Journal of the Korean Society for Library and Information Science, 2008
2. KOSIM

   Development and testing of an e-journal evaluation model for university libraries

   Durk-Hyun Chang and Wonchan Choi

   Journal of the Korean Society for Information Management, 2008