Sharing Experiences in Selecting Clinical Outcome and Approving Validated Questionnaires : Insights from an Elderly Registry Study

Article information

J Korean Med. 2024;45(1):17-43
Publication date (electronic) : 2024 March 1
doi : https://doi.org/10.13048/jkm.24002
1Department of Diagnostics, College of Korean Medicine, Wonkwang University
2Department of Korean Medicine Rehabilitation, College of Korean Medicine, Won-Kwang University
3Korea Medicine Science Research Division, Korea Institute of Oriental Medicine
4Korea Medicine Data Research Division, Korea Institute of Oriental Medicine
5Research Center of Traditional Korean Medicine, College of Korean Medicine, Wonkwang University
Correspondence to: Jungtae Leem, College of Korean Medicine, Wonkwang University, 460 Iksandae-ro, Iksan, 54538, Republic of Korea, Tel: +82-63-850-6914, Fax: +82-63-850-7324, E-mail: julcho@naver.com
Correspondence to: Jeeyoun Jung, Korea Medicine Science Research Division, Korea Institute of Oriental Medicine,, 1672 Yuseong-daero, Yuseong-gu, Daejeon, 34054, Republic of Korea, Tel: +82-42-868-9272, Fax: +82-42-868-9299, E-mail: jjy0918@kiom.re.kr
Received 2023 September 27; Revised 2023 October 26; Accepted 2024 February 16.

Abstract

Objectives

Underpinned by the context of a Korean traditional medicine cohort study on healthy aging, this research primarily aims to guide the selection of Clinical Outcome Assessments (COAs) for elderly healthy aging patient registry research, offering insights into the selection process; and secondly, to streamline the resource-intensive process of obtaining permissions for validated COAs, benefiting future traditional Korean medicine clinical researchers.

Methods

In this study, we identified outcomes through a review of previous studies, followed by a process involving expert consultations to select the final outcomes. Subsequently, for the selected outcomes that were Clinical Outcome Assessments (COAs) developed tools, we searched in commercial databases to confirm the availability of Korean versions and the necessity of obtaining permissions. Finally, we obtained permissions for their utilization and, when needed, acquired the original instrument questionnaire through payment.

Results

Through a literature review of existing observational studies, a total of 57 outcomes were selected, with 19 of them identified as COA instruments. Upon verifying usage permissions for these 19 instruments, it was found that 17 required author-specific permissions, and among these, 2 needed a purchase as they were commercially available.

Conclusion

This study provides a detailed overview of outcome selection and permission acquisition for elderly patient registry research. It underscores the importance of Clinical Outcome Assessment (COA) tools and the rigorous approval process, aiming to enhance research reliability. Continuous verification of COA information is essential, and future research should explore Core Outcome Set (COS) development through consensus-building approaches like Delphi studies.

Fig. 1

Flow diagram of the process of Selecting Clinical Outcome and Approving Validated Questionnaires

Overview of Prior Research

Process of Outcome Revision

Final Outcomes and Classification According to FDA8)

Permission to Use of Clinical Outcome Assessment Instruments

References

1. Briggs A. M., de Carvalho I. A.. 2018;Actions required to implement integrated care for older people in the community using the World Health Organization’s ICOPE approach: A global Delphi consensus study. PLOS ONE 13(10):e0205533. https://doi.org/10.1371/journal.pone.0205533.
2. Kessler R. C., Davis R. B., Foster D. F., Van Rompay M. I., Walters E. E., Wilkey S. A., Kaptchuk T. J., Eisenberg D. M.. 2001;Long-term trends in the use of complementary and alternative medical therapies in the United States. Annals of Internal Medicine 135(4):262–268. https://doi.org/10.7326/0003-4819-135-4-200108210-00011.
3. Ayele A. A., Tegegn H. G., Haile K. T., Belachew S. A., Mersha A. G., Erku D. A.. 2017;Complementary and alternative medicine use among elderly patients living with chronic diseases in a teaching hospital in Ethiopia. Complementary Therapies in Medicine 35:115–119. https://doi.org/10.1016/j.ctim.2017.10.006.
4. Takayama S., Iwasaki K.. 2017;Systematic review of traditional Chinese medicine for geriatrics. Geriatrics & Gerontology International 17(5):679–688. https://doi.org/10.1111/ggi.12803.
5. Kingston A., Jagger C.. 2018;Review of methodologies of cohort studies of older people. Age and Ageing 47(2):215–219. https://doi.org/10.1093/ageing/afx183.
6. Walton M. K., Powers J. H., Hobart J., Patrick D. L., Marquis P., Vamvakas S., Isaac M., Molsen E., Cano S. J., Burke L.. 2015;Clinical Outcome Assessments: Conceptual Foundation–Report of the ISPOR Clinical Outcomes Assessment – Emerging Good Practices for Outcomes Research Task Force DOES THIS HAVE TO BE LABLED AS PART 1. Value in Health : The Journal of the International Society for Pharmacoeconomics and Outcomes Research 18(6):741–752. https://doi.org/10.1016/j.jval.2015.08.006.
7. Bang G., Kang D., Cho J.. 2022;Current status of routine use of Patient-Reported Outcome in the tertiary hospital clinical setting in Republic of Korea. Korean Journal of Clinical Pharmacy 32(2):74–83. https://doi.org/10.24304/kjcp.2022.32.2.74.
8. FDA-NIH Biomarker Working Group. 2016. BEST (Biomarkers, EndpointS, and other Tools) Resource Food and Drug Administration (US); http://www.ncbi.nlm.nih.gov/books/NBK326791/.
9. Eton D. T., Bauer B. A., Sood A., Yost K. J., Sloan J. A.. 2011;Patient-Reported Outcomes in Studies of Complementary and Alternative Medicine: Problems, Solutions, and Future Directions. EXPLORE 7(5):314–319. https://doi.org/10.1016/j.explore.2011.06.002.
10. Barnes P. M., Bloom B., Nahin R. L.. 2008;Complementary and alternative medicine use among adults and children: United States, 2007. National Health Statistics Reports 12:1–23.
11. Astin J. A.. 1998;Why Patients Use Alternative MedicineResults of a National Study. JAMA 279(19):1548–1553. https://doi.org/10.1001/jama.279.19.1548.
12. Paterson C., Baarts C., Launsø L., Verhoef M. J.. 2009;Evaluating complex health interventions: A critical analysis of the “outcomes” concept. BMC Complementary and Alternative Medicine 9:18. https://doi.org/10.1186/1472-6882-9-18.
13. Anfray C., Trimoreau M.. n.d. Licensing and eCOAs: Lessons learned and pending issues Mapi Research Trust; Retrieved June 28, 2023, from http://www.mapi-trust.org/news-events/news/licensing-and-ecoas-lesso/.
14. Marcus A.. 2017;Pay up or retract? Drug survey spurs conflict. Science (New York, N.Y.) 357(6356):1085–1086. https://doi.org/10.1126/science.357.6356.1085.
15. Hays R. D., Weech-Maldonado R., Teresi J. A., Wallace S. P., Stewart A. L.. 2018;Commentary: Copyright Restrictions versus Open Access to Survey Instruments. Medical Care 56(2):107–110. https://doi.org/10.1097/MLR.0000000000000857.
16. Ongenae K., Dierckxsens L., Brochez L., van Geel N., Naeyaert J. M.. 2005;Quality of life and stigmatization profile in a cohort of vitiligo patients and effect of the use of camouflage. Dermatology (Basel, Switzerland) 210(4):279–285. https://doi.org/10.1159/000084751.
17. Moon S.-W.. 2019;Research Ethics and Laws Related to Survey Research in Clinical Psychology. Korean Journal of Clinical Psychology 38(1):112–126. https://doi.org/10.15842/kjcp.2019.38.1.009.
18. Anfray C., Arnold B., Martin M., Eremenco S., Patrick D. L., Conway K., Acquadro C., ; ISOQOL Translation and Cultural Special Interest Group (TCA-SIG). 2018;Reflection paper on copyright, patient-reported outcome instruments and their translations. Health and Quality of Life Outcomes 16(1):224. https://doi.org/10.1186/s12955-018-1050-4.
19. About PROQOLID - ePROVIDE™. n.d. ePROVIDE - Mapi Research Trust Retrieved June 28, 2023, from https://eprovide.mapi-trust.org/about/about-proqolid.
20. Ware J., Kosinski M., Keller S. D.. 1996;A 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity. Medical Care 34(3):220–233. https://doi.org/10.1097/00005650-199603000-00003.
21. Herdman M., Gudex C., Lloyd A., Janssen M., Kind P., Parkin D., Bonsel G., Badia X.. 2011;Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation 20(10):1727–1736. https://doi.org/10.1007/s11136-011-9903-x.
22. Nasreddine Z. S., Phillips N. A., Bédirian V., Charbonneau S., Whitehead V., Collin I., Cummings J. L., Chertkow H.. 2005;The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society 53(4):695–699. https://doi.org/10.1111/j.1532-5415.2005.53221.x.
23. McKown S., Acquadro C., Anfray C., Arnold B., Eremenco S., Giroudet C., Martin M., Weiss D.. 2020;Good practices for the translation, cultural adaptation, and linguistic validation of clinician-reported outcome, observer-reported outcome, and performance outcome measures. Journal of Patient-Reported Outcomes 4(1):89. https://doi.org/10.1186/s41687-020-00248-z.
24. Won C. W., Lee S., Kim J., Chon D., Kim S., Kim C.-O., Kim M. K., Cho B., Choi K. M., Roh E., Jang H. C., Son S. J., Lee J.-H., Park Y. S., Lee S.-G., Kim B. J., Kim H. J., Choi J., Ga H., Kim M.. 2020;Korean frailty and aging cohort study (KFACS): Cohort profile. BMJ Open 10(4):e035573. https://doi.org/10.1136/bmjopen-2019-035573.
25. Ding D., Zhao Q., Guo Q., Meng H., Wang B., Yu P., Luo J., Zhou Y., Yu L., Zheng L., Chu S., Mortimer J. A., Borenstein A. R., Hong Z.. 2014;The Shanghai Aging Study: Study design, baseline characteristics, and prevalence of dementia. Neuroepidemiology 43(2):114–122. https://doi.org/10.1159/000366163.
26. Hong N., Kim K.-J., Lee S. J., Kim C. O., Kim H. C., Rhee Y., Youm Y., Choi J.-Y., Park H.-Y.. 2019;Cohort profile: Korean Urban Rural Elderly (KURE) study, a prospective cohort on ageing and health in Korea. BMJ Open 9(10):e031018. https://doi.org/10.1136/bmjopen-2019-031018.
27. Baek Y., Seo B.-N., Jeong K., Yoo H., Lee S.. 2020;Lifestyle, genomic types and non-communicable diseases in Korea: A protocol for the Korean Medicine Daejeon Citizen Cohort study (KDCC). BMJ Open 10(4):e034499. https://doi.org/10.1136/bmjopen-2019-034499.
28. Dusek J. A., Abrams D. I., Roberts R., Griffin K. H., Trebesch D., Dolor R. J., Wolever R. Q., McKee M. D., Kligler B.. 2016;Patients Receiving Integrative Medicine Effectiveness Registry (PRIMIER) of the BraveNet practice-based research network: Study protocol. BMC Complementary and Alternative Medicine 16:53. https://doi.org/10.1186/s12906-016-1025-0.
29. Kim S.-H., Jo M.-W., Ahn J., Ock M., Shin S., Park J.. 2014;Assessment of psychometric properties of the Korean SF-12 v2 in the general population. BMC Public Health 14:1086. https://doi.org/10.1186/1471-2458-14-1086.
30. Yang S.. 1992;Effects of Fluid Intake, Dietary Fiber Supplement and Abdominal Muscle Exercises on Antipsychotic Drug-Induced Constipation in Schizophrenics. Journal of Catholic Medical College 45(4):1501–1514.
31. McMillan S. C., Williams F. A.. 1989;Validity and reliability of the Constipation Assessment Scale. Cancer Nursing 12(3):183–188. https://doi.org/10.1097/00002820-198906000-00012.
32. KEE B. S.. 1996;A Preliminary Study for the Standardization of Geriatric Depression Scale Short Form-Korea Version. J Korean Neuropsychiatr Assoc 35(2):298–306.
33. Yesavage J. A., Sheikh J. I.. 1986;9/Geriatric Depression Scale (GDS). Clinical Gerontologist 5(1–2):165–173. https://doi.org/10.1300/J018v05n01_09.
34. Won C. W., Yang K. Y., Rho Y. G., Kim S. Y., Lee E. J., Yoon J. L., Cho K. H., Shin H. C., Cho B. R., Oh J. R., Yoon D. K., Lee H. S., Lee Y. S.. 2002;The Development of Korean Activities of Daily Living(K-ADL) and Korean Instrumental Activities of Daily Living(K-IADL) Scale. Journal of the Korean Geriatrics Society 6(2):107–120.
35. Lawton M. P., Brody E. M.. 1969;Assessment of older people: Self-maintaining and instrumental activities of daily living. The Gerontologist 9(3):179–186.
36. Resnick B., Galik E., Dorsey S., Scheve A., Gutkin S.. 2011;Reliability and validity testing of the physical resilience measure. The Gerontologist 51(5):643–652. https://doi.org/10.1093/geront/gnr016.
37. Park G., Cho B., Kwon I. S., Park B. J., Kim T., Cho K. Y., Park U. J., Kim M. J.. 2016;Reliability and Validity of Korean Version of Falls Efficacy Scale-International (KFES-I). Journal of Korean Academy of Rehabilitation Medicine 34(5):554–559.
38. Yardley L., Beyer N., Hauer K., Kempen G., Piot-Ziegler C., Todd C.. 2005;Development and initial validation of the Falls Efficacy Scale-International (FES-I). Age and Ageing 34(6):614–619. https://doi.org/10.1093/ageing/afi196.
39. Sohn S. I., Kim D. H., Lee M. Y., Cho Y. W.. 2012;The reliability and validity of the Korean version of the Pittsburgh Sleep Quality Index. Sleep & Breathing = Schlaf & Atmung 16(3):803–812. https://doi.org/10.1007/s11325-011-0579-9.
40. Buysse D. J., Reynolds C. F., Monk T. H., Berman S. R., Kupfer D. J.. 1989;The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatry Research 28(2):193–213. https://doi.org/10.1016/0165-1781(89)90047-4.
41. Craig C. L., Marshall A. L., Sjöström M., Bauman A. E., Booth M. L., Ainsworth B. E., Pratt M., Ekelund U., Yngve A., Sallis J. F., Oja P.. 2003;International physical activity questionnaire: 12-country reliability and validity. Medicine and Science in Sports and Exercise 35(8):1381–1395. https://doi.org/10.1249/01.MSS.0000078924.61453.FB.
42. Oh J. Y., Yang Y. J., Kim B. S., Kang J. H.. 2007;Validity and Reliability of Korean Version of International Physical Activity Questionnaire (IPAQ) Short Form. Journal of the Korean Academy of Family Medicine 28(7):532–541.
43. Rubenstein L. Z., Harker J. O., Salvà A., Guigoz Y., Vellas B.. 2001;Screening for undernutrition in geriatric practice: Developing the short-form mini-nutritional assessment (MNA-SF). The Journals of Gerontology. Series A, Biological Sciences and Medical Sciences 56(6):M366–372. https://doi.org/10.1093/gerona/56.6.m366.
44. Wilson M.-M. G., Thomas D. R., Rubenstein L. Z., Chibnall J. T., Anderson S., Baxi A., Diebold M. R., Morley J. E.. 2005;Appetite assessment: Simple appetite questionnaire predicts weight loss in community-dwelling adults and nursing home residents. The American Journal of Clinical Nutrition 82(5):1074–1081. https://doi.org/10.1093/ajcn/82.5.1074.
45. Oh S. Y., Koh S.-J., Yeon B. J., Kwon K. A., Jeung H.-C., Lee K. H., Young-Woong W., Lee H. J.. 2019;Validity and Reliability of Korean Version of Simplified Nutritional Appetite Questionnaire in Patients with Advanced Cancer: A Multicenter, Longitudinal Study. Cancer Research and Treatment 51(4):1612–1619.
46. Frates B., Tollefson M., Comander A.. n.d. PAVING the Path to Wellness Workbook. Healthy Learning Retrieved August 23, 2023, from https://healthylearning.com/paving-thepath-to-wellness-workbook/.
47. Lim M. K., Kim M. H., Shin Y. J., Yoo W. S., Yang B. M.. n.d;Social Support and Self-rated Health Status in a Low Income Neighborhood of Seoul, Korea. Journal of Preventive Medicine and Public Health 36(1):54–62.
48. Sherbourne C. D., Stewart A. L.. 1991;The MOS social support survey. Social Science & Medicine (1982) 32(6):705–714. https://doi.org/10.1016/0277-9536(91)90150-b.
49. Su J. E., Yun Y. G., Ryong Y. H., Kim I. C., Park J.-Y., Jung I.. 2017;Preliminary Study to Develop the Instrument of Korean Medical Pattern Identification and Functional Evaluation for Five Organ. Journal of Physiology & Pathology in Korean Medicine 31(2):126–137. https://doi.org/10.15188/kjopp.2017.04.31.2.126.
50. Kang B.-K., Jang S., Ko M. M., Jung J.. 2019;A Study on the Development of a Korean Metabolic Syndrome Questionnaire Using Blood Stasis Clinical Data. Evidence-Based Complementary and Alternative Medicine: eCAM 2019;:8761417. https://doi.org/10.1155/2019/8761417.
51. Cheong M. J., Lee G.-E., Lee Y., Bae K.-H., Kang Y., Kim J.-H., Lyu Y.-S., Kang H. W.. 2019;Validation of the Core Seven-Emotions Inventory—Short form. Integrative Medicine Research 8(2):116–119. https://doi.org/10.1016/j.imr.2019.04.003.
52. Lee J.-Y., Dong Woo Lee null, Cho S.-J., Na D. L., Hong Jin Jeon null, Kim S.-K., You Ra Lee null, Youn J.-H., Kwon M., Lee J.-H., Maeng Je Cho null. 2008;Brief screening for mild cognitive impairment in elderly outpatient clinic: Validation of the Korean version of the Montreal Cognitive Assessment. Journal of Geriatric Psychiatry and Neurology 21(2):104–110. https://doi.org/10.1177/0891988708316855.
53. Survey contents | KDCA korean National HEalth & Nutrition Examination Survey n.d. Retrieved August 23, 2023, from https://knhanes.kdca.go.kr/knhanes/sub04/sub04_01_02.do?classType=2.
54. Kim C. O.. n.d. Geriatric Diseases Prevention and Management Cohort. (2012. December) (1465012630) Retrieved August 23, 2023, from https://scienceon.kisti.re.kr/srch/selectPORSrchReport.do?cn=TRKO201300030794.
55. Guralnik J. M., Simonsick E. M., Ferrucci L., Glynn R. J., Berkman L. F., Blazer D. G., Scherr P. A., Wallace R. B.. 1994;A short physical performance battery assessing lower extremity function: Association with self-reported disability and prediction of mortality and nursing home admission. Journal of Gerontology 49(2):M85–94. https://doi.org/10.1093/geronj/49.2.m85.
56. McGill S. M., Childs A., Liebenson C.. 1999;Endurance times for low back stabilization exercises: Clinical targets for testing and training from a normal database. Archives of Physical Medicine and Rehabilitation 80(8):941–944. https://doi.org/10.1016/s0003-9993(99)90087-4.
57. Korea Health Panel Survey n.d. Retrieved August 23, 2023, from https://www.khp.re.kr:444/web/data/board/view.do?bbsid=54&seq=1731.
58. Demers L., Ska B., Desrosiers J., Alix C., Wolfson C.. 2004;Development of a conceptual framework for the assessment of geriatric rehabilitation outcomes. Archives of Gerontology and Geriatrics 38(3):221–237. https://doi.org/10.1016/j.archger.2003.10.003.
59. Prorok J. C., Williamson P. R., Shea B., Rolfson D., Mañas L. R., Cesari M., Kim P., Muscedere J.. 2022;An international Delphi consensus process to determine a common data element and core outcome set for frailty: FOCUS (The Frailty Outcomes Consensus Project). BMC Geriatrics 22(1):284. https://doi.org/10.1186/s12877-022-02993-w.
60. U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. 2006;Guidance for industry: Patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health and Quality of Life Outcomes 4(1):79. https://doi.org/10.1186/1477-7525-4-79.
61. Al Sayah F., Jin X., Johnson J. A.. 2021;Selection of patient-reported outcome measures (PROMs) for use in health systems. Journal of Patient-Reported Outcomes 5(Suppl 2):99. https://doi.org/10.1186/s41687-021-00374-2.
62. Revicki D. A., Schwartz C. E.. 2009;Intellectual property rights and good research practice. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation 18(10):1279–1280. https://doi.org/10.1007/s11136-009-9551-6.
63. center for reserach ethics information. 2021. CRE Research Ethics Questions and Answers 1 https://www.cre.or.kr/bbs/BoardDetail.do?nttId=568&bbsId=BBSMSTR_000000000041&pageIndex=1.
64. Williamson P. R., Altman D. G., Blazeby J. M., Clarke M., Devane D., Gargon E., Tugwell P.. 2012;Developing core outcome sets for clinical trials: Issues to consider. Trials 13(1):132. https://doi.org/10.1186/1745-6215-13-132.
65. Webbe J., Sinha I., Gale C.. 2018;Core Outcome Sets. Archives of Disease in Childhood. Education and Practice Edition 103(3):163–166. https://doi.org/10.1136/archdischild-2016-312117.
66. Williamson P. R., Altman D. G., Blazeby J. M., Clarke M., Devane D., Gargon E., Tugwell P.. 2012;Developing core outcome sets for clinical trials: Issues to consider. Trials 13:132. https://doi.org/10.1186/1745-6215-13-132.

Article information Continued

Fig. 1

Flow diagram of the process of Selecting Clinical Outcome and Approving Validated Questionnaires

Table 1

Overview of Prior Research

Author, Year Country Starting Year Study Period (year) Plans for Follow-up Period (month) Study Name Study Population No. of Subjects Study Design
Baek Y, 2020 Korea, Daejeon-si 2017 9 2 year KDCC(Korean Medicine Daejeon Citizen Cohort Study) men and women aged 30–55 years ; residents of Daejeon ; individuals who provided informed consent 2000 prospective cohort study, multi-center, protocol
Won CW, 2020 Korea 2016 10 2 year KFACS (Korean Frailty and Aging Cohort Study) men and women aged 70–84 years ; currently living in the community ; having no plans to move out in the next 2 years ; having no problems with communication and no prior dementia diagnosis. 3014 multicenter longitudinal cohort study
Ding D,2014 China, Shanghai 2010 ongoing baseline and 4 year Shanghai Aging Study (1) registered residents in Jingansi community; (2) ≥ 60 years; (3) without schizophrenia or mental retardation based on their medical records; or (4) able to communicate and accept physical and cognitive examinations 3141 a prospective cohort, protocol
Hong N,2019 Korea 2012 10 2 year The Korean Urban Rural Elderly (KURE) Cohort age ≥65 years; residence in the study area; ability to communicate with the research team; and provision of written informed consent 3517 prospective cohort study, multi-center
Jeffery A D,2022 US (14 member sites) 2013 10 baseline, 2, 4, 6, 12, 18 and 24months* Patients Receiving Integrative MedicineEffectiveness Registry (PRIMIER) outpatient aged 18 or over who was seen by an IM provider at any of the clinical sites in the 8weeks preceding their enrollment ; must be willing and able to provide informed consent, to participate, and to be contacted in the future by study personnel. 2374 A prospective, longitudinal,observational evaluation
*

Tobacco and alcohol use are asked at baseline, 12, and 24 months, and medical record data are pulled at baseline and every 6 months

the first and second follow-up performed every 4 years

Table 2

Process of Outcome Revision

Domain Classification Reasons for Exclusions and Changes Excluded Instruments
Health Status Pregnancy 1st : Excluded from selection because age range on inclusion criteria
Breast-feeding 1st : Excluded from selection because age range on inclusion criteria
Health Assessment / Vital Signs Body Mass Index; Body temperature 1st : Additional selections
Health Status Family history 1st : Exclude because it’s in the medical history
2nd : Reselected to evaluate family history separately.
Health Related Quality of Life (HRQOL) 1st : Selected (1) SF-12v2, but changed to (2) SF-36v2 with more detailed questions
 2nd : Re-selected (1) SF-12v2 as the shortened version to save patient interview time.
(2) SF-36v2 Korean
Comorbidity 1st : Select three objective comorbidity measures (1) CCI, (2) ECM, (3) SCQ
 2nd : Selected CCI as the most commonly used of the three metrics, and excluded SCQ because it was not possible to calculate a final score.
(3) SCQ
(2) ECM
Polypharmacy 1st : Selection of two “inappropriate medication prescribing criteria” to assess polypharmacy ((1)AGS Beers criteria, (2) STOPP Citeria)
2nd : Decided not to use criteria, but to collect through history taking of medication history. Excluded from selection
(1) AGS Beers criteria
(2) STOPP criteria
Dietary supplement 1st : Further refine dietary supplement categorization by nutrient and function
Constipation 1st : Select 3 most commonly used constipation endpoints in Korea (1) CAS, (2) PAC-SYM, (3) PAC-QOL
2nd : (1) CAS was selected as the most commonly used of the three metrics, (2) PAC-SYM, and (3) PAC-QOL were excluded because they require a paid purchase or have a complicated registration process.
(2) PAC-SYM
(3) PAC-QOL
Geriatric depression 1st : (1) GDS (2) GDS-SF
2nd : Decide to utilize the shortened form (2) GDS-SF, to save time on patient interviews
(1) GDS
Instrumental activities of daily living 1st : Select two Korean adaptations of instrumental activities of daily living (IADLs). (1) Jang Won Won Development - 10 questions (2) Kang Soo Jin Development - 11 questions
2nd : Decided to use (1) Jang Won Won Development - 10 questions, because it’s easier to get the author’s contact information for the translation
(2) Korean IADL (Kang Soo Jin Development - 11 questions)
Activities of daily living 1st : (1) Excluded K-ADLs due to lack of sensitivity when surveying the elderly. (1) ADL
Physical resilience 1st : Additional selections
Fall scale 1st : Four assessment tools were selected for fall risk prediction (1)MFS (2)Huhn’s Fall Risk Assessment Tool (3)JHFRAT (4)FAS-K
2nd : Decided to assess fractures and falls comprehensively through (1) MFS.
3rd : Korean translations were selected to the extent possible. As kFES-I is more researched among fall-related assessment scales in Korean subjects, we decided to evaluate kFES-I except for (1) MFS.
(1) MFS
(2) Huhn’s Fall Risk Assessment Tool
(3) JHFRAT
(4) FAS-k
Recent injury 1st : Select questions using the Fracture Assessment Questions as a guide
2nd : Decided to assess fractures and falls comprehensively through (1) MFS.
Fear of falling 1st : Select 2 fear of falling scales (1)kFES-I (Korean Version of Falls Efficacy Scale-International ) (2)ABC-scale
2nd : Decided to assess fractures and falls comprehensively through (1) MFS.
3rd : Korean translations were selected to the extent possible. As kFES-I is more researched among fall-related assessment scales in Korean subjects, we decided to evaluate kFES-I except for (1) MFS.
(2) ABC-scale
Oral health 1st : Five oral health assessment items were selected: (1) whether to brush daily yesterday; (2) when to brush yesterday; (3) whether to have an oral examination in the past year; (4) mastication discomfort; and (5) pronunciation discomfort.
Urine-hCG 1st : Add blood test items for pregnancy and lactation.
2nd : Decide not to collect because patients screened for cohort are not likely to be of childbearing potential. Delete this entry
Health Behavior Eating behavior 1st : Select 3 assessment tools for dietary habits (1) National Health and Nutrition Examination Survey_Dietary Habits Survey (2) DEBQ, (3) TFEQ
2nd : (2) DEBQ and (3) TFEQ were not selected because they do not have Korean translations and the license purchase process is complicated.
(2) DEBQ, (3) TFEQ
Food security 1st : Selection of two assessment tools for food safety items (1) National Health and Nutrition Examination Survey_Food Security Survey (2) U.S. Household food security survey module
2nd : Eliminated all due to lack of clinical significance of food security when evaluating geriatric populations
(1) National Health and Nutrition Examination Survey_Food Security Survey
(2) U.S. Household food security survey module
Paving Wheel Questionnaire 2nd : No validation studies have been done on the translations, so we requested and obtained appropriate translations from the journal.
Social network 1st : Select 2 additional social network questionnaire assessment tools (1) MOS-SSS (2) Lubben-6
2nd : (2) Lubben-18 tool was not selected because no information could be found about purchasing licenses and permissions.
(2) Lubben-18
Healthcare Unmet needs 1st : Use survey items provided by the Korean Medical Panel
Long-term care services 2nd : The service is offered to people 65 and older, so it does not meet the cohort selection criteria and was not selected.
Cognitive-Psychiatric Function Cognitive function - MMSE2, MMSE 1st : Select 2 tools (1) MMSE, (2) MMSE-2
3rd : Excluded (1) MMSE and (2) MMSE-2 due to the high number of overlapping questions with the MoCA instrument and the difficulty of purchasing a research license for both.
(1) MMSE
(2) MMSE-2
Cognitive function - CDT scoring 1st : For the Clock Drawing item of MoCA-K, we decided to use a separately developed scoring system, (1) the CDT Scoring Table.
3rd : Decided to utilize only MoCA-k, and excluded (1) the CDT Scoring Table..
(1) the CDT Scoring Table.
Physical Function TUG test, FRT 1st : Select (1) TUG and (2) FRT, which are common physical performance tests with SPPB.
2nd : Eliminated (1) TUG and (2) FRT because we believe SPPB is sufficient to assess physical performance.
(1) TUG
(2) FRT
Knee MMT 2nd : Knee MMT excluded from selection, as it is replaced by knee ROM test
Knee, lumbar spine X ray 2nd : Decide not to order knee and hip X-rays and replace them with a bone density test to save time with the patient.
Core muscle assessment 1st : Decided to use ultrasound to assess abdominal, rectus femoris, and core muscle thickness.
2nd : Decided to eliminate it due to inefficiency of patient interview time and instead use McGil’s core endurance test to assess abdominal core muscle function.
Availability of squat tests 2nd : Decide to run a simple squat test to assess physical function and strength
3rd : Decided to use McGil’s endurance test to comprehensively assess strength measures. The squat test was excluded
Hearing, vision test 1st : Hearing loss and vision loss are common symptoms of the elderly, so select vision loss as an additional category.
EEG; HRV test; Biological age measurement; PFT 3rd : Access to equipment at healthcare organizations conducting clinical research. Added to leverage rich evaluation metrics
Body Composition Inbody - assessment of Sarcopenia 3rd : Decided to evaluate muscle mass through inbody testing. We decide to further evaluate for sarcopenia.
Korean Medicine Questionnaire BSQ-MS 3rd : The existing questionnaire is full of Korean medicine terminology, which makes it difficult to conduct interviews in the field, so we changed it to a simplified questionnaire that is easy, clear, and shortened. (1) BSQ-MS

Sf-12v2; 12-item Short Form Survey, Sf-36v2; 36-item Short Form Survey, CCI; Charlson comorbidity index, ECM; Elixhauser et al. comorbidity measure, SCQ; Self-Administered Comorbidity Questionnaire, AGS; American Geriatrics Society, STOPP; Screening Tool of Older Persons’ Prescriptions, CAS; Constipation Assessment Scale, PAC-SYM; Psychometric validation of a constipation symptom assessment questionnaire, PAC-QOL; Patient Assessment of Constipation Quality of Life questionnaire, GDS; Geriatric Depression Scale, GDS-SF: Geriatric Depression Scale-Short Form, IADL; Instrumental Activities of Daily Living, ADL; Activities of Daily Living, MFS; Morse Fall Scale, JHFRAT; The Johns Hopkins Fall Risk Assessment Tool, FAS-K; Adult Fall Assessment Scale Korean version, kFES-I; Korean Version of Falls Efficacy Scale-International, ABC-scale; Activities-specific Balance Confidence scale, DEBQ; Dutch Behavior Questionnaire, TFEQ; Three-Factor Eating Questionnaire, MOS-SSS; Medical Outcomes Study Social Support Survey, MMSE; Mini-mental State Examination, MMSE-2; Mini-mental State Examination 2nd edition, CDT; Clock Drawing Test, TUG; Timed Up and Go, FRT; Functional Reach Test, MMT; Manual Muscle Test, ROM; Range of Motion, EEG; electroencephalography, HRV; heart rate variability, PFT; Pulmonary function test, BSQ-MS; Blood Stasis Questionnaires on metabolic

Table 3

Final Outcomes and Classification According to FDA8)

Outcome Domain Individual Clinical Outcome Variable Clinical Outcome Assessments/Biomarkers/Other Outcomes (Classification According to FDA)
Demographics Sex Other outcomes
Date of birth; age Other outcomes
Education attainment Other outcomes
Family relationship Other outcomes

Anthropometry Body weight; Height; Body Mass Index Biomarker

Health Assessment Vital Signs Blood Pressure : Systolic blood pressure; Diastolic blood pressure Biomarker
Pulse rate Biomarker
Body temperature Biomarker

Health Status Medical history; Surgical history; Drug history(polypharmacy); Family history PRO

Health Behavior Korean 12-item Short Form Survey PROs instrument
Comorbidity as Charlson comorbidity index PRO
Dietary supplement PRO
Constipation - Constipation Assessment Scale PROs instrument
Quality of life - EQ-5D-5L, EQ-5D-5L visual Analogue PROs instrument
Geriatric Depression Scale Short Form Korea Version PROs instrument
Korean instrumental activities of daily living scale. PROs instrument
Physical resilience scale PROs instrument
Fear of falling - Korean Version of Falls Efficacy Scale-International PROs instrument
Oral health PRO
Women’s health PRO
Smoking; drinking PRO
Sleep - Korean version of the Pittsburgh Sleep Quality Index PROs instrument
Physical activity - Korean Version of International Physical Activity Questionnaire Short Form PROs instrument
Nutritional risk - short form PROs instrument
Eating behavior PRO
Korean Version of Simplified Nutritional Appetite Questionnaire PROs instrument
Paving Wheel Questionnaire PROs instrument
Social network - Korean translation of the Medical Outcomes Study Social Support Survey scale PROs instrument

Healthcare Unmet needs Other outcomes
Healthcare costs Other outcomes

Cognitive Function Korean Version of the Montreal Cognitive Assessment PerfO instrument

Physical Function Hand-grip PerfO
SPPB score PerfO
Range Of Motion (knee; lumbar) ClinRO
Hearing, vision test ClinRO
Electroencephalography(EEG) ClinRO
Heart Rate Variability test (pulse wave test) ClinRO
McGil’s core endurance test PerfO
Biological age measurement ClinRO
Pulmonary function test PerfO

Body Composition DEXA ClinRO
Inbody ; assessment of Sarcopenia ClinRO

Korean Medicine Questionnaire Instrument of Korean Medical Pattern Identification and Functional Evaluation for Five Organ PROs instrument
Blood Stasis Questionnaires on metabolic syndrome PROs instrument
Kidney deficiency pattern screening assessment questionnaire PROs instrument
Core Seven-Emotions Inventory - short form PROs instrument

Clinical Laboratory Tests Biomarker

Biochemistry Albumin, aspartate aminotransferase, Total Protein, Total bilirubin, Calcium, Chlorine, Phosphorus, Sodium, Alkaline phosphatase isoenzymes, Amylase, creatine kinase, Aspartate Aminotransferase, Lactate dehydrogenase, γ-Gamma-glutamyl transpeptidase, Blood Urea Nitrogen, Creatinine, Uric Acid, Total cholesterol, High-density lipoprotein cholesterol, Triglyceride, Ferritin, total iron binding capacity, C-Reactive Protein, Low-density lipoprotein cholesterol

Immunology 25-OH Vitamin D-Osteocalcin, Cortisol, Free Thyroxine 4, Thyroid Stimulating Hormone, Dehydroepiandrosterone-sulfate - Vitamin B12, Insulin

Male Hormone Testosterone, prostate-specific antigen

Female Hormone Follicle stimulating hormone, Luteinizing Hormone, Estradiol

Hematology, HbA1c White Blood Cell, Red Blood Cell, Hemoglobin, hematocrit, Platelet, Mean corpuscular volume, Mean Corpuscular Hemoglobin, Mean Corpuscular Hemoglobin Concentration, White Blood Cell differential (Neutrophil, Lymphocyte, Monocyte, Eosinophil, Basophil), Hemoglobin A1c

Glucose Glucose

Urinalysis Urine White Blood Cell, Specific gravity, pH, Protein, Glucose, Occult blood, Ketones, Urobilinogen, Bilirubin, Nitrite, Urine Sediment (White Blood Cell, Red Blood Cell, Epithelial cell, Bacteria, Casts, Crystal, Others)

Omics analysis Metabolomic metrics, Plasma proteomics

EQ-5D-5L; EuroQOL 5-Dimension 5-level, PRO; Patient-reported outcomes, PerfO; performance outcome, SPPB; Short Physical Performance Battery, ClinRO; clinician-reported outcome, DEXA; Dual-energy X-ray absorptiometry

Table 4

Permission to Use of Clinical Outcome Assessment Instruments

Clinical Outcome Assessment Instruments Concept of Interest Population Intended to Use Response Option Number of Items Range of Score PROQOLID Database Availability Authorization Required for Use of Original Work Requires Purchase of Original Work Questionnaire Acquisition Methods: Availability of Original Author Contacts/Platform Link [Korean] PROQOLID Database Korean Version Availability [Korean] Authorization Required for Use of Translation Author [Korean] Questionnaire Acquisition Methods: Availability of Translation Author Contacts/Platform Link
Health Status Korean version of 12-item Short Form Survey 20,29) Health-Related Quality of Life - HRQL (incl. health status) Adult Yes/No
5 to 6-point Likert Scale
12 0–100 O O O https://www.qualitymetric.com/contact-info/? O O O
https://www.qualitymetric.com/contact-info/?
Health Status Constipation Assessment Scale30,31) Signs and symptoms Adult 3-point Likert scale 8 0–16 O X X NA O O X
Health Status EuroQOL 5-Dimension 5-level21) Utility, Health-Related Quality of Life - HRQL (incl. health status) Adolescent Adult Pediatrics 5-point Likert/Likert-type Scale 5 −0.59 ~ 1.00 O O X https://customer.euroqol.org/users/sign_in O X https://customer.euroqol.org/users/sign_in
Health Status EuroQOL 5-Dimension 5-level Visual Analogue21) Utility, Health-Related Quality of Life - HRQL (incl. health status) Adolescent Adult Pediatrics Visual Analog Scale(VAS) 1 VAS (20 cm) 0~100 O O X https://customer.euroqol.org/users/sign_in O X https://customer.euroqol.org/users/sign_in
Health Status Geriatric Depression Scale Short Form Korea Version32,33) NA NA Yes/no 15 N/A O X X NA X O X
Health Status Korean instrumental activities of daily living scale34,35) Physical functioning Geriatrics 3-, 4-point Likert scale 10 10–37 O O O O O O O
Health Status Physical resilience scale 36) Psychological functioning (incl. coping) NA 2-point Likert scale 17 + 1 subjective question 0–17 X O X O X X X
Health Status Korean Version of Falls Efficacy Scale-Internation al37,38) Physical functioning NA 4-point Likert Scale 16 16–64 O O X O O O O
Health Behavior Paving Wheel Questionnaire46) Psychological functioning (incl. coping), Social functioning (incl. work) NA 5-point Likert scale 60 60–300 X O O O X O X
Health Behavior Korean version of the Pittsburgh Sleep Quality Index42,43) Signs and symptoms Adult Caregivers 4-point Likert Scale 19 (+ 5 items rated by the bedpartner or roommate for clinical information only/not scored) 0–21 O X X NA O O O
Health Behavior Korean Version of International Physical Activity Questionnaire Short Form41,42) Physical functioning Youth 15 years of age and older Other: Number of minutes per week within each activity category Open-ended questions surrounding individuals’ last 7-day recall of physical activity 7 N/A O X X NA
https://sites.google.com/view/ipaq
O O X
Health Behavior Nutritional risk - short form43) Other_ Nutritional status Geriatrics 2-,3-,4-point Likert-type Scale 6+1 0–14 O X X https://www.mna-elderly.com/ O X https://www.mna-elderly.com/sites/default/files/2021-10/mna-mini-korean.pdf
Health Behavior Simplified nutritional appetite questionnaire 44,45) Signs and symptoms Adult Geriatrics 5-point Likert/Likert-type Scale 4 4–20 O X X NA
https://www.medlineuniversity.com/viewdocument/skintegrity-snaq-simplified-nutrit?CommunityKey=d15198e2-e041-4be7-be2b-1cc2c8291f86&tab=librarydocuments
O O O
Health Behavior Medical outcomes study-social support survey 47,48) Psychological functioning (incl. coping), Social functioning (incl. work) Adult 5-point Likert scale 19 19–95 O X X NA
https://www.rand.org/health-care/surveys_tools/mos/social-support.html
O O X
Cognitive Function Korean Version of the Montreal Cognitive Assessment22,52) Psychological functioning (incl. coping) Validated for 55 to 85 years Other: drawing, multiple choices, pictorial, analogy, open-ended question, counting 28 0–30 O X X NA
https://mocacognition.com/paper/
O X https://mocacognition.com/paper/
Korean Medicine Questionnaire Instrument of Korean Medical Pattern Identification and Functional Evaluation for Five Organ49) Signs and symptoms NA 5-point Likert scale 48 48–240 X O X O . .
Korean Medicine Questionnaire Blood Stasis Questionnaires on metabolic syndrome50) Signs and symptoms NA 5-point Likert scale Yes/No 15 0–32 X O X O . .
Korean Medicine Questionnaire Core Seven-Emotions Inventory - short form51) Psychological functioning NA 5-point Likert scale 28 28–140 X O X O . .
Korean Medicine Questionnaire Kidney deficiency pattern screening assessment questionnaire Signs and symptoms Adult Geriatrics 5-point Likert scale 20 X O O O . .