Your browser does not support the NLM PubReader view.

Go to this page to see a list of supporting browsers.

Effect of A Pharmacovigilance Practice Training Course for Future Doctors of Korean Medicine on Knowledge, Attitudes and Self Efficacy

Article information

J Korean Med. 2020;41(1):21-44
Publication date (electronic) : 2020 March 9
doi : https://doi.org/10.13048/jkm.20003
Mikyung Kimorcid_icon
Department of Internal Medicine, College of Korean Medicine, Sangji University
Correspondence to: Mikyung Kim, Department of Internal Medicine, College of Korean Medicine, Sangji University, 83 Sangjidae-ro, Wonju, Gangwon-do, 26338, Republic of Korea, Tel: +82-33-741-9215, Fax: +82-33-732-2124, E-mail: 01mkkim@gmail.com
Received 2020 January 6; Revised 2020 February 3; Accepted 2020 February 5.

Abstract

Objectives

This study was aimed to develop a pharmacovigilance practice training course for future doctors of Korean medicine, the graduate students of a college of Korean medicine, and to verify the educational effect of the curriculum.

Methods

Fifty-six students were given a training course designed as follows: 1) pre-class homework (basic theory self-study, online course, causality assessment, and adverse event reporting simulation); 2) in-class: homework submission and case discussion; 3) after-class: homework revision and resubmission. An online survey to assess the change of the level of basic knowledge and attitudes toward pharmacovigilance, the willingness to report adverse events, and self-efficacy for the causality assessment and adverse event reporting was conducted before and after education.

Results

The survey participation rate was 96.5% in pre-education and 64.3% in the post-education survey. After education, knowledge level was improved (mean score from 4.3±2.11 to 6.7±1.96 points, modal value from 3 to 8 points) and positive changes were observed in almost all questions on attitudes. In the post-education survey, more students felt that they could do causality assessment (from 13% to 80.5%), could report adverse events to the agency in charge (from 7.4% to 96.2%), and expressed their strong willingness to report adverse events in the future (from 77.8% to 88.9%) than in the pre-education survey.

Conclusions

More schools of Korean medicine need to adopt pharmacovigilance training courses in their curriculum to foster future doctors of Korean medicine with pharmacovigilance capabilities. Such efforts will be the basis for achieving an evidence-based, safe use of herbal medicine.

Keywords: pharmacovigilance; spontaneous reporting system; adverse event reporting; undergraduate education; clinical practice training; college of Korean medicine
Fig. 1

Changes in knowledge level before and after education (distribution of total score)

n=54 for pre-, and 36 for post-education

x-axis, total score (out of 10); y-axis, number of students

Fig. 2

Changes in expected responses in questions on attitudes toward pharmacovigilance and adverse event reporting before and after education

n=54 for pre-, and 36 for post-education

Abbreviations: KMD, Korean medicine doctor; PV, pharmacovigilance; AE, adverse event

Fig. 3

Changes in expected responses in questions on self-efficacy, willingness to report, and attitudes toward the need for PV course before and after education

n=54 for pre-, and 36 for post-education

Abbreviations: PV, pharmacovigilance; AE, adverse event; KM, Korean medicine

Changes in knowledge level before and after education (percentage of the correct answer by each question)

Changes in attitudes toward pharmacovigilance and adverse event reporting before and after education (selection rate for each distractor)

Changes in self-efficacy, willingness to report, and attitudes toward the need for pharmacovigilance course before and after education (selection rate for each distractor)

Themes Emerging in the Survey

Supplementary Material

Supplement 1

Questionnaire

jkm-41-1-21-suppl.pdf

References

1. Korea Institute of Drug Safety & Risk Management. Drug Safety Information. KIDS Webpage [cited 2020 12 Jan]; Available from: https://www.drugsafe.or.kr/ .
2. Lopez-Gonzalez E, Herdeiro MT, Figueiras A. Determinants of under-reporting of adverse drug reactions: a systematic review. Drug Saf 2009;32(1):19–31.
3. Shetti S, Kumar CD, Sriwastava NK, Sharma IP. Pharmacovigilance of herbal medicines: Current state and future directions. Pharmacogn Mag 2011;7(25):69–73.
4. Inman WH. Attitudes to adverse drug reaction reporting. Br J Clin Pharmacol 1996;41(5):434–5.
5. Hartman J, Härmark L, van Puijenbroek E. A global view of undergraduate education in pharmacovigilance. Eur J Clin Pharmacol 2017;73(7):891–9.
6. Beckmann J, Hagemann U, Bahri P, Bate A, Boyd IW, Dal Pan GJ, et al. Teaching pharmacovigilance: the WHO-ISoP core elements of a comprehensive modular curriculum. Drug Saf 2014;37(10):743–59.
7. van Eekeren R, Rolfes L, Koster AS, Magro L, Parthasarathi G, Al Ramimmy H, et al. What future healthcare professionals need to know about pharmacovigilance: introduction of the WHO PV core curriculum for university teaching with focus on clinical aspects. Drug Saf 2018;41(11):1003–11.
8. Lareb . Pharmacovigilance Education for Universities 2017. Available from: https://www.pv-education.org .
9. Schutte T, Tichelaar J, Reumerman MO, van Eekeren R, Rolfes L, van Puijenbroek EP, et al. Feasibility and educational value of a student-run pharmacovigilance programme: a prospective cohort study. Drug Saf 2017;40(5):409–18.
10. Schutte T, Tichelaar J, Reumerman MO, van Eekeren R, Rissmann R, Kramers C, et al. Pharmacovigilance skills, knowledge and attitudes in our future doctors–A nationwide study in the Netherlands. Basic Clin Pharmacol 2017;120(5):475–81.
11. Choi N-K, Kwon H-B, Lee A-Y, Park B-J. A Survey on Attitudes and Awareness of Physicians and Pharmacists Regarding Spontaneous Reporting System and Experience for Adverse Drug Events in Goyang-si. JPERM 2008;1:44–52.
12. Teong C-H, Jeong J-S, Park K-H, Lee D-W, Park S-C. Medical Staff’s Attitude towards Adverse Drug Reaction in the Dongguk University Gyeongju Hospital. Korean J Fam Pract 2015;5(1):25–33.
13. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3(2):77–101.
14. BIO, Biomedtracker, AMPLION. Clinical Development Success Rates 2006–2015. BIO Industry Analysis Available from: https://www.bio.org/sites/default/files/legacy/bioorg/docs/Clinical%20Development%20Success%20Rates%202006-2015%20-%20BIO,%20Biomedtracker,%20Amplion%202016.pdf .
15. Jung S-Y, Choi N-K, Lee J, Park B-J. Use of big data for drug safety monitoring and decision making. J Korean Med Assoc 2014;57(5):391–7.
16. Alomar MJ. Factors affecting the development of adverse drug reactions. Saudi Pharma J 2014;22(2):83–94.
17. Uppsala Monitoring Center. UMC Web page [cited 2020 12 Jan]; Available from: https://www.who-umc.org/ .
18. Park B-J. Status and Improvement Plan of Patient Safety Management System Related to Pharmaceutical Products. HIRA Policy Trend 2014;8(5):16–26.
19. Park J-W. Past, Present, and Future of Korean Regional Drug Safety Center. JPERM 2018;10:43–8.
20. Plöen M. Signal Detection in a Global Database 2018. [cited 2020 12 Jan]; Available from: https://www.meddra.org/sites/default/files/page/documents_insert/signal_detection_in_a_global_database.pdf .
21. APEC Harmonization Center. 2015 AHC Activity Report 2016;:28–31.
22. Woo Y-j, Chung S-y, Park B-J. Current Status of Spontaneous Adverse Reactions Reporting System on Herbal Medicine in China, Japan, Korea and WHO. J Int Korean Med 2014;35(2):111–8.
23. Woo Y-j, Chung S-y, Park B-J. Necessity of Reporting on Herbal Medicine Adverse Event and Introduction of Reporting Method. J Int Korean Med 2014;Oct. :174–9.
24. Shaw D, Graeme L, Pierre D, Elizabeth W, Kelvin C. Pharmacovigilance of herbal medicine. J Ethnopharmacol 2012;140(3):513–8.
25. World Health Organization. WHO guidelines on safety monitoring of herbal medicines in pharmacovigilance systems 2004. [cited 2020 12 Jan]; Available from: https://apps.who.int/iris/bitstream/handle/10665/43034/9241592214_eng.pdf .
26. Wechwithan S, Suwankesawong W, Sornsrivichai V, McNeil EB, Jiraphongsa C, Chongsuvivatwong V. Signal detection for Thai traditional medicine: examination of national pharmacovigilance data using reporting odds ratio and reported population attributable risk. Regul Toxicol Pharmacol 2014;70(1):407–12.
27. Fahim SM, Mishuk AU, Cheng N, Hansen R, Calderon AI, Qian J. Adverse event reporting patterns of concomitant botanical dietary supplements with CYP3A4 interactive & CYP3A4 non-interactive anticancer drugs in the U.S. Food and Drug Administration Adverse Event Reporting System (FAERS). Expert Opin Drug Saf 2019;18(2):145–52.
28. Li H, Deng J, Yue Z, Zhang Y, Sun H. Detecting drug-herbal interaction using a spontaneous reporting system database: an example with benzylpenicillin and qingkailing injection. Eur J Clin Pharmacol 2015;71(9):1139–45.
29. Kwon Y-J, Jo W-K, Han C-H. Status of Herbal-drug-associated Adverse Drug Reactions Voluntarily Reported by EMR. J Int Korean Med 2012;33(4):485–97.
30. Kim M, Han C-H. Analysis of Herbal-drug-associated Adverse Drug Reactions Using Data from Spontaneous Reporting System in Electronic Medical Records. J Korean Med 2015;36(1):45–60.
31. Lee SH, Song BW, Choi HJ, Kim EY. The Analysis of Herbal Medicine-Associated Adverse Drug Reactions Spontaneously Reported in a Korean Medicine Hospital. J Kor Soc Health-syst Pharm 2017;34(2):183–99.
32. Cho J-H, Oh D-S, Hong S-H, Ko H, Lee N-H, Park S-E, et al. A nationwide study of the incidence rate of herb-induced liver injury in Korea. Arch Toxicol 2017;91(12):4009–15.
33. Kim M, Han C-H. Adverse drug reactions in Korean herbal medicine: A prospective cohort study. Eur J Integr Med 2017;9:103–9.
34. Woo Y, Hyun MK. Safety of herbal medicine for elderly patients with chronic disease in the Republic of Korea. Eur J Integr Med 2019;30:100934.
35. Elkalmi RM, Hassali MA, Ibrahim MIM, Widodo RT, Efan QMA, Hadi MA. Pharmacy Students’ Knowledge and Perceptions About Pharmacovigilance in Malaysian Public Universities. Am J Pharm Educ 2011;75(5):96.
36. Kim HJ, Hwang SY. Impact of Safety Climate Perception and Barriers to Adverse Drug Reaction Reporting on Clinical Nurses’ Monitoring Practice for Adverse Drug Reactions. Korean J Adult Nurs 2018;30(2):115–25.
37. Kyung EJ, Rew JH, Oh M, Kim EY. A Survey on Attitude and Awareness of Health-Care Professionals Regarding Pharmacovigilance System and Experience for Adverse Drug Reaction (ADR) from a Single University Hospital. Korean K Clin Pharm 2013;23(3):256–68.
38. De Smet PA. An introduction to herbal pharmacoepidemiology. J Ethnopharmacol 1993;38(2–3):189–95.
39. Farah M. Guidelines for herbal ATC classification Uppsala Monitoring Centre. Uppsala: 2004.
40. Farah M. Herbal ATC index Uppsala. Uppsala Monitoring Centre: 2004.
41. Uppsala Monitoring Center. What’s New in WHODrug March. 1. 2018. [cited 202012 Jan]; Available from: https://www.who-umc.org/media/164170/whats-new-in-whodrug-2018.pdf .
42. ISoP, Herbal and Traditional Medicine Group. Special Interest Group 2017. [cited 2020 12 Jan]; Available from: https://isoponline.org/special-interest-groups/herbal-and-traditional-medicines-2 .
43. Ministry of Food and Drug Safety/Pusan University. Construction of Herbal Drug Code System for Pharmacovigilance 2018. [cited 202012 Jan]; Available from: http://www.ndsl.kr/ndsl/search/detail/report/reportSearchResultDetail.do?cn=TRKO201900003538 .
44. Lesar TS, Briceland L, Stein DS. Factors Related to Errors in Medication Prescribing. JAMA 1997;277(4):312–7.
45. Gavaza P, Bui B. Pharmacy students’ attitudes toward reporting serious adverse drug events. Am J Pharm Educ 2012;76(10):194.
46. Gerritsen R, Faddegon H, Dijkers F, van Grootheest K, van Puijenbroek E. Effectiveness of pharmacovigilance training of General Practitioners. Drug Saf 2011;34(9):755–62.
47. Reumerman M, Tichelaar J, Piersma B, Richir MC, van Agtmael MA. Urgent need to modernize pharmacovigilance education in healthcare curricula: review of the literature. Eur J Clin Pharmacol 2018;74(10):1235–48.

Article information Continued

Copyright © 2020 The Society of Korean Medicine all rights reserved

Fig. 1

Fig. 1

Changes in knowledge level before and after education (distribution of total score)

n=54 for pre-, and 36 for post-education

x-axis, total score (out of 10); y-axis, number of students

Fig. 2

Fig. 2

Changes in expected responses in questions on attitudes toward pharmacovigilance and adverse event reporting before and after education

n=54 for pre-, and 36 for post-education

Abbreviations: KMD, Korean medicine doctor; PV, pharmacovigilance; AE, adverse event

Fig. 3

Fig. 3

Changes in expected responses in questions on self-efficacy, willingness to report, and attitudes toward the need for PV course before and after education

n=54 for pre-, and 36 for post-education

Abbreviations: PV, pharmacovigilance; AE, adverse event; KM, Korean medicine

Table 1

Changes in knowledge level before and after education (percentage of the correct answer by each question)

Questions Options Pre-education Post-education
Concept of pharmacovigilance 36(66.7) 27(75.0)
Concept of side effect 29 (53.7) 31 (86.1)
Concept of adverse drug reactions 10 (18.5) 18 (50.0)
Main methodology of PMS 32 (59.3) 34 (94.4)
Agency in charge of SRS in Korea 19 (35.2) 22 (61.1)
WHO CC for International Drug Monitoring 14 (25.9) 26 (72.2)
Potent reporters in SRS Correct answer 11 (20.4) 20 (55.6)
Doctors 47 (87.0) 35 (97.2)
KMDs 46 (85.2) 34 (94.4)
Dentists 45 (83.3) 35 (97.2)
Pharmacists 35 (64.8) 30 (83.3)
KOPs 21 (38.9) 27 (75.0)
Nurses 20 (37.0) 27 (75.0)
Patients 18 (33.3) 23 (63.9)
Patients’ care-givers 13 (24.1) 22 (61.1)
Do not know 10 (18.5) 2(5.6)
Targets of SRS Correct answer 1 ( 1.9) 5(13.9)
Nonprescription drugs 31 (57.4) 34 (94.4)
Prescription drugs 29 (53.7) 32 (88.9)
Vaccines 25 (46.3) 28 (77.8)
Biologics 25 (46.3) 24 (66.7)
HM (pharmaceutical preparations) 21 (38.9) 24 (66.7)
HM (complex formulae prepared by individuals) 19 (35.2) 18 (50.0)
HM (single drug) 16 (29.6) 27 (75.0)
Do not know 22 (40.7) 3 (8.3)
Reporting criteria based on causality level 41 (75.9) 29 (80.6)
Disclosing of patient personal information in ICSRs 41 (75.9) 30 (83.3)

Results are presented as frequency (%). N=54 for pre-, and 36 for post-education.

Abbreviations: PMS, post-marketing surveillance; SRS, spontaneous reporting system; WHO, World Health Organization; CC, collaborating center; KMD, Korean Medicine Doctors; KOP, Korean Oriental Pharmacist; HM, herbal medicine; ICSR, individual case safety report

Table 2

Changes in attitudes toward pharmacovigilance and adverse event reporting before and after education (selection rate for each distractor)

Questions Time point Options
The role of the KMDs in PV is important No Do not know Yes
Pre 4 (7.4) 9 (16.7) 41 (75.9)
Post 0 (0.0) 1 (2.8) 35 (97.2)
KMDs need to report AEs to agency in charge, when they experienced/witnessed AEs after HM therapy. No Do not know Report only HM-related AEs Report all except HM-related AEs Yes
Pre 0 (0.0) 4 (7.4) 3 (5.6) 0 (0.0) 47 (87.0)
Post 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 36 (100.0)
AE reporting will result in the followings: Unlikely Less likely Do not know Likely Very Likely
1) People learn lessons about drug risks Pre 0 (0.0) 4 (7.4) 5 (9.3) 32 (59.3) 13 (24.1)
Post 0 (0.0) 0 (0.0) 2 (5.6) 20 (55.6) 14 (38.9)
2) The reporter gains personal benefits Pre 9 (16.7) 15 (27.8) 20 (37.0) 7 (13.0) 3 (5.6)
Post 9 (25.0) 7 (19.4) 13 (36.1) 7 (19.4) 0 (0.0)
3) It contributes to improving patient safety. Pre 1 (1.9) 1 (1.9) 5 (9.3) 32 (59.3) 15 (27.8)
Post 0 (0.0) 0 (0.0) 2 (5.6) 15 (41.7) 19 (52.8)
4) It increases the risk of medication errors Pre 11 (20.4) 22 (40.7) 10 (18.5) 9 (16.7) 2 (3.7)
Post 13 (36.1) 15 (41.7) 7 (19.4) 0 (0.0) 1 (2.8)
5) It breaks trust with patients Pre 6 (11.1) 16 (29.6) 15 (27.8) 15 (27.8) 2 (3.7)
Post 8 (22.2) 13 (36.1) 12 (33.3) 2 (5.6) 1 (2.8)
6) It interferes with the normal workflow Pre 4 (7.4) 23 (42.6) 18 (33.3) 7 (13.0) 2 (3.7)
Post 12 (33.3) 11 (30.6) 10 (27.8) 2 (5.6) 1 (2.8)
7) The reporting process wastes time. Pre 12 (22.2) 21 (38.9) 10 (18.5) 9 (16.7) 2 (3.7)
Post 16 (44.4) 10 (27.8) 6 (16.7) 3 (8.3) 1 (2.8)
8) It leads to a decrease in medical income. Pre 10 (18.5) 15 (27.8) 16 (29.6) 12 (22.2) 1 (1.9)
Post 12 (33.3) 11 (30.6) 10 (27.8) 2 (5.6) 1 (2.8)
9) It causes legal disputes. Pre 3 (5.6) 9 (16.7) 16 (29.6) 21 (38.9) 5 (9.3)
Post 9 (25.0) 6 (16.7) 15 (41.7) 5 (13.9) 1 (2.8)
10) It contributes to the safe use of drugs. Pre 0 (0.0) 2 (3.7) 5 (9.3) 28 (51.9) 19 (35.2)
Post 1 (2.8) 0 (0.0) 3 (8.3) 12 (33.3) 20 (55.6)

Results are presented as frequency (%). N=54 for pre-, and 36 for post-education.

Abbreviations: KMD, Korean Medicine Doctors; PV, pharmacovigilance; pre, pre-education; post, post-education; HM, herbal medicine; AE, adverse event

Table 3

Changes in self-efficacy, willingness to report, and attitudes toward the need for pharmacovigilance course before and after education (selection rate for each distractor)

Questions Time point Options
I can assess the causal relationship between AEs and suspected drugs. Not at all Mostly no Do not know Mostly yes Always yes
Pre 3 (5.6) 11 (20.4) 33 (61.1) 5 (9.3) 2 (3.7)
Post 1 (2.8) 1 (2.8) 5 (13.9) 25 (69.4) 4 (11.1)
I can report AEs to the agency in charge. No Yes
Pre 50 (92.6) 4 (7.4)
Post 1 (2.8) 35 (97.2)
I will report the AEs to the agency in charge. Not at all Mostly no Do not know Mostly yes Always yes
Pre 0 (0.0) 1 (1.9) 11 (20.4) 34 (63.0) 8 (14.8)
Post 0 (0.0) 0 (0.0) 4 (11.1) 21 (58.3) 11 (30.6)
PV course should be included in the curriculum of college of KM. Not agree Do not know Agree
Pre 6 (11.1) 9 (16.7) 39 (72.2)
Post 1 (2.8) 4 (11.1) 31 (86.1)

Results are presented as frequency (%). N=54 for pre-, and 36 for post-education.

Abbreviations: KMD, Korean Medicine Doctors; PV, pharmacovigilance; pre, pre-education; post, post-education; HM, herbal medicine; AE, adverse event; KM, Korean medicine

Table 4

Themes Emerging in the Survey

Question Theme Subtheme
Educational Effect of This Course 1. Instructive (n=9) 1-1. Learned new things not familiar with
1-2. A chance to think about how to prepare in case of AEs
2. Realized the need for PV (n=2) 2-1. PV will contribute to the improvement and development of KM
2-2. I will actively participate in PV in the future.
Suggestions for Improvement of the PV System for HM 1. PV target expansion (n=4) All types of HMs in circulation should be included in PV system in addition to pharmaceutical preparations
2. Activation of PV participation in KM profession (n=3) 2-1. Activation of HM-related AE reporting by KMDs
2-2. Promoting KMDs to report AEs
2-3. Encouraging education and researches

Abbreviations: AE, adverse events; PV, pharmacovigilance; KM, Korean medicine; HM, herbal medicine; KMD, Korean medicine doctors