AbstractMaterials and methodsThe literature in Korea was reviewed using the search engines Science and Technology Society Village, Korean Studies Information Service System, National Discovery for Science Leaders, and Oriental Medicine Advanced Searching Integrated System. The keywords searched were “bee venom,” “apitoxin,” “apitherapy,” and “bee sting.” We selected 412 studies, which included Korean literary studies, experimental studies, and clinical studies.
ResultsWe classified them by publication year, research type, disease and topic, and quality assessment. Among bee venom-related studies, clinical studies (235 studies) outnumbered experimental studies (149 studies) and literary studies (28 studies). Nineteen experimental studies concentrated on the theme of “anticancer.” In the type analysis of clinical studies, lumbar disorders comprised 45 of 235 studies, followed by the effect on body. Forty-two randomized controlled trials (RCTs) have been published from 2003 to date (2015). Twenty-two studies used appropriate randomization methods. Fourteen studies had a Jadad score of 4–5 points; 15 studies, 1–3 points; and 13 studies, 0 points.
IntroductionBee venom therapy is a new acupuncture method. It uses the effects of needling and the biochemical pharmacological reactions of bee venom in treating diseases by artificially extracting and purifying venom from the venom sac of live bees, and then injecting it into the area or the acupoints associated with a disease1). In clinical practice, bee venom acupuncture is applied to treat diseases such as musculoskeletal diseases, immune system diseases, and nervous system diseases through the use of its effective features such as anti-inflammatory effect, analgesic effect, and continuous thermal stimulation on the treated part, and immune function enhancement and activation2).
Under these changes, one of the largest features in the field of acupuncture in Korea is pharmacopuncture-related research. Bee venom acupuncture (BVA) is a treatment method that involves applying chemical stimulation and physical stimulation on the acupoints of the human body, along with the existing pharmacopuncture therapy. It originated from bee sting therapy, which has been used among ordinary people for a long time to stimulate an affected area or on acupoints with live bees. By collecting bee venom from bees with bee venom collectors and securing safety through a sterile purification process, pharmacopuncture preparations for treatment have become commercially available to Korean medicine doctors. Bee venom was successfully developed with significantly reduced allergic reaction, which is a substantial problem. In Korea, numerous studies have been conducted with this venom and good efficacy results are continuously reported3). The authors aimed to report the results of an analysis on bee venom-related research studies published to date in Korea so as to investigate the current trends in research on bee venom and determine directions to move toward in the future.
Materials and Methods1. MaterialsTo review current research articles, we used four databases in South Korea: Science and Technology Society Village (KISTI), Korean Studies Information Service System (KISS), National Discovery for Science Leaders (NDSL), and Oriental Medicine Advanced Searching Integrated System (OASIS). The key words were “bee venom,” “apitoxin,” “apitherapy,” and “bee sting.” Furthermore, studies published in 2015 that were not yet available in database systems were manually searched for inclusion by reviewing journals.
We included literary studies (e.g., review), experimental studies (e.g., in vivo, in vitro), and clinical studies (e.g., randomized clinical trials [RCTs], non-RCTs, case reports or series, brief reports) on BVA. We excluded non–BVA-related studies, studies without full texts, and duplicate files. In the first step, the search focused on the titles and the abstracts. In the second step, studies were selected or extracted by reviewing the full texts.
As a result, 412 studies were selected for primary analysis. Based on the study method, clinical studies were then selected for secondary analysis. Forty-two RCTs, which excluded case studies and nonrandomized controlled trials (non-RCT), were selected for additional analysis (Figure 1).
2. MethodsData extraction and analysis were performed by two authors (Dr. Han and Professor Lee), who read and analyzed the full texts of the extracted data or abstracts when full texts were unavailable. The primarily selected studies were analyzed according to the year of publication and the type of study. The type of study was classified into three types: literature study, experimental study, and clinical study. A literature study was defined as a study that comprehensively investigated and described in the findings of various literature reports with respect to a certain disease or a study with a historical focus on the literature reports. An experimental study was defined as a study that released the results of experiments with animals or cells. A clinical study included case reports.
The secondarily selected RCTs were analyzed by subdividing them by general status and research quality assessment. The general status was analyzed with regard to the year of publication, target disease, bee venom treatment methods, control group setting, treatment and follow-up duration, assessment tools, treatment outcomes, ethical approval, and adverse event reports. The research quality assessment was performed using the modified Jadad score, as described in the study by White and Ernst 4), which is slightly modified from the existing Jadad score because it is difficult for acupuncture practitioners to be blinded (Table 1).
In terms of measurement, a randomized study was assigned 1 point, a study that used an appropriate randomization method was assigned 1 point, a study with inappropriate randomization was assigned −1 point (an undescribed randomization method was also assigned −1 point), a study in which the patients were blinded to intervention was assigned 1 point, a study in which the evaluator was blinded to the intervention was assigned 1 point, and a study that described withdrawals and dropouts was assigned 1 point.
Results1. Study of bee venom1) The number of published studies by yearSince 1976, when Experimental Studies on the Effect of Bee Venom Therapy on the Analgesic, Anti-pyretic and Anti-inflammatory Action by Koh5) was published for the first time in Korea, the research of bee venom has steadily increased. Each year since 2000, related studies have been published in the double-digits. In 2003, more than 30 related studies were first published. In 2006, the number of published studies was the highest with 36 studies. Until 1999, experimental focused research was conducted; clinical studies began thereafter and have been conducted to a greater extent than literature or experimental research (Figure 2).
2) The number of published studies, according to the study methodThe included studies were classified into three types, according the study method: literature studies, experimental studies, and clinical studies. Among 412 studies, there were 235 clinical studies (accounting for 57%), 149 experimental studies (36%), and 28 literature studies (7%) (Figure 3).
2. Classification of the literature studiesLiterature studies related to bee venom can be largely classified into two categories. The first class of studies investigated research trends or analyzed studies obtained by searching the MEDLINE database (U.S. National Library of Medicine, Bethesda, MD) or journals; the second class of studies examined treatment theories with bee venom based on studies or past literature. The former class included 19 (68%) studies on research trends and literature analysis, whereas the latter class included nine (32%) studies on bee venom therapy (Figure 4).
3. The classification of the experimental studies, according to themeExperimental research papers related to bee venom were classified according to the purpose and theme. One study can have several purposes and themes; therefore, related studies were organized by allowing overlaps. The results were as follows: 19 studies most frequently dealt with the theme of anticancer, followed by 17 studies on pain control, 14 studies on apoptosis, 14 studies on anti-inflammatory effects, and 11 studies anti-arthritis effects. Overlapping may occur when classifying themes. For example, experiments on nitric oxide (NO) is often for its antioxidant effects and experiments on cyclooxygenase-2 (COX-2) is often to determine its anti-inflammatory analgesic action. In addition, experiments on apoptosis mostly use cancer cells, which may be intended to determine an anticancer effect (Figure 5).
4. Classification of clinical studies, according to the region of the diseaseThe studies on diseases in clinical studies were classified by the region of the disease. It was difficult to classify the region of a disease because some cases involved multiple regions in a study; however, a widely covered region was classified as the region of a disease in the study and a region with an extensive range was classified as a systemic disease. The classified regions were largely divided into facial and head, neck, upper limb, spine and torso, lumbar, genitalia, pelvic limb, and systemic disease. The studies were divided by the subject of “nonpatients” or “hypersensitivity reactions.” The most studied region with a disease was the lumbar region with 45 (19%) studies, followed by systemic disease with 38 (16%) studies and the upper limb with 37 (16%) tudies. It was followed by (in decreasing order) pelvic limb (13%), neck part (9%), facial and head (8%), hypersensitivity reaction (8%), spine and torso (5%). With regard to a single disease, lumbar herniation of the nucleus pulposus was the most commonly studied disease among lumbar diseases with 22 studies. When expanding the region of the disease to the entire spine (i.e., cervical, thoracic, lumbar), lumbar herniation of the nucleus pulposus had the highest number of clinical cases. In addition, 12 (8%) studies were related to bee venom hypersensitivity reaction, even if there was a single case per study. Musculoskeletal diseases (e.g., fracture, arthritis, ligament disease, herniation of the nucleus pulposus) overall accounted for approximately 66% of the total studies (Figure 6).
Random-controlled Trials of Bee Venom1. The study diseases and the number of study participantsThere were seven studies on degenerative knee osteoarthritis, six studies on shoulder pain caused by stroke sequelae, six studies on back pain and herniation of the nucleus pulposus, four studies on ankle sprain, five studies on facial paralysis, four studies on neck disease, two studies on carpal tunnel disease, one study on patients with stroke and upper limb spasticity, one study on tennis elbow, one study on central post-stroke pain, one study on cancer pain, one study on heart rate variability, one study on musculoskeletal diseases, one study on rheumatoid arthritis, and one study on allergic reaction. With regard to the number of study participants, one study had fewer than 10 participants, three studies had 11–20 participants, 9 studies had 21–30 participants, 14 studies had 31–40 participants, 7 studies had 41–49 participants, 5 studies had 50–60 participants, 2 studies had 60–70 participants, and one study had more than 90 participants.
Bee venom treatment methods1. Manufacturers and typesThere were 19 self-mixed studies that used dried bee venom. Seventeen studies were provided by the Korean Pharmacopuncture Institute, three studies were prepared by Kyunghee Medical Center, and three studies were prepared by Jasaeng Oriental Medicine Hospital. Twenty-nine studies used bee venom (BV) only, 6 studies used sweet bee venom (SBV) only, and seven studies used both SBV and BV.
2. The injection site and the number of acupointsFour studies used one acupoint, nine studies used the A-shi point, and three studies used the joint cavity. Most studies used a variety of acupoints ranging from three points to 10 points or more.
3. The amount of injected BV into each acupointDepending on the concentration, the amount of BV injection by acupoint varied from 0.01 cc to 0.1 cc, based on the study. In some studies that were included in the present study, the injected amount was changed, depending on the patients and the response.
4. The total amount of injected BVThe total amount of injected BV also varied, and usually ranged from 0.1 cc to 1.0 cc. The highest amount used was 1.5 cc.
5. Needling depthIn 11 studies, the needling depth was precisely indicated by the centimeter unit. However, in most studies the needling depth was ambiguously described as “subcutaneous,” “in blood,” or “intradermal,” or was not mentioned.
6. Treatment durationThe treatment duration varied. Three studies evaluated one-time treatment. Two studies had a duration for a long-term period or 8 weeks or more; one study had a duration of 5 weeks; nine studies had a duration of 4 weeks; 10 studies had a duration of 2 weeks to less than 4 weeks; and six studies had a duration of less than 2 weeks, except for the three studies with the one-time treatment. In 11 studies in which the treatment duration varied according to the individual patient, the treatment duration was not indicated or could not be determined.
7. The frequency of BVA treatmentsThe frequency of BVA treatment varied: three studies examined one-time treatments only, four studies examined daily treatments, 15 studies examined three times weekly treatments or every other day treatments, eight studies examined twice weekly treatments, and five studies examined 2–3 times weekly treatments. Seven studies did not indicate the frequency of treatment.
8. Total number of BVA treatmentsThe total number of BVA treatments was variously distributed, and the highest number of treatments was 16 sessions, which was reported in two studies. Nine studies reported more than 10 treatments; this number excludes the studies that reported 16 treatments. Seventeen studies reported five treatments to fewer than nine treatments, and accounted for most studies. Ten studies reported fewer than four treatments, except for the three studies that used a one-time treatment. In one study, the total number of treatments was unknown.
Control group setting and combined treatmentMost studies had one control group. Three studies had two control groups and one study had three control groups. Among studies having one control group, 10 studies adopted a saline solution to treat the control group; seven studies had no treatment, except for combined treatment; six studies adopted common acupuncture to treat the control group; seven studies compared SBV and BV, and eight studies adopted other control group treatments.
Assessment toolThe visual analog scale (VAS) was the most commonly used assessment tool, which was used in 30 studies of the 42 included studies. In addition, a variety of assessment tools were used: five studies used the Yanagihara’s unweighed grading system (Y-system), four studies used painless passive range of motion (ROM) of shoulder external rotation, three studies used the Ankle-Hindfoot Scale (AHS), five studies used the Oswestry Low Back Disability Questionnaire (ODI), three studies used the Numerical Rating Scale (NRS), three studies used the pain rating score, two studies used the Nine Point Scale, and three studies used the Neck Disability Index (NDI).
Treatment outcomesSeventeen studies indicated that the results of the assessment as treatment results were statistically significant, eight studies indicated that the results of the assessment were partially effective, and 17 studies indicated no difference between the groups.
Ethical approval and skin testWith regard to ethical approval, four studies only were approved by the institutional review board (IRB) with consent, 10 studies received written consent, and three studies provided explanation and obtained verbal consent. However, in most studies information on written consent or IRB approval was not included.
The skin test and related information was described in 20 studies. However, it was not mentioned in the remaining 22 studies.
Modified Jadad score1. RandomizationAll included studies reported being randomized. However, 21 studies were performed by appropriate randomization, and the remaining 21 studies merely reported that randomization was performed or were studied in an inappropriate way.
DiscussionResearch articles related to bee venom began in France with the results of an experiment on applying bee stings to patients with rheumatoid disease, which was first reported in 1858 by Desjardin48). In 1968, Habermann49) reported the biochemical constituents of BV, and thereafter several experimental and clinical research studies with regard to the efficacy, effect, and allergic reaction of each constituent of BV have been actively published in many countries such as the United States, China, Russia, and Northern Europe. In addition, a recent attempt to analyze BVA for rheumatoid arthritis was performed through a systematic literature review and meta-analysis; however, there is low-quality evidence, based on one study, that BVA can significantly reduce pain and improve the quality of life of patients with rheumatoid arthritis, compared to the placebo control (i.e., a normal saline injection). However, the number of studies, their quality, and the total sample size were too low to draw firm conclusions50). Since a thesis by Kweon51) in 1992, many studies have been published to date in Korea.
In this regard, the authors attempted to conduct a typical analysis of BV-related studies to analyze and classify comprehensively the trends and content of BV-related studies published until 2015, and thereby to explore the directions of BV-related studies and address problems. In addition, the authors analyzed research trends and the research quality of RCT-designed studies by using various assessment criteria and the modified Jadad scale.
An examination of the number of studies by type published from the 1990s to 2015 showed that, since the 2000s, full-fledged clinical studies have been conducted, based on basic research and early literature. Beginning in 2002, more than 25 BV-related studies have been published every year, and account for a considerable proportion of studies in the Korean medicine community.
Based on the type of study, the number of past literature studies related to BV was very small, compared to other Korean medicine therapy-related literature; thus, studies based on the literature accounted for a small proportion, and most of the development is achieved in the areas of experimental and clinical studies.
For basic research papers, experiments have been conducted in diverse ways from the pharmacological reactions of cell units to efficacy with injections on acupoints in animals. When dealing with a wide range of topics, the contents of such diverse topics may often overlap because the topics have been examined for similar purposes, even though the main subject of each study is different.
It was too complicated to classify clinical studies by disease because such studies have dealt with a variety of diseases from nervous system disorders such as stroke and facial nerve paralysis; adverse reaction reports, which include BV hypersensitivity reactions in clinical studies of normal persons; and the same diseases often become separate diseases because in many cases a mix of Western diagnoses and Korean medicine diagnoses is used in practice. Therefore, it was in reality difficult to obtain statistical data.
From 2003 until 2008, related RCTs have generally been on an increasing trend. However, since 2009, a small number of related studies have been released. This may be because studies related to BV have been conducted over a certain level and there have been increased restrictions in RCTs because of reinforced IRB standards. Related studies have been conducted on a variety of disease, but most studies have been conducted with a focus on musculoskeletal diseases because of the nature of BV.
With regard to the number of study participants in the included studies, for a considerable number of studies, there was a concern whether the number of clinical study participants as presented in the results of related studies could be a sufficient number of samples as the evidence of study results. For example, if the number of participants in a study is fewer than 20, the number of individuals per group is fewer than 10 subjects per group, and thus any changes in the results of a small number of patients may easily reverse the study’s conclusion.
An examination of the experimental methods showed that, because there were differences in the experimental methods between studies, it may be necessary to establish standards for BV-related studies. Several studies also lacked a detailed description of the experimental design, which decreased the accuracy and reliability of the studies. This may subsequently affect the reproducibility of studies and, at the same time, pose questions about their results. The amount of BV injection is critical because of the characteristics of BV. However, there were significant deviations in the injection amount between studies, which showed there was no unified recognition of the appropriate injection amount among researchers. Furthermore, the effects of BVA may vary, according to the needling depth; however, the needling depth was precisely described in only 11 studies, which may make it difficult to reproduce or verify the related studies objectively. The number of acupoints and injected amount by acupoint were different, depending on the study. Thus, consistent standards for BV-related studies seem to be required.
The treatment duration and the number of treatments are to be adjusted, according to the response to BV and the severity of diseases. The number of treatments, treatment intervals, and treatment duration should be controlled for each study. In view of the fact that the exact treatment interval was not specified or that the number of treatments, treatment interval, and treatment duration were different (depending on the patient), the control variables were inconsistent, and thereby lowered the reliability of the studies as a whole.
The VAS was the most used assessment tool. When assessing statistical effectiveness with this tool, BV has a therapeutic effect, according to the control group results. However, its efficacy may not be statistically significant because there is no difference between the treatment group and the control group. Considering such relativity, the control groups in the included studies could be classified in studies that compared SBS and BV, studies that adopted saline solution as the control group treatment, and studies that adopted other treatments (e.g., general acupuncture, pharmacopuncture) for the control group. In spite of clinical studies having similar themes, there were studies that showed significant differences in the results. This may be further verified through more sophisticated study designs and appropriate study methods in the future.
In clinical studies, the objectivity and science of study are important. However in an experimental study, in which certain factors are artificially manipulated or intervened, these factors are likely to cause a greater risk. Thus, concerned parties such as researchers, study sponsors, ethics committee, and research institution are further required to comply with ethics and to have responsibility. In particular, in a randomized study design, it is considered a matter of “equivalence,” and thus study participants should be informed of the risks associated with their allocation to a placebo group. Information on consent or IRB approval was not included in 25 studies of 42 RCTs. After 2007, investigators gradually tended to set a high value on written consent or ethical approval. Clinical studies in the future should be conducted after obtaining IRB approval.
A universal tool that determines the quality of study methods is the Jadad score. However, in the present study a slightly modified Jadad score was used because it is difficult to have acupuncture practitioners blinded to an intervention. In this regard, specific randomization methods were described in 22 studies (i.e., more than one-half of the included studies), which used a random-number table, randomization by computer, or coin tossing. In 20 studies, the investigators simply mentioned that the study was randomized. Randomization by computer program is recommended in view of the fact that coin tossing or random-number table has no reproducibility. However, in the present study, these randomization methods were considered appropriate because a study was evaluated only as to whether it mentioned randomization.
Twenty-two studies had the patients blinded to the intervention, 13 studies were double-blinded, and two studies were evaluator-blinded. For patient-blinded or double-blinded studies, it is easy for patients and practitioners to identify by the naked eye the treatment received, except for saline and acupuncture in which the same kind of syringe can be used. Thus, it is difficult to assess BV-related studies with blinding only. Furthermore, for patients are able to recognize whether BV was injected who experience BV reactions or symptoms such as redness, itching and swelling, which makes it impossible to determine if a blinding was properly achieved. On the other hand, for evaluator blinding, a study that is in progress in a double-blind fashion can be performed sufficiently and avoid selection bias, and therefore the quality of evaluator-blinded studies would be excellent. In fact, evaluator-blinded studies by Yang and Song20) and Ko et al.29) were appropriately conducted for different diseased areas.
A description about dropouts is a good way to assess studies objectively. If the reasons for dropouts and the number of dropouts are not described, dropouts can be determined by the researcher’s intention, which may cause bias and thereby affect the reliability of the whole study. Twenty studies did not mention dropouts from which it can be judged that an undetailed study design, progress, and description of the whole study were collectively formed.
The quality assessment of study methods in the included studies revealed that a considerable number of studies had low scores, which may deteriorate the quality of studies and raise questions about the reliability and validity of results of related studies. Therefore, efforts may be needed to describe study methods accurately. The use of the CONsolidated Standards of Reporting Trials (CONSORT) form or checklists for reporting RCTs, including the RCT checklist of the Scottish Intercollegiate Guidelines Network (SIGN) can be an option 52,53). In addition, when using recommendations such as the Standard for Reporting Intervention in Controlled Trials of Acupuncture (STRICTA)54) or the influencing Factors which Affect the Effectiveness of Acupuncture Scale (FEAS)55) as the study methods in acupuncture-related clinical studies, the provisions of such recommendations may affect the results of BV therapy such as acupuncture. Thus, BV-related RCTs in the future may require considering these methodologies.
Because BVA has not been standardized, significant differences in selecting medications and treatment methods exist among practitioners. It is necessary to verify the efficacy of BV through well-designed clinical studies rather than through clinical experience or literature evidences in accordance with EBM, but the number of high-quality clinical studies is absolutely lacking. In addition, there have been no unified study method in previous clinical studies conducted to date, which may lower the reliability of results. This factor makes it difficult to apply a meta-analysis as a means of setting treatment guidelines by integrating and analyzing several RCT results, which recently have been increasingly utilized. Therefore, clinical studies should be conducted using a standardized study method suited for the characteristics of BVA so that BVA can be positioned as an efficacious therapy, based on EBM. Studies for demonstrating the efficacy and safety of BVA should be actively performed, and its treatment methods should be standardized through integrating and analyzing the results of the studies.
AcknowledgmentsThis study was supported by ‘New Donguibogams’ Compilation Project (K15500) of KIOM (Korea Institute of Oriental Medicine) in 2015.
References1. Korean Pharmacopuncture Institute. Pharma-o-puncturology. Korean Pharmacopuncture Institute. Seoul. Elsevier Korea;(2008.
2. Korean Pharmacopuncture Institute. Pharmacopuncture Procedure Guide. Korean Pharmacopuncture Institute. Seoul. Korean Pharmacopuncture Institute;(2008.
3. Korean Pharmacopuncture Institute. Pharmacopuncturology. Korean Pharmacopuncture Institute. Seoul. Elsevier Korea;(2011.
4. White, AR, & Ernst, E. A systematic review of randomized controlled trials of acupuncture for neck pain. Rheumatology (Oxford, England), (1999). 38(2), 143-147. 10342627. Epub 1999/05/26. eng
![]() 5. Koh, H. Experimental studies on the effect of bee venom therapy on the analgesic, anti-pyretic and anti-inflammatory action. Korean Orien Med, (1976). 13(1), 283-292.
6. Lee, YC, Nam, DJ, Huh, G, Lee, JE, Kim, BNR, & Song, EM, et al. The comparative study on the effect of hwangryunhaedoktang pharmacopuncture and essential bee venom pharmacopuncture for cervical pain caused by traffic accidents. J Orien Rehabil Med, (2014). 24(4), 145-153.
7. Im, SH, Lee, MJ, Lee, SM, Kim, ES, Lee, SH, & Kang, JW, et al. A comparative study of the effects of jungsongouhyul pharmacopuncture treatment and bee venom pharmacopuncture treatment on peripheral facial paralysis. Journal of Korean Acupuncture & Moxibustion Society, (2014). 31(2), 135-144.
8. Kim, JH, Jeong, JY, Yee, SW, Shin, SY, Park, JH, & Kim, CH, et al. Comparison of the efficacy between needle-embedding therapy and sweet bee venom pharmacopuncture therapy on peripheral facial paralysis. Journal of Korean Acupuncture & Moxibustion Society, (2013). 30(4), 35-44. Korean.
![]() 9. Ro, HR, Park, SH, Lee, JY, Choo, WJ, Han, SW, & Kim, SW, et al. The comparative study on the effect of ShinBaro pharmacopuncture treatment and bee venom pharmacopuncture treatment of patient with spondylolisthesis. J Korea CHUNA Med Spine & Nerves, (2012). 7(2), 53-61.
10. Cho, SH, Cho, HS, Lee, KY, Yun, SH, Jung, WS, & Kim, SH. The comparative study of effectiveness of cotreatment with samgieum-gagam, acupuncture and sweet bee venom acupuncture on post-stroke shoulder pain. Journal of Korean Acupuncture & Moxibustion Society, (2012). 29(2), 15-27.
11. Lee, JH, Kim, JS, Yang, KY, Han, SY, Lee, JY, & Hwang, EM. Effect of bee-venom acupuncture on low back pain by traffic accidents. J Korea CHUNA Med Spine & Nerves, (2011). 6(2), 61-70.
12. Park, JA, Lee, CH, Kwon, GS, Lee, KA, & Jang, KJ. The effects of sweet bee venom pharmacopuncture on the post-stroke hemiplegic shoulder pain. Journal of Korean Acupuncture & Moxibustion Society, (2011). 28(4), 37-47.
13. Ku, JY, Lee, KH, Cho, SW, Lee, SC, Youn, HM, & Jang, KJ, et al. Comparison of the effects between sweet bee venom pharmacopuncture and scolopendrid pharmacopuncture on carpal tunnel syndrome. Pharmacopuncture, (2010). 13(4), 75-89.
![]() 14. Park, JH, Jang, SH, Lee, CH, Ku, JY, Jeun, DS, & Ahn, CB, et al. The clinical research of the effectiveness of pharmacopuncture complex therapy on peripheral facial paralysis. Journal of Korean Acupuncture & Moxibustion Society, (2010). 27(2), 79-87.
15. Noh, JH, Park, JA, Cho, SW, Youn, HM, Jang, KJ, & Song, CH, et al. Effect of bee-venom acupuncture on upper limb spasticity of stroke patients. Journal of Korean Acupuncture & Moxibustion Society, (2010). 27(4), 115-125.
16. Choi, JY, Lee, H, Kang, JH, Kim, YI, Kim, JH, & Lee, SH, et al. Comparative study of general oriental medical treatment and bee venom pharmacopuncture on acute peripheral facial paralysis patient with postauricular pain. Journal of Korean Acupuncture & Moxibustion Society, (2009). 26(5), 95-103.
17. Gwak, JY, Cho, SY, Shin, AS, Lee, IW, Kim, NH, & Kim, HM, et al. Efficacy of bee-venom acupuncture on central post stroke pain - single-blind randomized controlled trial. Journal of Korean Acupuncture & Moxibustion Society, (2009). 26(6), 205-214.
18. Kang, I, Moon, JY, Lim, MJ, Cho, JH, & Lee, HE. The comparison study between different interventions for treating acute ankle sprain - using dry needle, bee venom acupuncture, hwangryunhaedoktang herbal acupuncture. Journal of Korean Acupuncture & Moxibustion Society, (2008). 25(5), 89-95.
19. Kim, HB, Lee, RM, Lee, MH, Choi, YS, Kim, JI, & Lee, YH, et al. Comparative Study of Effects of ‘Intramuscular Bee Venom Herbal Acupuncture’ and ‘Intracutaneous Bee Venom Herbal Acupuncture’ in Knee Osteoarthritis Patients. Journal of Korean Acupuncture & Moxibustion Society, (2008). 25(2), 151-164.
20. Yang, KR, & Song, HS. A comparative study of warm needling and bee venom pharmacopuncture on osteoarthritis of the knee - a randomized controlled trial. Pharmacopuncture, (2008). 11(2), 21-31.
![]() 21. Kim, SC, Na, WM, Lee, SY, Jang, EH, & Lim, SI. A study on pain relief effects and allergic responses for the osteoarthritis of the knee joint between sweet bee venom and bee venom pharmacopuncture. Pharmacopuncture, (2008). 11(1), 31-40.
![]() 22. Kim, JH, Jang, SH, Yoon, HM, Jang, KJ, Ahn, CB, & Kim, CH, et al. The comparison of effectiveness between bee venom and sweet bee venom therapy on chronic lower back pain. Pharmacopuncture, (2008). 11(4), 15-24.
![]() 23. Yook, TH, Yu, JS, & Jung, HS. Effects of sweet bee venom and bee venom on the heart rate variability. Pharmacopuncture, (2008). 11(1), 41-54.
![]() 24. Lee, KH, Youn, HM, Ko, WS, Song, CH, Jang, KJ, & Ahn, CB, et al. Comparison of treatment effects and allergic responses to stiff neck between sweet bee venom and bee venom pharmacopuncture. Pharmacopuncture, (2008). 11(4), 39-48.
![]() 25. Yoo, HS, & Kim, JS. The effect of sweet bee venom pharmacopuncture (SBVP) on cancer -related pain: a randomized controlled trial and double Blinded. Pharmacopuncture, (2008). 11(1), 21-29.
![]() 26. Lee, SH, Kang, MW, Lee, H, & Lee, SY. Effectiveness of bee-venom acpuncture and ouhyul herbal acpuncture in herniation of nucleus pulposus-comparison with acpuncture therapy only. Journal of Korean Acupuncture & Moxibustion Society, (2007). 24(5), 197-205.
27. Na, WM, Lee, SY, Jang, EH, Kim, SC, Moon, HC, & Kim, SM, et al. A study on pain relief effects and allergic responses for the osteoarthritis of the knee joint between sweet bee venom and bee venom pharmacopuncture. Pharmacopuncture, (2007). 10(2), 47-55.
![]() 28. Lee, TH, Hwang, HS, Chang, SY, Cha, JH, Jung, KH, & Lee, EY, et al. The comparison of effectiveness between bee venom and sweet bee venom therapy on low back pain with radiating pain. Pharmacopuncture, (2007). 10(3), 85-89.
![]() 29. Ko, CN, Min, IK, Park, SW, Jung, WS, Moon, SK, & Park, JM, et al. Effectiveness of bee venom acupuncture on shoulder pain after stroke. The Journal of Korean Oriental Medicine, (2007). 28(1), 11-24.
30. Song, BY. A clinical study on the effects of sweet bee venom herbal acupuncture for patients with whiplash injury. Pharmacopuncture, (2007). 10(3), 77-83.
![]() 31. Seo, JW, Park, MJ, Sung, IH, Kim, NO, & Ahn, CK. A clinical study of bee venom acupuncture therapy on the treatment of acute ankle sprain. Journal of Korean Acupuncture & Moxibustion Society, (2006). 23(1), 95-103.
32. An, BJ, & Song, HS. Effect of bee venom -acupuncture therapy on patients with sprain of the wrist joint. Pharmacopuncture, (2006). 9(2), 167-171.
![]() 33. An, BJ, Kim, KT, Kang, MS, & Song, HS. Effect of bee venom-acupuncture on patients with osteoarthritis of knee joint. Journal of Korean Acupuncture & Moxibustion Society, (2006). 23(4), 15-20.
34. Eom, JY, Won, SH, Kwon, KR, & Lee, HS. Comparative study of acupuncture, bee venom acupuncture and bee venom herbal acupuncture on the treatment of post-stroke hemiplegic shoulder pain. Pharmacopuncture, (2006). 9(1), 139-154.
35. Lee, DY, Lee, GM, Yeom, SC, Kim, DH, & Kim, DJ. A clinical study of bee venom acupuncture therapy on shoulder pain patients in stroke sequelae. Journal of Korean Acupuncture & Moxibustion Society, (2006). 23(4), 69-80. Korean.
36. Lee, JS, Lee, JY, Kwon, KR, & Lee, HC. A study on allergic responses between bee venom and sweet bee venom pharmacopuncture. Pharmacopuncture, (2006). 9(3), 61-77.
![]() 37. Cho, SW, Go, KH, Nam, JH, Kim, MS, Lee, SY, & Lee, IS, et al. The effectiveness of zingiberis rhizoma herbal acupuncture therapy and bee venom herbal acupuncture therapy on the poststroke hemiplegic shoulder pain. J Orien Rehabil Med, (2005). 15(4), 77-87. Korean.
38. Kim, KT, & Song, HS. A randomized controlled double blinding study of bee venom acupuncture therapy on sprain of c-spine. Journal of Korean Acupuncture & Moxibustion Society, (2005). 22(4), 189-195.
39. Kim, KT, & Song, HS. The effectiveness of bee venom acupuncture therapy on the treatment of sprain of l-spine (a randomized controlled trial; double blinding). Journal of Korean Acupuncture & Moxibustion Society, (2005). 22(4), 113-120.
40. Song, HS. The effect of bee venom acupuncture (BVA) on acute ankle sprain: a randomized controlled trial and double blinding - pilot study. Pharmacopuncture, (2005). 8(2), 11-16.
41. Kim, MS, Kim, HJ, Park, YJ, Kim, EH, & Lee, EY. The clinical research of the efficacy of bee venom aqua-acupuncture on peripheral facial paralysis. Journal of Korean Acupuncture & Moxibustion Society, (2004). 21(4), 251-262. Korean.
42. Ryu, SM, Lee, JS, Kim, SS, & Jung, SH. The effect of intra-articular bee venom injection on osteoarthritis of the knee. J Orien Rehabil Med, (2004). 14(1), 35-52.
43. An, GH, Lee, H, & Lee, BR. The comparative study on the bee-venom therapy and common acupuncture therapy for the lateral epicondylitis (tennis elbow). J Korean Orien Med, (2004). 13(2), 267-276.
44. Lee, H. The comparative study on the bee-venom therapy and common acupuncture therapy for the acute ankle sprain. Korean J Acupunct, (2004). 21(4), 133-143.
45. Lee, SN, Hong, SY, Jo, HC, Byeon, IJ, Song, HS, & Kim, GH. The clinical study on bee venom acupuncture treatment on osteoarthritis of knee joint. Journal of Korean Acupuncture & Moxibustion Society, (2003). 20(5), 73-81. Korean.
46. Chung, WS, Lee, JS, Chung, SH, & Kim, SS. The effect of bee venom acupuncture on patient with herniation of nucleus pulposus of lumbar spine. J Orien Rehabil Med, (2003). 13(2), 87-101. Korean.
47. Lee, SH, Hong, SJ, Kim, SY, Yang, HI, Lee, JD, & Choe, DY, et al. Randomized controlled double blind study of bee venom therapy on rheumatoid arthritis. Journal of Korean Acupuncture & Moxibustion Society, (2003). 20(6), 80-88. Korean.
48. Kim MH. Bee Venom Therapy and Bee Acupuncture Therapy. Kim MH, editor. Seoul. Korean Education Plan;(1994.
49. Habermann E. Chemistry, Pharmacology and Toxicology of Bee, Wasp and Hornet Venoms. Bücherl W, Buckley EE, editors. Venomous Animals and Their Venoms: Venomous Invertebrates. New York. Academic Press;(1971). p. 61-93.
50. Lee, JA, Son, MJ, Choi, J, Jun, JH, Kim, JI, & Lee, MS. Bee venom acupuncture for rheumatoid arthritis: a systematic review of randomised clinical trials. BMJ open, (2014). 4(11), e006140. 25380812. 4225238. Epub 2014/11/09. eng
![]() 51. Kweon, KL, Koh, HK, & Kim, CH. Experimental studies on the effect of api-toxin therapy on the anti-inflammatory action. Kyunghee Univ Oriental Med J, (1993). 16, 297-323.
52. Begg, C, Cho, M, Eastwood, S, Horton, R, Moher, D, & Olkin, I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. Jama, (1996). Aug 28. 276(8), 637-639. 8773637. Epub 1996/08/28. eng
![]() 53. Chalmers, I. Current Controlled Trials: an opportunity to help improve the quality of clinical research. Current controlled trials in cardiovascular medicine, (2000). 1(1), 3-8. 11714397. 59587. Epub 2001/11/21. Eng
![]() 54. MacPherson, H, White, A, Cummings, M, Jobst, KA, Rose, K, & Niemtzow, RC, et al. Standards for Reporting Interventions in Controlled Trials of Acupuncture: the STRICTA recommendations. Journal of alternative and complementary medicine (New York, NY), (2002). Feb. 8(1), 85-89. 11890439. Epub 2002/03/14. eng
![]() 55. Kim, WY, Lee, SD, Lim, BM, & Kim, KS. The assessment of appropriateness of acupuncture methodology based on STRICTA recommendations - the discussion of 5 systematic reviews and their objects 58 randomized controlled trials using the new tools. Journal of Korean Acupuncture & Moxibustion Society, (2007). 24(5), 151-170.
|
|