ObjectiveWe constructed a real-world evidence evaluation system to provide reference for obtaining high-quality evidence in evidence-based medicine.MethodsThrough the investigation and analysis of the key factors influencing the real-world research evidence, combined with domestic and foreign literature and evaluation tools, we preliminarily constructed the indicators of the real-world evidence evaluation system, then consulted experts in related fields by the Delphi method, modified and determined the final evaluation indicators. ResultsThe indicators of the final real-world evidence evaluation system included 40 items. The recovery efficiencies of the two rounds of expert consultation were 88.2% and 100%; The expert coordination coefficients were 0.174 (P<0.001) and 0.189 (P<0.001). After the second round of consultation, the mean of Likert scale in the range of 3.73~4.93, and the coefficient of variation varied in the range of 0.05~0.21. ConclusionThe real-world evidence evaluation system constructed in this study has certain reliability and scientificity, which can provide a basis and help for the transformation of real-world research into high-quality evidence.
ObjectiveBy establishing a set of evaluation system for thoracoscopic clinical function and applicability, to evaluate and compare the advantages and disadvantages of different brands of thoracoscopes, and to provide some suggestions for the innovation and upgrade of thoracoscopes, especially for the domestic thoracoscopes.MethodsThe project coordination team initially formulated the evaluation index system for the clinical function and applicability of thoracoscope by querying literature and brainstorming. The Delphi expert consultation method was used to distribute questionnaires to the selected experts. Experts provided scores which were based on the importance of each indicator, and clarified the basis of their judgment and the familiarity with the evaluation indicators. After two rounds of screening by Delphi method, a thoracoscopic clinical function and applicability satisfactory questionnaire was formed. The appropriate sample for pre-investigation was selected, and the reliability and validity were tested. The index composition was adjusted based on the results of the test to form a final evaluation scale.ResultsThe project coordination team initially formulated 24 thoracoscope-related evaluation indicators. After two rounds of experts consultation, the item "brightness adjustment" was deleted without any additional entries. The positive coefficients of the experts in the first round and the second round were 100.0% and 80.0%, respectively. The two rounds of authoritative coefficients were 0.86 and 0.90, and the coordination coefficients were 0.272 (P<0.001) and 0.523 (P<0.001), respectively. A total of 140 questionnaires were issued in this pre-investigation. The recovery rate was 100.0% and the effective rate was 90.0%. The Cronbach's α value of the scale was 0.936, and the Spearman-Brown split-half reliability coefficient was 0.972. The factor analysis finally extracted 3 common factors. The total variance of the cumulative interpretation was 70.9%. The three common factors were named "operation related", "image related" and "device related".ConclusionThe evaluation index system developed in this study has good reliability and validity, and can be used as a tool to evaluate the clinical function and applicability of thoracoscopes.
Objective To construct the expert consensus on comprehensive rehabilitation assessment system for the elderly in the hospital and community. MethodsMedline, Embase, Cochrane Library, China National Knowledge Infrastructure and VIP databases were searched for geriatric rehabilitation assessment materials from June 2016 to June 2021. The primary items were summarized through literature review and research group discussion, and then Delphi method was used among 20 experts in geriatric rehabilitation medicine to develop consensus-based core items for the elderly comprehensive rehabilitation assessment system. Results A total of 158 references were included. Through integration, sorting and screening, the research team initially formulated 41 items and four major sections including cardiopulmonary exercise, sensory perception, cognition and psychology (speech contained), and swallowing, urination and defecation. The effective recovery rates of the two rounds of experts consultation were both 100%, the mean expert authority coefficient was 0.92±0.05, the variation coefficients were 0.174±0.043 and 0.172±0.063, respectively; the Kendall coefficients of concordance were 0.587 and 0.601, with P values<0.05 for both, respectively. Finally, The comprehensive rehabilitation assessment system for the elderly including 16 items would be formed. Conclusion The expert consensus on comprehensive rehabilitation assessment system for the elderly constructed by Delphi method includes motor, sensory perception, cognition, swallowing, speech, cardiopulmonary, defecation, mental and psychological elements, which are identified with high recognition and consistency from experts.
ObjectivesTo provide methodology support for the tracking assessment of specific resolution execution through evidence-based construction of tracking assessment index system for resolution execution of WHO essential medicine accessibility resolution, so as to further promote and improve the establishment of national essential medicine policies, and offer a methodology reference to survey and assess the resolution executions in other public health fields.MethodsA multi-disciplinary team was set up to preliminarily construct the index system by means of earlier system assessment index through index screening based on Delphi method. The weight of each index was determined by analytic hierarchy process.ResultsAfter two rounds of expert consultation, the index system available for resolution execution measures and results of WHO essential medicine accessibility were established, including 9 indexes of resolution execution measures. Meanwhile, the execution results of index contained 4 first class indexes, 13 second class indexes and 36 third class indexes. Each of the indexes obtained its own weight according to degree of importance.ConclusionsIn this study, the assessment index for resolution execution of essential medicine accessibility is established, however, the empirical research is still required to further verify the scientificity as well as feasibility of this index system.
As an important auxiliary means of pharmacoeconomics evaluation, budget impact analysis can effectively measure the affordability of medical insurance fund, and plays a significant role in the process of medical insurance access negotiation, adjustment of medical insurance reimbursement directory and establishment of payment price. The quality of budget impact analysis data has a great impact on the analysis results and the scientific decision-making. When the existing data cannot meet the requirements of the paper, relevant software is needed to carry out Delphi method to ensure the data accuracy. Infopoll is a powerful, easy-to-use application that designs consultation questionnaires by providing multiple question choices and multiple forms of answer settings, as well as detailed statistical charts for results analysis. This paper introduces how to obtain the data of budget impact analysis based on Delphi method using Infopoll software, and analyzes the main results in detail.
ObjectiveTo build core items of database for traumatic brain injury (TBI) in rehabilitation medical database.MethodsRelevant factors in TBI database were summarized through database search in combination of acknowledged relevant items of TBI in rehabilitation medical database. Delphi method was used for experts to determine which items should be included by two rounds of questionnaires.ResultsThe average authority coefficient of experts was 0.94. After two rounds of questionnaires, 73 were included. Its contents include: general conditions, brain damage and disposal, relevant rehabilitation assessment scales, previous rehabilitation treatment, treatment expenses, and contents that require attention during re-evaluation.ConclusionsAfter two rounds of Delphi evaluation, the core items of database for TBI are identified with high recognition and consistency from experts.
ObjectiveTo select the key questions of the reporting quality of acupuncture therapy network meta-analysis. MethodsA question pool about reporting quality of acupuncture therapy network meta-analysis was conducted by preliminary literature research and qualitative systematic review. A correspondence questionnaire was designed and the selection of key questions was carried out through two rounds of expert consultation using the Delphi method. ResultsA total of 21 key questions were selected for the network meta-analysis report standard of acupuncture, including whether to report details of acupuncture interventions (e.g., needle type, acupoints used, number of needles inserted, depth of needle insertion, retention time, needling techniques, and treatment duration), diagnostic criteria for diseases or traditional Chinese medicine syndromes, and qualifications of acupuncture practitioners. Of these, the only three key questions answered by the preferred reporting items for systematic reviews and network meta-analysis (PRISMA-NMA) were summary, protocol and registration, and source of funding, while the remaining 19 were specific to acupuncture-related report standards. ConclusionThe conducted key question on reporting guideline of acupuncture network meta-analysis can improve the standardization and rigor of relevant research and better utilize its academic and clinical value.
ObjectiveTo establish a systematic, scientific, and sensitive index system to provide a scientific basis for quality evaluation and comprehensive quality management of day surgery nursing.MethodsThe databases of Wanfang, China National Knowledge Infrastructure, CQVIP, PubMed, and Web of Science were searched. The retrieval time was from the establishment of the databases to 15th July, 2019. Based on the “structure-process-outcome” management model, Delphi method was used to conduct two rounds of expert consultation for nursing experts related to day surgery in five tertiary hospitals. The results of the consultation were sorted out and the consensus of experts was obtained, so as to determine the quality-sensitive indicators of day surgery nursing.ResultsA total of 20 nursing experts participated in the questionnaire survey. The final evaluation indicators determined by expert correspondence included 1 structural indicator, 9 process indicators, and 4 outcome indicators.ConclusionsThe construction of quality evaluation standard of day surgery nursing not only embodies the connotation of nursing management of day surgery, but also puts forward clear requirements and quality standards for specialized nursing management. It has high reliability, scientificity, and strong operability, which can effectively improve the quality of nursing management and service level of day surgery.
ObjectiveTo construct a health in all policies (HiAP) evaluation index system for earthquake-stricken areas based on national health policies.MethodsFrom April to December 2020, this study combined the methods of comprehensive review of relevant literature, on the foundation of the evaluation indicators pool was preliminarily constructed. The Delphi method and analytic hierarchy process were adopted to construct the evaluation indicators system in earthquake-stricken areas and analyzed the weights of indicators.ResultsA total of 5 first-level indicators (investment, action, short-term effect, medium-term effect, long-term effect), 15 second-level indicators, and 44 third-level indicators with satisfactory logical consistency of HiAP evaluation indicators system in earthquake-stricken areas had been constructed.ConclusionsThe HiAP evaluation indicators system constructed in this study can be used to comprehensively evaluate the implementation of HiAP earthquake-stricken areas.
As a tool for building consensus among groups, Delphi technique has been widely used in healthcare research which is appropriate for clinical questions where quantitative methods are unlikely to yield results that can be successfully implemented in practice. Researchers in palliative care developed standards for conducting and reporting Delphi studies (CREDES). This paper introduces and interprets the specific content of CREDES standards, with a view to providing reference for the evaluation of Delphi research design quality and report transparency.