Real-world data studies have experienced rapid development in recent years, however, misunderstandings persist. This paper aims to improve practice and promote standardization by updating the categorization of real-world data, proposing two conceptual frameworks for conducting real-world data studies, developing the concepts of research data infrastructure and clarifying the misconceptions on registry database, and discussing future development.
As an important source for real-world data, existing health and medical data have gained wide attentions recently. As the first part of the serial technical guidance for real-world data and studies, this report introduced the concepts, features and potential applications of existing medical and health data, proposed recommendations for planning and developing a research database using existing health and medical data, and developed essential indicators for assessing the quality of such research databases. The technical guidance may standardize and improve the development of research database using existing health and medical data in China.
Observational studies based on real-world data are providing increasing amount of evidence for evaluating therapeutic outcomes, which is important for timely decision-making. Although time and costs for data collection could be saved using real-world data, it is significantly more complex to design real world researches with lower risk of bias. In order to enhance the validity of causal inference and to reduce potential risk of bias in real world studies, the Working Group of China Real world data and studies Alliance (China REAL) has formulated recommendations for designing observational studies to evaluate therapeutic outcomes based on real-world data. This guidance introduces design types commonly used in real world research; recommends key elements to consider in observational studies, including sample selection, specifying and allocating exposures, defining study entry and endpoints, and pre-designing statistical analysis protocols; and summarizes potential biases and corresponding control measures in real-world studies. These recommendations introduces key elements in designing observational studies using real-world data, for the purpose of improving the validity of causal inference. However, the application scope of these recommendations may be limited and warrant constant improvement.
Assessing the clinical value of pharmaceuticals is crucial for comprehensive evaluation in clinical practice and plays a vital role in supporting decision-making for drug supply assurance. Real-world data (RWD) offers valuable insights into the actual diagnosis and treatment processes, serving as a significant data source for evaluating the clinical demand, effectiveness, and safety of drugs. This technical guidance aims to elucidate the scope of application of RWD for the clinical value assessment of pharmaceuticals, as well as the key considerations for conducting value assessment research. These considerations include identifying the dimensions of clinical value that necessitate RWD and effectively utilizing RWD for evaluation purposes. Additionally, this guidance provides essential points for implementing pharmaceutical clinical value assessment based on real-world data, with a specific focus on study design and statistical analysis. By doing so, this guidance assists researchers in accurately comprehending and standardizing the utilization of real-world research in conducting pharmaceutical clinical research.
A patient registry database is an important source of real-world data, and has been widely used in the assessment of drug and medical devices, as well as disease management. As the second part of the serial technical guidance for real-world data and studies, this paper introduces the concept and scope of potential uses of patient registry databases, proposes recommendations for planning and developing a patient registry database, and compares existing health and medical databases. This paper further develops essential quality indicators for developing a patient registry database, in expect to guide future studies.
Randomized controlled trials are considered as the gold standard for determining the causality, and are usually used to evaluate the efficacy and safety of medical interventions. However, in some cases it is not feasible to conduct a randomized controlled trial. In recent years, a framework called “target trial emulation study” has been formally established to guide the design and analysis of observational studies based on real-world data. This framework provides an effective method for causal inference based on observational studies. In order to facilitate domestic scholars to understand and apply the framework to solve related clinical problems, this article introduces it from the basic concept, framework structure and implementation steps, development status, and prospects.
With the boom of information technology and data science, real-world evidence (RWE) which is produced using diverse real-world data (RWD) has become an important source for healthcare practice and policy decisions, such as regulatory and coverage decisions, guideline development, and disease management. The production of high-quality RWE requires not only complete, accurate and usable data, but also scientific and sound study designs and data analyses to enable the questions of interest to be reliably answered. In order to improve the quality of production and use of RWE, China REal world data and studies ALliance (ChinaREAL) has developed the first series of technical guidance for developing real-world data and subsequent studies. The efforts are ongoing which would ultimately inform better healthcare practice and policy decisions.
In 2019, the national government issued the document "Implementation Plan for Supporting the Construction of the Boao Lecheng International Medical Tourism Pilot Area", which allowed the use of innovative drugs and medical devices in medical institution of Boao Lecheng. These medical products had been designed to meet urgent clinical requirements and had been approved by regulatory authorities overseas. Through the use of these medical products, real-world data were generated in the routine clinical practice, based on which real-world evidence might be produced for regulatory decision-making by using scientific and rigorous methods. In March 2020, the first medical device product using domestic real-world data was approved, suggesting that the real-world data initiative in Boao Lecheng achieved initial success. This work also provided important experience for promoting the practice of medical device regulatory decision-making based on real-world evidence in China. Here, we shared the preliminary experiences from the study on the first approved medical device product and discussed the issues on developing a real-world data research framework in Boao Lecheng in attempt to offer insights for future studies.
To enhance the quality and transparency of oncology real-world evidence studies, the European Society for Medical Oncology (ESMO) has developed the first specific reporting guidelines for oncology RWE studies in peer-reviewed journals "the ESMO Guidance for Reporting Oncology Real-World Evidence (GROW)". To facilitate readers understanding and application of these reporting standards, this article introduces and interprets the development process and main contents of the ESMO-GROW checklist.
Evidence-based medicine is the methodology of modern clinical research and plays an important role in guiding clinical practice. It has become an integral part of medical education. In the digital age, evidence-based medicine has evolved to incorporate innovative research models that utilize multimodal clinical big data and artificial intelligence methods. These advancements aim to address the challenges posed by diverse research questions, data methods, and evidence sources. However, the current teaching content in medical schools often fails to keep pace with the rapidly evolving disciplines, impeding students' comprehensive understanding of the discipline's knowledge system, cutting-edge theories, and development directions. In this regard, this article takes the opportunity of graduate curriculum reform to incorporate real-world data research, artificial intelligence, and bioinformatics into the existing evidence-based medicine curriculum, and explores the reform of evidence-based medicine teaching in the information age. The aim is to enable students to truly understand the role and value of evidence-based medicine in the development of medicine, while possessing a solid theoretical foundation, a broad international perspective, and a keen research sense, in order to cultivate talents for the development of the evidence-based medicine discipline.