Literature review for clinical evaluation – Best practices
This blog post will show you how to systematically, transparently, and audit-proof conduct an MDR-compliant literature search. You will learn how to develop a robust search strategy, define clear inclusion and exclusion criteria, avoid typical bias risks in screening, and critically evaluate studies. Furthermore, you will learn how to effectively link literature to your clinical claims, systematically identify data gaps, and keep your research up-to-date through continuous lifecycle management.
Abbreviations
|
CEP |
Clinical evaluation plan |
|
CERIUM |
Clinical Evaluation Report |
|
MDR |
Medical Device Regulation (EU Ordinance 2017/745) |
|
Sota |
State-of-the-art |
Underlying regulations, standards and guidelines
EU Regulation 2017/745 (MDR)
MEDDEV 2.7/1 Rev. 4
1 Introduction
Under the MDR, clinical evaluation is no longer a formal obligation – it is the central evidence for the safety, performance, and clinical benefit of a medical device. The evaluation must be systematic, transparent, and evidence-based (Article 61, Annex XIV).
And this is precisely where quality is often decided, at a point that is still underestimated in practice: literature research.
Too often it is understood as a preparatory step – as a means to "collect relevant studies".
But under the MDR, it is far more than that.
The literature forms the basis for key elements of clinical evaluation:
- the State of the Art (SotA)
- the derivation and safeguarding of clinical claims
- the benefit-risk assessment
- as well as the identification of clinical data gaps
If the literature review is unsystematic, this has direct consequences:
The clinical evaluation becomes selective instead of complete, descriptive instead of analytical – and in the worst case, vulnerable to regulatory challenges.
Typical weaknesses repeatedly emerge:
- missing or unclear search strategy
- non-reproducible searches
- Mixed objectives (e.g., state of the art vs. product-specific evidence)
- unstructured or subjective study selection
These problems are rarely the result of a lack of literature. They arise from a lack of structure. An MDR-compliant literature search therefore does not follow gut feeling, but a clearly defined, documented, and traceable process. It is not retrospective ("What did we find?") but prospectively planned ("What do we need to show – and how do we find the appropriate evidence?").
This article shows you exactly how to implement this – and turn your literature review from a weakness into a solid foundation for your clinical evaluation.
2. Strategy before search: The most common weakness
One of the most frequent – and at the same time most consequential – errors in clinical evaluation lies not in the execution of the literature search, but before its actual beginning: the lack of a clearly defined search strategy.
In practice, research is often started operationally – databases are opened, initial search terms are entered, and the results "develop along the way."
What seems intuitive is problematic from a regulatory perspective.
Because under the MDR (Medical Review Guidelines), a literature review must systematic and reproducible .
And that is only possible if the strategy is defined in advance.
Without this structure, typical weaknesses arise:
- The selection of studies is situational rather than rule-based
- Search terms are not documented
- Relevant studies are overlooked or found by chance
- Traceability in the audit is not given
The consequence: The literature base has a selective effect – even if this was not intended.
A reliable literature review therefore always begins with a clear strategic definition.
Before the first search is performed, at least the following elements should be defined:
- Objective of the research
(e.g., state of the art vs. product-specific evidence) - Selected databases
- Inclusion and exclusion criteria
(clear, structured and predefined) - Search terms
(including synonyms, controlled terms and logical connectives)
This preliminary work is not an additional bureaucratic burden – it is a prerequisite for quality.
3. Structure & Reproducibility: From Plan to Report
A literature review is only considered reliable if a third party can understand and, ideally, reproduce identicallyhow the results were obtained.
This is precisely where a crucial weakness becomes apparent in many clinical evaluations:
The research has been carried out – but not documented in a way that would allow it to be verified.
The key to reproducibility lies in a clear structure.
Best practice is to separate the process into three sequential documents, each fulfilling a specific function:
3.1 Literature Search Plan – The strategic foundation
The plan is before the research and defines the methodological framework.
He answers key questions such as:
- What is the goal of the research?
- What questions need to be answered?
- What are the inclusion and exclusion criteria?
- Which databases are used?
- Which search strings are used?
- What time restrictions apply?
3.2 Literature Search Protocol – Documented Implementation
The protocol describes what was actually done.
It contains:
- the specific databases used
- the complete search strings (copy-paste reproducible)
- Search data and time periods
- the number of hits per database
Here, the planned strategy is translated into a comprehensible implementation .
3.3 Literature Search Report – Evaluation and Selection
The report documents how the results were handled.
This includes:
- the screening process (Title/Abstract → Full Text)
- Number of included and excluded studies
- Reasons for exclusions
- Methodology of critical appraisal
- Summary of relevant results
- Identified data gaps
The report makes transparent how data becomes reliable evidence.
This tripartite structure is more than just a formal structure – it creates clarity throughout the entire process:
- Plan = Strategy
- Protocol = Implementation
- Report = Evaluation
When these levels are clearly separated and consistently documented, the result is a literature review that not only appears complete, but is also verifiable, comprehensible, and defensible .
4. State-of-the-art vs. product-specific literature
One of the most frequent – and at the same time conceptually most critical – errors in clinical evaluation is the mixing of State of the Art (SotA) and product-specific literature.
What seems efficient at first glance ("everything in one research") leads in practice to a vague argumentation – and thus to a weakened evaluation logic.
The reason:
Both types of literature pursue different goals and answer fundamentally different questions.
4.1 State of the Art (SotA) – The Reference Framework
The state-of-the-art literature answers the central question:
What is currently considered the medical and technical standard?
It defines the context in which your product is evaluated and provides the basis for:
• available treatment options or diagnostic options
• established technologies
• Typical complication rates
• expected clinical outcomes
• Benchmark values (measurable parameters) for clinical safety and performance
The SotA establishes the objective frame of reference. Without this framework, an evaluation is not possible – because clinical safety, performance, and benefit can only be assessed in comparison to an established standard.
4.2 Product-specific literature – Proof of performance
Product-specific literature answers a different question:
How does the specific product perform within this reference framework? How effective and safe is it, and what benefits does it provide?
It serves to:
· to substantiate clinical claims
· to characterize the security profile
• to classify performance in comparison to the state of the art
This evidence shows whether the product meets the requirements – or ideally exceeds them.
Why separation is crucial
If the two levels are not clearly separated, typical problems arise:
Benchmarks are unclear or implicit
Comparability becomes more difficult
Arguments appear circular ("the product is good because your own study shows it is")
· The benefit-risk assessment is losing objectivity
5. Bias-free study selection: Criteria & screening
A systematic literature review doesn't end with the search itself –
that's where the real critical work begins. The true quality of your evidence base is determined in a step that is often underestimated: the selection of studies.
This is where – consciously or unconsciously – the greatest influence on the outcome of your clinical assessment arises. And this is precisely where the greatest risk of bias also lies.
5.1 Why clear criteria are crucial
The selection of relevant studies must not be based on individual assessment.
It must be based on predefined, structured criteria.
If these are missing or too vague, the following happens:
Decisions are made situationally
· Similar studies are evaluated differently
The selection process becomes inconsistent and difficult to understand
The risk of selective evidence increases
5.2 Best Practice: Structured Inclusion & Exclusion Criteria
Well-defined criteria are not based on "perceived relevance" but on clear parameters such as:
• Compliance with the intended purpose
• Appropriate indication and target population
• Suitable study design
• Sufficient data quality and transparency
• Relevant endpoints
5.3 The screening process: Step by step to an evidence base
A structured study selection process typically takes place in three stages:
1) Title and abstract screening
→ Initial filtering based on basic criteria
2) Full-text evaluation
→ Detailed suitability assessment
3) Final inclusion decision
→ Based on full evaluation and defined criteria
In each of these phases, studies are excluded – and this must be consistently and transparently documented.
5.4 Where bias typically arises
Even with formally defined criteria, weaknesses often creep in during practice:
Decisions are based on interpretation rather than criteria
Inclusion and exclusion rules are not applied consistently
Reasons for exclusion are not documented
Studies with positive results will be given preferential consideration
5.5 Objectivity is not a coincidence – but the result of structure
A reliable selection of studies is characterized by the fact that it:
· rule-based rather than intuitive
· is applied consistently across all studies
· is fully documented and traceable
6. From Evidence to Statement: Claims, Data Gaps & Lifecycle
Literature research provides data. However, the added regulatory value only arises when this data is transformed into reliable statements.
This is precisely where the maturity of a clinical evaluation becomes apparent:
How consistently is evidence linked to the author's own clinical statements – and how transparently are limitations identified?
6.1 Traceability: When claims become traceable
One of the key requirements under the MDR is the complete traceability between clinical statements and the underlying evidence.
A reliable correlation always follows a clear logic:
Clinical claim/endpoint → measurable parameter → study → outcome → CER conclusion
Specifically, this means:
Every claim must be clearly defined
The underlying measurable parameters must be defined
Relevant studies must be clearly identifiable
Results must be presented transparently
6.2 Typical weaknesses in practice
Many clinical reviews reveal a break precisely at this point:
Claims are broadly formulated, but the evidence is narrow or specific
• Study populations are not suitable for the intended purpose
Positive results are highlighted, contradictory data are downplayed
• A clear link between the claim and the study is lacking
6.3 Identifying and actively using data gaps
A thorough literature review does not always lead to complete evidence.
And that's perfectly fine – as long as it's addressed transparently.
Typical situations:
· small case numbers
· non-comparable populations
• contradictory results
• missing data for specific indications or subgroups
The crucial factor is not whether data gaps exist, but how systematically they are dealt with.
6.4 From gap to measure
Identified gaps should have direct consequences:
• Planning of PMCF activities
• Adaptation or clarification of claims
• Assessment of the need for further clinical data (e.g. studies)
Data gaps are therefore not a deficit, but a steering instrument for clinical strategy.
6.5 Lifecycle Management: Evidence is not a static state
Clinical evidence is constantly evolving, and your literature search must follow this principle.
An MDR-compliant assessment therefore takes into account:
1) Periodic updates (risk-based)
Higher risk → more frequent updates
• Class III and implantable products → annually
2) Event-based updates (trigger-based)
• new PMS signals
Security alerts
• relevant PMCF results
• Changes to intended purpose or claims
A literature review that is only updated "before the audit" is reactive – not compliant.
7. Conclusion
An MDR-compliant literature search is far more than a methodological intermediate step in the CER. It is the foundation on which the entire clinical evaluation is built – and therefore crucial for its quality, reproducibility and regulatory acceptance.
This is something that is repeatedly demonstrated in practice:
The problem is not the availability of literature, but how it is used.
A reliable literature review is therefore not characterized by the number of studies found, but by clear principles:
Strategy before execution – the search is planned, not exploratory
• Structured documentation – from plan to minutes to report
• Clear separation of evidence levels – state-of-the-art and product-specific data fulfill different functions
• Objective study selection – based on defined criteria and transparent screening
• Critical evaluation instead of description – data is weighted, not just summarized
• Clean linking with claims – every statement is evidence-based and traceable
• Actively addressing data gaps – as a starting point for PMCF and further development
• Continuous updating – as an integral part of lifecycle management
Ultimately, this very system determines whether your clinical assessment:
· appears defensive or argues convincingly
· is vulnerable or withstands audit
Or to put it another way:
A good literature review does not only answer the question of what is known.
She clearly and comprehensibly shows
why you arrive at your conclusions – and why these are sound.
8. How we can help you
Conducting a literature search in compliance with the MDR (Medical Device Regulation) is complex – and a critical bottleneck in many projects. We support you in setting up this process in a structured, efficient, and audit-proof manner.
Our focus is on:
- Strategy & Planning:
Clear definition of search strategy and criteria - Structure & Documentation:
Creation of plan, protocol and report – reproducible and MDR-compliant - Screening & Evaluation:
Systematic study selection and sound appraisal - Linking to your CER:
Clean traceability of claims for evidence and identification of data gaps - Lifecycle & Updates:
Building sustainable processes for continuous updates
The aim is a literature review that is not only complete, but also methodologically sound and regulatory compliant.
Want to know more? Contact us for a free initial consultation!
You can get a free initial consultation here: free initial consultation



