Systematic reviews and meta analysis: steps to follow
13 important questions on Systematic reviews and meta analysis: steps to follow
Aim/ research question of systematic reviews
- Should always depart from a clinical relevant and well defined research question
- Relevant from clinical perspective and well defined
Inclusion criteria (PICO)
I: interventions
C: controls
O: Outcomes
But also think about these important aspects:
- Timing of outcome measures (short or long term)
- Design of study (RCT/CCT)
- Time (e.g. New type of surgery introduced)
- Language
--> after defining inclusion criteria, you go look for literature that meet these criteria
To what extend should you also look for grey literature resources?
- Depends on research question whether or not it is important to include
- Higher grades + faster learning
- Never study anything twice
- 100% sure, 100% understanding
For my 1st exam I got a C. Then, I started looking for ways to learn better and I came across Study Smart. Since then I have scored a A+, A, A- and another A. I highly recommend it to everyone who wants to hear it. I am so happy with it!!
I was struggling to finish all my first-year subjects for 3 years. Then I discovered Study Smart, which helped me to finish all of them within 3 months.
Because of StudySmart, things are going well in many ways. Before, I always had study stress and no time for anything. Now I feel calm and confident (because of the program). I used to score a B, now I usually score an A or A+.
Hey Chris, I really want to thank you very much for developing the platform, I usually got around C for my exams, now I scored an A+, an A and a A- !!
Since using Study Smart, my average has increased significantly. I even completed a statistics course with a A+ while I'm bad at statistics. I took on extra courses this year, because of Study Smart. Thanks so much!
Ever since I started studying with StudySmart I passed all my exams !!! No more re-sits!! At first, I was happy with a pass and now I only get good grades. Many thanks!
I aced all the courses I studied with Study Smart. For law, I first scored a D, and now an A! I’m 100% sure that I’ll pass all the courses I study with Study Smart.
I always thought I studied well. My grades were fine. I could never have imagined that applying these study skills would have such a huge and direct impact on my grades, my speed and the pleasure I have in learning.
For the first time, I finally feel totally confident about the way I learn. I have the perfect overview and make great progress in terms of speed and the grades I get. Thanks, Chris!
I immediately started to enjoy learning again, and my grades soared. All of a sudden, everything went better. I highly recommend Study Smart to all students..
Being able to create my materials online made the process of studying so much smoother and quicker. I no longer have to spend a huge amount of my time on creating my summaries.
At first, my notes were a mess. Now I use Study Smart to take my notes in a perfectly structured way. It helps me to save a lot of time and do other things I enjoy.
Students that study with Study Smart get better grades. The system applies all the learning methods in such a way that both well-performing students and students who struggle perform much better.
Hi Chris, I would like to thank you very much. Last year I scored C on a course, and this year I got an A+ thanks to your method! Thank you very much!
The largest effect is that my child is more enthusiastic about school! Every parent wants their children to be happy at school, Study Smart made it happen.
In high school, I failed several exams, and that has really changed now. I actually needed this tool very much back then. Since I started studying with StudySmart, I haven't had any D's. My average score is now an A and those are results I would have never had in the past
With my old method, I passed only 3 out of 8 courses. Since I started taking my notes digitally in Study Smart, I have passed all my courses on the first try. For me, StudySmart takes away the stress of wondering if I will pass or not.
Thanks to StudySmart, I passed all my exams, and with better grades than before! On top of that, I have mastered a very good study method now, which I am confident will help me earn my degree.
How is the selection of studies done?
- Consensus meeting (with two independent reviewers and a third reviewer)
- First selection in hits in database
- Title, keywords, abstract
- Second selection based on full text papers
- Inclusion criteria
- When two reviewers disagree the third reviewer is consulted
What is the definition of Risk of Bias (RoB)
A systematic error, or deviation from the truth, in results or inferences potentially leading o underestimation or overestimation of the true intervention effect
What are some other important issues for the quality of a study?
- External validity
- Precision
- Statistical issues
- Others... (depending on topic)
Same as in RCT's, cause you usually include RCT's in sytematic reviews (unless there is a good reason not to do so)
- Selection, performance and attribution & detection bias
How do you assess risk of bias (RoB)
- Two independent reviewers
- Blind article for authors and journals
- Which items?
- Consensus meeting (third reviewer) Pilot
- Additional information from authors
Data extraction by two independent reviewers
- Study population (age, sex, setting)
- Disorder (type, duration, stage)
- Intervention (type, dose, frequency)
- Control group (no intervention, placebo, other intervention)
- Results (outcome measures, timing)
What is important when you do the analyses
- Define comparisons
- Clinical homogeneity
- Population and subgroups need to be the same
- Interventions, control groups need to be the same
- Outcome measures, instruments need to be the same
- Does it make sense to pool results?
- Are the results clinically relevant?
What is a meta analyses
- Statistically combined results of all studies
Prerequisite
- Clinical and methodological homogeneity
- Statistical homogeneity
- Sufficient data should be reported
Risk of bias and analyses how to combine
- Uses RoB as an inclusion criterion for review
- Descriptive
- Sensitivity analyses (preferred by most)
- High RoB vs low RoB
- Bias due to individual items
- Grade (or levels of evidence)
What are the levels of evidence methodology
- Strong evidence - when there are more high quality RCTs
- Moderate evidence - several low quality RCTS and/ or 1 high quality RCT
- Limited evidence - 1 RCT only (high or low)
- Conflicting evidence
Define 'more' 'severa', 'high quality', 'conflicting'
Three other types of biases that can be in systematic reviews
- Preliminary results (multiple papers -> 50 patients in 1st paper, 100 patients in 2nd paper -> 50 patients double counted)
- Salami tactic (1 paper on psychical outc. 1 paper on psychosocial. Or 1 paper on 1 year results, 1 paper on 3 years)
- Advanced salami (other authors in different papers on same study)
- Trials published in low or non-impact factor journals were more likely to report significant results than those published in high-impact mainstream medical journals
- Could be introduced in reviews exclusively based on English-language reports
The question on the page originate from the summary of the following study material:
- A unique study and practice tool
- Never study anything twice again
- Get the grades you hope for
- 100% sure, 100% understanding
