Lec: Global SA
13 important questions on Lec: Global SA
Why do we have uncertainty in the input of a model?
- Scaling problems
- Measurement problems
- Model structure errors
What are the 3 main characteristics of LSA?
- Local method: results depend on base-run
- Results depend on assumed scale of variation (st dev) of parameters
- Computationally cheap, only one extra run per parameter
What is a risk with LSA?
Worst case: when you think there is no slope (your model is not sensitive to your parameter at all) when actually this is not true
- Higher grades + faster learning
- Never study anything twice
- 100% sure, 100% understanding
For my 1st exam I got a C. Then, I started looking for ways to learn better and I came across Study Smart. Since then I have scored a A+, A, A- and another A. I highly recommend it to everyone who wants to hear it. I am so happy with it!!
I was struggling to finish all my first-year subjects for 3 years. Then I discovered Study Smart, which helped me to finish all of them within 3 months.
Because of StudySmart, things are going well in many ways. Before, I always had study stress and no time for anything. Now I feel calm and confident (because of the program). I used to score a B, now I usually score an A or A+.
Hey Chris, I really want to thank you very much for developing the platform, I usually got around C for my exams, now I scored an A+, an A and a A- !!
Since using Study Smart, my average has increased significantly. I even completed a statistics course with a A+ while I'm bad at statistics. I took on extra courses this year, because of Study Smart. Thanks so much!
Ever since I started studying with StudySmart I passed all my exams !!! No more re-sits!! At first, I was happy with a pass and now I only get good grades. Many thanks!
I aced all the courses I studied with Study Smart. For law, I first scored a D, and now an A! I’m 100% sure that I’ll pass all the courses I study with Study Smart.
I always thought I studied well. My grades were fine. I could never have imagined that applying these study skills would have such a huge and direct impact on my grades, my speed and the pleasure I have in learning.
For the first time, I finally feel totally confident about the way I learn. I have the perfect overview and make great progress in terms of speed and the grades I get. Thanks, Chris!
I immediately started to enjoy learning again, and my grades soared. All of a sudden, everything went better. I highly recommend Study Smart to all students..
Being able to create my materials online made the process of studying so much smoother and quicker. I no longer have to spend a huge amount of my time on creating my summaries.
At first, my notes were a mess. Now I use Study Smart to take my notes in a perfectly structured way. It helps me to save a lot of time and do other things I enjoy.
Students that study with Study Smart get better grades. The system applies all the learning methods in such a way that both well-performing students and students who struggle perform much better.
Hi Chris, I would like to thank you very much. Last year I scored C on a course, and this year I got an A+ thanks to your method! Thank you very much!
The largest effect is that my child is more enthusiastic about school! Every parent wants their children to be happy at school, Study Smart made it happen.
In high school, I failed several exams, and that has really changed now. I actually needed this tool very much back then. Since I started studying with StudySmart, I haven't had any D's. My average score is now an A and those are results I would have never had in the past
With my old method, I passed only 3 out of 8 courses. Since I started taking my notes digitally in Study Smart, I have passed all my courses on the first try. For me, StudySmart takes away the stress of wondering if I will pass or not.
Thanks to StudySmart, I passed all my exams, and with better grades than before! On top of that, I have mastered a very good study method now, which I am confident will help me earn my degree.
Other behaviour in models that give issues for LSA?
In case of snow parameter, it only shows sensitivity based on the temperature, meaning sensitivity can change based on situation > blocky structures.
GSA: SOBOL' methods
What is the definition of the explained variance in GSA?
Note: total variance - conditional expectation = basically the residuals
How does GSA work in steps?
- Sample parameter based on chosen distribution
- Run model many many times
- Determine conditional expectation for each parameter
- Calculate residuals
- Check which part of the model variance we can explain for this particular parameter
- Compare to total model variance to determine which parameter explains most of the variance, bc this is the parameter our model is most sensitive to
- Determine the portion of model variance explained by interaction of parameters
When would you do local and when global SA?
- Start with GSA: sample full range of parameters
- Look at which parameters influence your model most
- Calibrate these parameters
- After calibration, you do LSA; find best guess parameters
- Look in near vicinity of best guess parameters, to see what the uncertianty in your projections is
Model runtime: problem with GSA
But GSA can be done on a small range of a parameter; or we can sample full parameter space and determine which influence model results most and select these for calibration
What are the main take aways for variation analysis through sampling/GSA/SOBOL' (all same thing)?
- Global method
- Parameter space is sampled
- For identification of calibration parameters: take wide par space
- For sensitivity only: take smaller space
- Also works for highly non-linear functions
- Results depend on assumed distribution of parameters
- Computationally expensive; many model runs required
How will we sample our parameters?
What is Monte Carlo sampling?
- Pick distribution
- Randomly sample within distribution - Sample more in regions with high probability
- Run model
Issue: if your MC sample is not big enough and does not capture your distribution well, it will lead to different results each time
Thus MC is least efficient sampling strategy
2D Monte Carlo sampling vs 2D Quantile sampling
Q: we do capture full distribution of parameter; but it is not efficient for many parameters!
10 samples per par
6 pars in our model
run time: 1 sec
10^6 sec = 11 days
Give a summary of when to choose which sampling technique and give arguments why!
MC: too much insecurity due to random sampling, while we want to capture distribution correctly
Quantile: more efficient and more stable in representing distribution
2D or higher:
MC: even more expensive
Random quantile sampling: also gets too expensive
>> Latin Hypercube sampling! Kind of a mix between MC and quantile, which saves a lot of computational power. But we do have to assume the parameters are independent/do not interact
The question on the page originate from the summary of the following study material:
- A unique study and practice tool
- Never study anything twice again
- Get the grades you hope for
- 100% sure, 100% understanding
