Statistics for physical scientists short course

Published

All levels 6 lessons Workshop materials Course

Welcome to the� Statistics for Physical Scientists �short course!� It's designed to give researchers, particularly in the physical sciences, some tips, examples and practice in applying common statistical tools.� The course covers: basic summary stat

Overview

Welcome to the�Statistics for Physical Scientists�short course!� It's designed to give researchers, particularly in the physical sciences, some tips, examples and practice in applying common statistical tools.� The course covers:
  • basic summary statistics, probability distributions and data combinations,
  • overview of the Frequentist and Bayesian frameworks,
  • correlation testing and significance, and sample comparisons,
  • hypothesis tests and p-values,
  • model-fitting and hypothesis testing using the chi-squared statistic,
  • regression analysis (including least-squares and Gaussian processes),
  • principal component analysis,
  • practical error estimates (jack-knife, bootstrap and Monte Carlo simulations),
  • propagating errors and Fisher matrix,
  • Bayesian likelihood methods (including MCMC) and model selection
Please note that this short course is intended to provide a broad overview of some practical statistics tools, appropriate for around 20-30 hours' study.� �In your research, you will likely be applying the statistical methods of your field in much more detail than is possible to cover here.�

Course lessons

Lesson 1

Lesson 1

Statistics Short Course 1: Probability and statistics

In this section we will cover:

� The process of science

� Common uses of statistics

� Summary statistics and their errors

� Estimators and bias

� Optimal combination of data

� Probability distributions: Binomial, Poisson, Gaussian

� The Poisson error

� Special role of the Gaussian distribution, central limit theorem

� Confidence regions and tails

� Comparing the Frequentist and Bayesian frameworks

� Monte Carlo simulations

  VIDEO WOULD GO HERE!   Here is the accompanying python�Jupyter notebook for Class 1�(this is for python3) -- python2 version�here�ADD Jupyter notebooks to be spun up through GitHub

lesson 2

Lesson 2

Statistics Short Course 2: Correlation testing

In this section we will cover:

Correlation versus independence

� Pitfalls when searching for correlations

� Correlation coefficient

� Pearson product-moment correlation

� Significance of correlation

� Hypothesis tests and -values

� Student -distribution, tailed tests

� Non-parametric correlation tests; Spearman rank correlation

� Bayesian correlation methods

� Are the means of two samples consistent?

� Kolmogorov-Smirnov test

  Video and Class 2 Notebook here!!

Lesson 3

Lesson 3

Statistics Short Course 3: Model Fitting

In this section, we will cover:

� Comparing data and models

� The 2�statistic

� 2�probability distribution, degrees of freedom

� Reduced 2

� Use of 2�statistic as hypothesis test

� Modification for correlated data

� Use of 2�statistic for parameter fitting

� Errors in parameters from ?2; joint confidence regions

  PLACEHOLDER FOR VIDEO AND NOTEBOOK

Lesson 4

Lesson 4

Statistics Short Course 4: Regression

In this section, we will cover:

� Introduction to regression

� Least-squares linear regression

� Quantifying the regression fit

� The case of errors in both co-ordinates

� Principal component analysis, eigenvalues and eigenvectors

� Interpolation

� Gaussian processes (kriging)

PLACEHOLDER FOR VIDEO AND NOTEBOOK

Lesson 5

Lesson 5

Statistics Short Course 5: Error estimates

In this section, we will cover:

� What is an error?

� Statistical versus systematic errors

� Error estimation using approximate sampling procedures

� Jack-knife errors

� Bootstrap errors

� Combining and propagating errors, linear and non-linear cases

� Fisher matrix forecasts

� Monte Carlo simulations

PLACEHOLDER FOR VIDEO AND NOTEBOOK

Lesson 6

Lesson 6

Statistics Short Course 6: Bayesian likelihood methods

In this section we will cover:

� Bayesian Methods: conditional probability, Bayes� Theorem

� Role of the prior and likelihood

� Posteriors and confidence limits

� Marginalization

� Use of likelihood for parameter fitting

� Monte Carlo Markov Chains

� Model selection; is adding another parameter justified?

� Bayes factor and Jeffreys scale

� Akaike information criteria

VIDEO WOULD GO HERE!