Wiki source code of Introduction to Probability, fall 2013
Last modified by kohonen@helsinki_fi on 2024/03/27 10:40
Show last authors
author | version | line-number | content |
---|---|---|---|
1 | = Introduction to Probability with MATLAB, spring 2014 = | ||
2 | |||
3 | === Lecturer === | ||
4 | |||
5 | [[Jukka Kohonen>>doc:mathstatHenkilokunta.Kohonen, Jukka]] | ||
6 | |||
7 | |||
8 | === Scope === | ||
9 | |||
10 | 5 cr | ||
11 | |||
12 | === Type === | ||
13 | |||
14 | This course is aimed for international students with a background in Computer Science or an application discipline, such as Bioinformatics Master´s program (MBI). No background in statistics or probabilistics is required. | ||
15 | |||
16 | The course can be included in advanced studies in the MBI program. | ||
17 | |||
18 | === Contents === | ||
19 | |||
20 | The course starts from the elements of probability calculus, and will cover topics and concepts such as: | ||
21 | |||
22 | * probability, joint probability, and conditional probability | ||
23 | * random variable | ||
24 | * some elementary distributions such as binomial, uniform, exponential, and normal | ||
25 | * probability density function (pdf), cumulative distribution function (cdf) | ||
26 | * expected value, variance, and other useful statistics of a distribution | ||
27 | |||
28 | **MATLAB** is used as an educational tool in exercises, to obtain a **practical understanding** of random variables and probability distributions. (This is **not**, however, a course **about** MATLAB programming. The course will cover MATLAB only to such extent as is needed to use it for studying probability. Also, no previous familiarity with MATLAB is needed.) | ||
29 | |||
30 | === Prerequisites === | ||
31 | |||
32 | Elementary calculus | ||
33 | |||
34 | === Lectures and exercises === | ||
35 | |||
36 | The course lasts 6 weeks, starting 21.1.2014 and ending 26.2.2014. | ||
37 | |||
38 | Weekly schedule: | ||
39 | |||
40 | * Tue 12-14: lecture in room C128 | ||
41 | * Tue 14-16: exercises in room C128 | ||
42 | * Wed 12-14: lecture in room CK111 | ||
43 | * Wed 14-16: exercises in room C128 | ||
44 | |||
45 | The exercise sessions are instructed by Brittany Rose. | ||
46 | |||
47 | There are no deadlines for the exercises since no credits are given for them. Doing the exercises is for learning the topics. However, you **may** return your answers (on paper or in e-mail) if you wish to have comments on them. | ||
48 | |||
49 | === Exercise problems === | ||
50 | |||
51 | * [[Exercise set 1>>attach:ex1.pdf]] | ||
52 | * [[Exercise set 2>>attach:ex2.pdf]] | ||
53 | * [[Exercise set 3>>attach:ex3.pdf]] | ||
54 | * [[Exercise set 4>>attach:ex4.pdf]] | ||
55 | * [[Exercise set 5>>attach:ex5.pdf]] | ||
56 | * [[Exercise set 6>>attach:ex6.pdf]] | ||
57 | * [[Exercise set 7>>attach:ex7.pdf]] | ||
58 | * [[Exercise set 8>>attach:ex8.pdf]] | ||
59 | * [[Exercise set 9>>attach:ex9.pdf]] | ||
60 | * [[Exercise set 10>>attach:ex10.pdf]] | ||
61 | * [[Exercise set 11>>attach:ex11.pdf]] | ||
62 | * Auxiliary MATLAB functions can be found [[here>>url:http://www.helsinki.fi/~~kohonen/introprob/||shape="rect"]]. | ||
63 | * A Very Quick Guide to MATLAB is [[here>>attach:matlabhelp.pdf]]. | ||
64 | |||
65 | === Lecture topics === | ||
66 | |||
67 | * [[Lecture 1>>attach:lecture1.pdf]] (21.1.) | ||
68 | * [[Lecture 2>>attach:lecture2.pdf]] (22.1.) (More combinatorics: binomial coefficient, sampling); non-equiprobable finite probability space | ||
69 | * Lecture 3 (28.1.): Product rule; conditional probability; Bernoulli trial (= repeated independent experiments with same probability of success each time) | ||
70 | * Lecture 4 (29.1.): More about conditional probability; law of total probability; Bayes's rule (inverting the conditional probability) | ||
71 | * Lecture 5 (4.2.): Random variable; discrete distribution; binomial and geometric distribution; expected value and median | ||
72 | * Lecture 6 (5.2.): Discrete distributions and expected value continued | ||
73 | * Lecture 7 (11.2.): Continuous distributions; uniform distribution; density function; empirical histogram | ||
74 | * Lecture 8 (12.2.): Continuous distributions continued. Pdf, cdf, expected value. Expected gain from a bet, linked to subjective probability. | ||
75 | * Lecture 9 (18.2.): Exponential distribution. Distribution of a sum. [[Multinomial coefficient and multinomial distribution.>>attach:lecture9.pdf]] | ||
76 | * Lecture 10 (19.2.): Expected value of a function g(X). Variance and standard deviation. | ||
77 | * [[Lecture 11>>attach:lecture11.pdf]] (DRAFT) (25.2.): Markov's and Chebyshev's inequalities, and law of large numbers (G&S: Chapter 8). | ||
78 | * [[Lecture 12>>attach:lecture12.pdf]] (26.2.): Normal distribution and the central limit theorem. Distribution of a maximum (of any distribution). | ||
79 | |||
80 | Lecture slides are provided here if they exist. For blackboard lectures there may not be slides. | ||
81 | |||
82 | === Extra reading === | ||
83 | |||
84 | * There is a nice textbook by Grinstead and Snell available at | ||
85 | [[http:~~/~~/www.math.dartmouth.edu/~~~~prob/prob/prob.pdf | ||
86 | >>url:http://www.math.dartmouth.edu/~~prob/prob/prob.pdf||shape="rect"]]This intro course will not cover everything in the book, but it provides good reading for deeper understanding. | ||
87 | * Important topics include the following:\\ | ||
88 | ** Chapter 1: Idea of random variable. Section 1.2: definitions and theorems. | ||
89 | ** Chapter 2: Continuous randon variable. Density function and cumulative distribution function. | ||
90 | ** Chapter 3: "A Counting Technique" = rule of product. Permutations, factorials, combinations, binomial coefficient. Bernoulli trial and binomial distribution. (Card shuffling is out of scope.) | ||
91 | ** Chapter 4: Conditional probabilitiy. Definitions and theorems. Bayes' formula. (Joint density, beta density are out of scope.) | ||
92 | ** Chapter 5: Discrete uniform, binomial, geometric, hypergeometric distribution; continuous uniform, exponential, normal distribution. (Other distributions are out of scope.) | ||
93 | ** Chapter 6: Definition, interpretation and theorems of expected value and variance. | ||
94 | ** (Chapter 7 is out of scope.) | ||
95 | ** Chapter 8: Chebysev, and law of large numbers. | ||
96 | ** Chapter 9: Central limit theorem (what it means and how it is used). Proof of CLT is out of scope. | ||
97 | ** (Chapters 10—12 are out of scope.) | ||
98 | * "Out of scope" means it did not fit this one-period introductory course (and will not be required in the exam), but for further studies in probability, many of these chapters contain much useful reading. | ||
99 | |||
100 | === Exams === | ||
101 | |||
102 | The course is passed by taking a single **course exam**, which is held at the [[general examination>>url:https://wiki.helsinki.fi/display/mathstat/General+exams||shape="rect"]], **Tuesday 4.3.2014 starting at 12**. | ||
103 | |||
104 | General examinations are arranged at** Exactum A111 and B123. **The detailed information about the place can be found on the exam day from the **note on the door** of the auditorium. | ||
105 | |||
106 | Note: Although the general examination (where many different exams can be taken) lasts four hours, **this course exam lasts 2 hours** (you have to return your answers in two hours). | ||
107 | |||
108 | You can bring the following tools to the exam: a calculator; an A4 sheet of handwritten notes (you can use both sides of the paper); the [[MAOL book of tables>>url:http://www.suomalainen.com/oppikirjat/oppikirjat/maol-taulukot-sku-p9511206079||shape="rect"]]. At the exam we will provide you [[this printed collection of tables>>attach:taulukkoliite.pdf]]. | ||
109 | |||
110 | **Update 13.3.2014: The exam has been graded. **The results will be registered to Weboodi soon, and** will appear [[here>>url:https://wiki.helsinki.fi/pages/viewpage.action?pageId=129010105||shape="rect"]]**. For any questions about the grading, contact the lecturer. | ||
111 | |||
112 | |||
113 | |||
114 | === [[Registration>>url:https://oodi-www.it.helsinki.fi/hy/opintjakstied.jsp?html=1&Tunniste=57781||shape="rect"]] === | ||
115 | |||
116 | |||
117 | Did you forget to register? [[ What to do?>>doc:mathstatOpiskelu.Kysymys4]] | ||
118 | |||
119 | === === | ||
120 | |||
121 |