The cost of acquiring information by natural selection

Carl_Bergstrom 262 views 43 slides Jun 14, 2024
Slide 1
Slide 1 of 73
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61
Slide 62
62
Slide 63
63
Slide 64
64
Slide 65
65
Slide 66
66
Slide 67
67
Slide 68
68
Slide 69
69
Slide 70
70
Slide 71
71
Slide 72
72
Slide 73
73

About This Presentation

This is a short talk that I gave at the Banff International Research Station workshop on Modeling and Theory in Population Biology. The idea is to try to understand how the burden of natural selection relates to the amount of information that selection puts into the genome.

It's based on the f...


Slide Content

The cost of acquiring information by natural selection Carl T. Bergstrom Department of Biology University of Washington with R. McGee, O. Kosterlitz , A.Kaznatcheev , and B. Kerr Photo: Carl Bergstrom

Ben Kerr Olivia Kosterlitz Artem Kaznatcheev Ryan McGee

The information behind phenotype Photos: Carl Bergstrom

Where does this information come from? Photo: Carl Bergstrom

natural selection Photo: Carl Bergstrom

Photo: Carl Bergstrom In particular, organisms need to match their phenotypes to their environments, their niches, their life-histories, etc.

“The environment is light, so grow light fur.” — Mom Given that a light fur allele was inherited, it is likely that light fur has been favored in the past, and thus it is likely beneficial to develop light fur.

. Every bit of adaptive information in your genome was paid for in the blood of your ancestors’ children. Photo: Carl Bergstrom

But can we quantify it? I think so. Adaptive genetic information refers to the inherited material that reduces an organism's uncertainty about the current environment so that its expected fitness is greater than it would be due to chance alone. Photo: Carl Bergstrom

Imagine the state of the environment as a random variable E and the genome G as another random variable.   Natural selection creates mutual Information between E and G . Photo: Carl Bergstrom

We can measure how much information has been added looking at how much genotype frequencies have changed due to selection.   Photo: Carl Bergstrom

As the frequency of the best genotype increases in the population, the population gains information about the environment.

Nearly 70 years ago…. Nearly 70 years ago….

Nearly 70 years ago….

Selective deaths

Selective deaths

Substitution load growth rate of optimal type     growth rate of type i

“It is appropriate to speak of a cost of selection, since the cost comes from the fact that natural selection is less efficient than divine intervention.” - Joe Felsenstein Substitution load

Information gain

Information gain Substitution load

Information gain Substitution load

Substitution load Information gain

Substitution load Information gain

Beyond a thought-experiment

               

               

               

               

               

               

               

    population growth rate population growth rate optimal type growth rate optimal type growth rate optimal growth rate population growth rate

    population growth rate population growth rate optimal type growth rate optimal type growth rate optimal growth rate population growth rate

WTF?

Aha!

time growth rate of optimal type     growth rate of type i Substitution Load growth rate of optimal type in condition j     growth rate of type i in condition j probability of condition j Mismatch Load

Regret Loss and regret Photo: Carl Bergstrom

In computational learning theory, loss is the payoff cost of mismatch between strategy and environment, and regret is the cost of having to learn the best strategy: the difference between the cumulative loss as the learner updates its strategy over time, and the loss it could have achieved had it played an optimal fixed strategy from the beginning.

By thinking about regret, we can broadly extend our results about substitution load. Photo: Carl Bergstrom

Load of the evolving population Load of the best type Information gain of evolving population

environment genotype “idiosyncratically” stochastic environments

environment genotype Cycling environments

environment genotype Frequency-dependent fitnesses Rock- Paper- Scissors

Load of the evolving population Load of the best type Information gain of evolving population

Theorem : Information gain converges to regret, in fixed or stochastic environments, with or without frequency-dependence, etc.

Theorem : Information gain is bounded above by empirical regret, a measure of regret taken relative to the ex-post optimal strategy.

Teaser : Among learning algorithms, natural selection is never ”far” from optimal in the sense of minimizing regret.