VPRE's Process

What is machine learning and deep learning?

Machine learning is when computers learn from experience and data without human involvement.

In other words, machine learning algorithms are able to improve automatically through experience.
Machine learning can sense evolution as well. For example, text auto-generation will change based on the owner’s language style.

Deep learning is a subset of machine learning.

Deep learning uses artificial neural networks - algorithms inspired by the workings of the human brain - to learn from large amounts of data.

We use deep learning in our daily lives. Functions like sentence autocomplete in Gmail, Google Translate, self-driving cars, image recognition, and many others all incorporate deep learning.

In essence, the training process is for fine-tuning equations in our deep learning model to fit the data in the training set.

The machine learning model is given a set of “practice questions” which is called a “training dataset”. For each item in the training dataset, the model goes through a set of mathematical equations and then produces an output. It then compares the output with the “correct answer” and reflects on the mathematical equations that it went through, and tries to adjust and see if the adjustment improves the correctness of the output. Therefore, the performance of the model is highly dependent on the quality of the training set, just like how we need good practice exams to test our knowledge.

After training, we need to validate the model by feeding it an input that it hasn’t seen before, and see if it can produce a correct output. Pretty much like a “final exam” for the model.

What is a Markov Model?

A common statistical model that uses past data to extract probabilities of events occurring and uses them to calculate the likelihood of future events occurring.

For VPRE, the events we want to model are mutations in the spike protein. Using the same training data we used for deep learning, we count all the different kinds of mutations that have occurred in the past at each position of the genetic sequence. For example, we might have fifty A to C mutations in the training data at position 500 in the spike protein. We use these counts to calculate the probability of each type of mutation occurring at each position in the spike protein.

How does VPRE work?

What is machine learning and deep learning?

Machine learning is when computers learn from experience and data without human involvement.

Deep learning is a subset of machine learning.

Okay, how about Variational AutoEncoders (VAEs)?

VAEs are deep learning models capable of generating meaningful latent spaces for image and text data.

We can train neural networks to learn from their mistakes.

What is training?

In essence, the training process is for fine-tuning equations in our deep learning model to fit the data in the training set.

After training, we need to validate the model by feeding it an input that it hasn’t seen before, and see if it can produce a correct output. Pretty much like a “final exam” for the model.

Implementing evolution into deep learning

How do we train VPRE?

Our training data consists of thousands of existing spike protein gene sequences.

Complementing deep learning with statistics

How can we be confident in our predictions?

We are implementing a statistical model to corroborate the results of our deep learning simulations.

What is a Markov Model?

A common statistical model that uses past data to extract probabilities of events occurring and uses them to calculate the likelihood of future events occurring.

How does a Markov Model generate predictions?

Using the probabilities of mutation from past data, the model calculates the most likely mutations to occur.