ECS 188 Study Guide - Midterm Guide: Cheat Sheet, Variable Elimination, Conditional Independence

• School: UC-Davis
• Department: Engineering: Computer Science
• Course: ECS 188
• Professor: all

Document Summary

Midterm ii: you have 2 hours, the exam is closed book, closed notes except a one-page crib sheet, please use non-programmable calculators only, mark your answers on the exam itself. If you are not sure of your answer you may wish to provide a brief explanation. All short answer sections can be successfully answered in a few sentences at most. First and last name of student to your left. First and last name of student to your right. Q1. pts] markov decision processes (a) [?? pts] write out the equations to be used to compute q i from r, t, v i 1, and to compute v i from r, t, q i , . V i (s) = (b) [?? pts] consider the mdp with transition model and reward function as given in the table below. Assume the discount factor = 1, i. e. , no discounting. 2 in the graph below. s" t(s,a,s") r(s,a,s") s" t(s,a,s") r(s,a,s") a s.