RL for Large State Spaces: Value Function Approximation

Sep 12, 2014

270 likes | 385 Views

RL for Large State Spaces: Value Function Approximation. Alan Fern. * Based in part on slides by Daniel Weld. Large State Spaces. When a problem has a large state space we can not longer represent the V or Q functions as explicit tables Even if we had enough memory

Share Presentation

Embed Code

Link

features
linear approximation
state features
function approximation
linear approximation function
learn good parameter values

esme

Download Presentation

RL for Large State Spaces: Value Function Approximation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

Introduction to PCP

Introduction to PCP. Introduction. In this lecture we’ll cover: Definition of PCP Prove some classical hardness of approximation results Review some recent ones. Review: Decision, Optimization Problems. A decision problem is a Boolean function ƒ(X) , or alternatively

1.13k views • 33 slides

Elementary Linear Algebra Anton & Rorres, 9 th Edition

Elementary Linear Algebra Anton & Rorres, 9 th Edition. Lecture Set – 06 Chapter 6: Inner Product Spaces. Chapter Content. Inner Products Angle and Orthogonality in Inner Product Spaces Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition Best Approximation; Least Squares

3.03k views • 54 slides

Function

Function. Function. Introduction Library function New defined function Random number generator Scope Inline function Function overload. Introduction. Why do we need function? Reuse and simplify a large program. Chapter 7 and Chapter 8 (p309-p436). Library function.

1.38k views • 96 slides

Chapter 4 General Vector Spaces

Linear Algebra. Chapter 4 General Vector Spaces. 大葉大學資訊工程系黃鈴玲. 4.1 General Vector Spaces and Subspaces.

2.84k views • 99 slides

Identifying Function-Based Interventions

Identifying Function-Based Interventions. Chris Borgmeier PhD cborgmei@pdx.edu Sheldon Loman, PhD sheldon.loman@pdx.ed Portland State University. Activity 6: Function Based Interventions. Complete Pre-Test. Behavior Support Planning FBA  BSP.

1.64k views • 114 slides

Materia Medica

Materia Medica. Heat/Excitation Tissue State. Excitation/Irritation Tissue State. Characterized by Exaggeration of Function Tissues are in a state of excitation, irritation or over stimulation. Blood rushes to the area with classic symptoms of heat, redness, swelling and pain.

1.16k views • 80 slides

Lectures on the Geometry and Topology of Configuration Spaces

Lectures on the Geometry and Topology of Configuration Spaces. Sadok Kallel American University of Sharjah (UAE). Introduction. If you type ``configuration spaces" on the archives, you get nearly 300 references. You get many more on Google .

1.18k views • 97 slides

Fundamental of Programming (C)

Fundamental of Programming (C). Lecture 7 Modular programming. Outline. Introduction to pointer Introduction to function User define function Function prototype (declaration) Function definition Function call and return Formal and Actual Parameters Scope of Identifiers Storage classes

1.03k views • 77 slides

STAR: Steiner-Tree Approximation in Relationship Graphs

STAR: Steiner-Tree Approximation in Relationship Graphs. Max-Planck Institute for Informatics, Database and Information Systems, Gjergji Kasneci , Maya Ramanath , Mauro Sozio , Fabian M. Suchanek , Gerhard Weikum. Introduction. Entity-Relationship Graphs

1.47k views • 127 slides

The Christian And War

The Christian And War. A Study That Attempts To Answer The Question: May A Christian Scripturally Function As A Punitive Agent Of The State?. May A Christian Scripturally Function As A Punitive Agent Of The State?.

2.21k views • 200 slides

Identifying Function-Based Interventions

Identifying Function-Based Interventions. Chris Borgmeier, PhD cborgmei@pdx.edu Sheldon Loman, PhD sheldon.loman@pdx.edu Portland State University. Objectives. Use a Competing Behavior Pathway to Identify Function-based behavior supports that:

1.18k views • 82 slides

Feedforward Neural Networks. Classification and Approximation

Feedforward Neural Networks. Classification and Approximation. Classification and Approximation Problems BackPropagation (BP) Neural Networks Radial Basis Function (RBF) Networks Support Vector Machines. Classification problems. Example 1 : identifying the type of an iris flower.

1.22k views • 87 slides

Hirschsprung’s Disease: GI Implications & Nutritional Management

Hirschsprung’s Disease: GI Implications & Nutritional Management. Presented by: Laura Kashtan. Outline. Anatomy of the Large Intestine How Does the Gut Normally Function? Hirschsprung’s Disease Medical Nutrition Therapy Patient Presentation Summary. Large Intestines.

1.16k views • 62 slides

Introduction to Radial Basis Function Networks

Introduction to Radial Basis Function Networks. Content. Overview The Models of Function Approximator The Radial Basis Function Networks RBFN’s for Function Approximation The Projection Matrix Learning the Kernels Bias-Variance Dilemma The Effective Number of Parameters Model Selection

1.78k views • 139 slides

RBF

NEURAL NETWORK Radial Basis Function. RBF. Radial Basis Functions. The RBF networks, just like MLP networks, can therefore be used classification and/or function approximation problems.

1.05k views • 64 slides

An Approximation Algorithm for the Asymmetric Maximum TSP

An Approximation Algorithm for the Asymmetric Maximum TSP. From: January 2004 Journal of Algorithms Author: Markus Bl ä ser* Speaker: H. Z. Hsu Advisor: R. C. T. Lee. In the following, we will first introduce some terms in graph theorem in order to define the

1.56k views • 139 slides

Chapter 4 Vector Spaces

Chapter 4 Vector Spaces. 4.1 Vectors in R n 4.2 Vector Spaces 4.3 Subspaces of Vector Spaces 4.4 Spanning Sets and Linear Independence 4.5 Basis and Dimension 4.6 Rank of a Matrix and Systems of Linear Equations 4.7 Coordinates and Change of Basis. Elementary Linear Algebra

5.18k views • 107 slides

Chapter 4 Vector Spaces

1.74k views • 107 slides

Approximation and visualization of Pareto frontier: Interactive Decision Maps technique

Approximation and visualization of Pareto frontier: Interactive Decision Maps technique. Alexander V. Lotov Dorodnicyn Computing Centre of Russian Academy of Sciences , and Lomonosov Moscow State University, Russia Part 1. Plan of the talk.

1.94k views • 172 slides

More Related

RL for Large State Spaces: Value Function Approximation

RL for Large State Spaces: Value Function Approximation

Presentation Transcript

Introduction to PCP

Elementary Linear Algebra Anton &amp; Rorres, 9 th Edition

Function

Chapter 4 General Vector Spaces

Identifying Function-Based Interventions

Materia Medica

Lectures on the Geometry and Topology of Configuration Spaces

Fundamental of Programming (C)

STAR: Steiner-Tree Approximation in Relationship Graphs

The Christian And War

Identifying Function-Based Interventions

Feedforward Neural Networks. Classification and Approximation

Hirschsprung’s Disease: GI Implications &amp; Nutritional Management

Introduction to Radial Basis Function Networks

RBF

An Approximation Algorithm for the Asymmetric Maximum TSP

Chapter 4 Vector Spaces

Chapter 4 Vector Spaces

Approximation and visualization of Pareto frontier: Interactive Decision Maps technique

Elementary Linear Algebra Anton & Rorres, 9 th Edition

Hirschsprung’s Disease: GI Implications & Nutritional Management