Chapter 8

2. Chapter 8 State Feedback and State Estimators Homework 8 Refer to the last example. (a) Calculate the transfer function G(s) of the system. (b) Calculate the steady-state value of the system to a step input, using the Final Value Theorem of Laplace Transform. (c) Determine the gain K so that the steady-state response of KG(s) has zero error to a step input. (d) Find out the relation between the transfer function gain Kand the reference gain E.

3. Chapter 8 State Feedback and State Estimators Solution of Homework 8 (a) Calculate the transfer function of the system in s-Domain.

4. Chapter 8 State Feedback and State Estimators Solution of Homework 8 (b) Calculate the steady-state value of the step response of the system, using the Final Value Theorem of Laplace Transform.

5. Chapter 8 State Feedback and State Estimators Solution of Homework 8 (c) Determine the gain K so that the steady-state response of KG(s) has zero error to a step input. (d) Find out the relation between the transfer function gain K and the reference gain E.

6. Chapter 10 Optimal Control Optimal Control • Optimal control deals with the problem of finding a control law for a given system, such that a certain optimality on a criterion is achieved. • The resulting control law is optimal solution of a cost function or performance index, which is a function of state variables and control variables. • An optimal control is described in a set of differential equations, describing how the control variables may minimize the cost function.

7. Chapter 10 Optimal Control Optimal Control • An example: Consider a car traveling on a straight line through a hilly road. • The question: How should the driver press the gas pedal in order to minimize the total traveling time? • As the system we may regard both the car and the contour of the road. • The term “control law” in this example refers specifically to the way in which the driver presses the gas pedal and shifts the manual gears as the input to the system. • The optimality criterion, which described the output of interest, is the minimization of the total traveling time. • Besides, the control problems usually include additional constraints. For example, the amount of available fuel might be limited, the gas pedal cannot be pushed through the floor of the car, speed limits, etc.

8. Chapter 10 Optimal Control Optimal Control • A proper cost function (or performance index) will give a mathematical expression of the traveling time as a function of speed (again a function of gas pedal position and gear position), road contour, additional constraints, and initial conditions of the system. • Another optimal control problem is to find the way to drive the car so as to minimize its fuel consumption, given that it must complete a given course not slower than a certain time limit. • Even another control problem is to minimize the total financial cost of completing the trip, given assumed price for time and fuel.

9. Chapter 10 Optimal Control Performance Indexes • A performance index is a mean to measure the control performance in the completion of a control objective. • Suppose the control objective is to bring a system modeled by: in such a way and in a fixed time interval [to,tf], so that the components of the state vector are “small”. • A suitable performance index to be minimized would be:

10. Chapter 10 Optimal Control Performance Indexes • If the control objective is to manipulate the system so that the components of output y(t) are to be small, then: where Q = CTC is a symmetric positive semidefinite matrix. A matrix is a positive semidefinite matrix if all the real parts of its eigenvalues are more or equal to zero, OR, if for all nonzero vector z with real entries, then zTQz≥ 0.

11. Chapter 10 Optimal Control Performance Indexes • In order to control the inputs u(t) so that they are not too large, we use the following performance index: where R is a symmetric positive semidefinite weight matrix. • Not all performance indexes can be minimized at the same time. A compromise can be taken by minimizing a convex combination of the indexes, e.g.:

12. Chapter 10 Optimal Control Performance Indexes • The weighting constants can also be accommodated in the weight matrices Q and R as follows: with

13. Chapter 10 Optimal Control Some Performance Indexes for Optimal Control Problems 1. Minimum-time problems 2. Terminal control problems : final state : reference final state 3. Minimum control effort problems 4. Tracking problems

14. Chapter 10 Optimal Control Optimal Control: Minimizing State Vector • Consider the n-dimensional single-variable state space equations: • The desired state vector is represented xd(t) = 0. • We will select a feedback controller, so that u(t) is some function of the measured state variables x(t), and therefore • Substituting into the first equation, we obtain

15. Chapter 10 Optimal Control Optimal Control: Minimizing State Vector • The performance index to be minimized is the one expressed in terms of the state vector • In minimizing J1, we let the final time of interest be tf = ∞. • To obtain the minimum value of J1, we postulate a decreasing magnitude of the state vector, or equivalently, its negative first derivation. • We assume the existence of an exact differential so that where P is yet to be determined. • P is chosen to be symmetric to simplify the algebra without any loss of generality.

16. Chapter 10 Optimal Control Optimal Control: Minimizing State Vector • Then, for a symmetric P, pij= pji, the differentiation on the left-hand side of the last equation can be completed as • But thus then as wished. • If

17. Chapter 10 Optimal Control Optimal Control: Minimizing State Vector • Further • Therefore, to minimize the performance index J1, the following two equations must be considered

18. Chapter 10 Optimal Control Example: Optimal State Feedback Consider the open-loop control system shown in the figure below. The state variables are x1 and x2. The step response of the system is quite unsatisfactory due to undamped poles at the origin. We will choose a feedback control in the form of Therefore, inserting u(t) into the state equation,

19. Chapter 10 Optimal Control Example: Optimal State Feedback To minimize the performance index J1, we write again the equation Letting k1 equals an arbitrary stable value, say k1 = 2, then

20. Chapter 10 Optimal Control Example: Optimal State Feedback The integral of the performance index is rewritten as We will consider the case where the initial states are given as xT(0) = [1 2], so that Substituting the values of P we already have,

21. Chapter 10 Optimal Control Example: Optimal State Feedback To minimize J1 as a function of k2, we take the derivative w.r.tk2 and set it equal to zero Thus, the system matrix for the compensated system is Checking the characteristic equation of the compensated system, • Both poles are now with negative real value • The system is optimal for the given values of k1 and x(0)

22. Chapter 10 Optimal Control Homework 9 Consider again the control system as given before, described by Assuming the linear control law Determine the constants k1 and k2 so that the following performance index is minimized Consider only the case where the initial condition is x(0)=[c 0]T and the undamped natural frequency (ωn) is chosen to be 2 rad/s. • Recall again the standard form of a second order transfer function (FCS) • Calculate the transfer function of the system if compensated with k • Determine the value of corresponding k (k1 or k2?) to obtain ωn as requested

23. Chapter 10 Optimal Control Homework 9A Consider the system described by the equations Determine the optimal control which minimizes the following performance index. (Hint: You may assume the value of the feedback gain, where available.)