Chapter 7 Numerical Optimization

In this chapter, we will discuss a few numerical methods for optimization problems without constraints. Except the first method, all methods employ the derivative information of the function to be optimized. We will also see that the first three methods are all related to algorithms introduced in earlier chapters.