optimization - How to show that the method of steepest descent does not converge in a finite number of steps? - Mathematics Stack Exchange

I have a function, $$f(\mathbf{x})=x_1^2+4x_2^2-4x_1-8x_2,$$ which can also be expressed as $$f(\mathbf{x})=(x_1-2)^2+4(x_2-1)^2-8.$$ I've deduced the minimizer $\mathbf{x^*}$ as $(2,1)$ with $f^*

Mathematics, Free Full-Text

A neural network-based PDE solving algorithm with high precision

CoolMomentum: a method for stochastic optimization by Langevin dynamics with simulated annealing

convergence divergence - Interpretation of Noise in Function Optimization - Mathematics Stack Exchange

A reinforcement learning approach to airfoil shape optimization

Quasi-Newton methods for topology optimization using a level-set method

Mini-batch optimization enables training of ODE models on large-scale datasets

Restricted-Variance Constrained, Reaction Path, and Transition State Molecular Optimizations Using Gradient-Enhanced Kriging

Steepest Descent Direction - an overview

Solved 1. Implement the steepest descent and fixed-step size

python - Steepest Descent Trace Behavior - Stack Overflow

Stochastic gradient line Bayesian optimization for efficient noise-robust optimization of parameterized quantum circuits

nonlinear optimization - Do we need steepest descent methods, when minimizing quadratic functions? - Mathematics Stack Exchange

A structural optimization algorithm with stochastic forces and stresses

Intuition (and maths!) behind multivariate gradient descent, by Misa Ogura