Radial effect in stochastic diagonal approximate greatest descent
Access Status
Date
2017Type
Metadata
Show full item recordAbstract
© 2017 IEEE. Stochastic Diagonal Approximate Greatest Descent (SDAGD) is proposed to manage the optimization in two stages, (a) apply a radial boundary to estimate step length when the weights are far from solution, (b) apply Newton method when the weights are within the solution level set. This is inspired by a multistage decision control system where different strategies is used at different conditions. In numerical optimization context, larger steps should be taken at the beginning of optimization and gradually reduced when it is near to the minimum point. Nevertheless, the intuition of determining the radial boundary when the optimized parameters are far from the solution is yet to be investigated for high dimensional data. Radial step length in SDAGD manipulates the relative step length for iteration construction. SDAGD is implemented in a two layer Multilayer Perceptron to evaluate the effects of R on artificial neural networks. It is concluded that the greater the value of R, the higher the learning rate of SDAGD algorithm when the value of R is constrained in between 100 to 10,000.
Citation
Source Title
ISBN
School
Collection
Related items
Showing items related by title, author, creator and subject.

Qian, X.; Liao, L.; Sun, Jie (2018)© 2018, SpringerVerlag GmbH Germany, part of Springer Nature and Mathematical Optimization Society. The affine scaling algorithm is one of the earliest interior point methods developed for linear programming. This algorithm ...

Kadkhodaie, Ali; Bolandi, V.; Farzi, R. (2017)Determination of TOC is critical to the evaluation of every source rock unit. Methods which are dependent upon extensive laboratory testing are limited by the availability and integrity of the rock samples. Prediction of ...

Bolandi, V.; Kadkhodaie, Ali; Farzi, R. (2017)Determination of TOC is critical to the evaluation of every source rock unit. Methods which are dependent upon extensive laboratory testing are limited by the availability and integrity of the rock samples. Prediction of ...