Radial effect in stochastic diagonal approximate greatest descent
MetadataShow full item record
© 2017 IEEE. Stochastic Diagonal Approximate Greatest Descent (SDAGD) is proposed to manage the optimization in two stages, (a) apply a radial boundary to estimate step length when the weights are far from solution, (b) apply Newton method when the weights are within the solution level set. This is inspired by a multi-stage decision control system where different strategies is used at different conditions. In numerical optimization context, larger steps should be taken at the beginning of optimization and gradually reduced when it is near to the minimum point. Nevertheless, the intuition of determining the radial boundary when the optimized parameters are far from the solution is yet to be investigated for high dimensional data. Radial step length in SDAGD manipulates the relative step length for iteration construction. SDAGD is implemented in a two layer Multilayer Perceptron to evaluate the effects of R on artificial neural networks. It is concluded that the greater the value of R, the higher the learning rate of SDAGD algorithm when the value of R is constrained in between 100 to 10,000.
Showing items related by title, author, creator and subject.
A strategy of global convergence for the affine scaling algorithm for convex semidefinite programmingQian, X.; Liao, L.; Sun, Jie (2018)© 2018, Springer-Verlag GmbH Germany, part of Springer Nature and Mathematical Optimization Society. The affine scaling algorithm is one of the earliest interior point methods developed for linear programming. This algorithm ...
Analyzing organic richness of source rocks from well log data by using SVM and ANN classifiers: A case study from the Kazhdumi formation, the Persian Gulf basin, offshore IranBolandi, V.; Kadkhodaie, Ali; Farzi, R. (2017)Determination of TOC is critical to the evaluation of every source rock unit. Methods which are dependent upon extensive laboratory testing are limited by the availability and integrity of the rock samples. Prediction of ...
Akindeju, Michael Kehinde (2013)Considering the level of current interests in the continuous synthesis of Titania, the Chemical and Manufacturing Industry is expected to benefit from the results of this work which proposed and implemented a tailor-made ...