RUS  ENG JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PERSONAL OFFICE
General information
Latest issue
Archive
Impact factor

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS



Zh. Vychisl. Mat. Mat. Fiz.:
Year:
Volume:
Issue:
Page:
Find






Personal entry:
Login:
Password:
Save password
Enter
Forgotten password?
Register


Zh. Vychisl. Mat. Mat. Fiz., 2010, Volume 50, Number 6, Pages 979–998 (Mi zvmmf4884)  

The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors

V. A. Kazeev, E. E. Tyrtyshnikov

Institute of Numerical Mathematics, Russian Academy of Sciences, ul. Gubkina 8, Moskow, 119333 Russia

Abstract: A tensor given by its canonical decomposition is approximated by another tensor (again, in the canonical decomposition) of fixed lower rank. For this problem, the structure of the Hessian matrix of the objective function is analyzed. It is shown that all the auxiliary matrices needed for constructing the quadratic model can be calculated so that the computational effort is a quadratic function of the tensor dimensionality (rather than a cubic function as in earlier publications). An economical version of the trust region Newton method is proposed in which the structure of the Hessian matrix is efficiently used for multiplying this matrix by vectors and for scaling the trust region. At each step, the subproblem of minimizing the quadratic model in the trust region is solved using the preconditioned conjugate gradient method, which is terminated if a negative curvature direction is detected for the Hessian matrix.

Key words: tensor decompositions, canonical decomposition, low-rank approximations, trust region Newton method, conjugate gradient method.

Full text: PDF file (388 kB)
References: PDF file   HTML file

English version:
Computational Mathematics and Mathematical Physics, 2010, 50:6, 927–945

Bibliographic databases:

Document Type: Article
UDC: 519.61
Received: 17.12.2009

Citation: V. A. Kazeev, E. E. Tyrtyshnikov, “The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors”, Zh. Vychisl. Mat. Mat. Fiz., 50:6 (2010), 979–998; Comput. Math. Math. Phys., 50:6 (2010), 927–945

Citation in format AMSBIB
\Bibitem{KazTyr10}
\by V.~A.~Kazeev, E.~E.~Tyrtyshnikov
\paper The structure of the Hessian and the efficient implementation of Newton's method in the problem of the canonical approximation of tensors
\jour Zh. Vychisl. Mat. Mat. Fiz.
\yr 2010
\vol 50
\issue 6
\pages 979--998
\mathnet{http://mi.mathnet.ru/zvmmf4884}
\mathscinet{http://www.ams.org/mathscinet-getitem?mr=2744667}
\adsnasa{http://adsabs.harvard.edu/cgi-bin/bib_query?2010CMMPh..50..927K}
\transl
\jour Comput. Math. Math. Phys.
\yr 2010
\vol 50
\issue 6
\pages 927--945
\crossref{https://doi.org/10.1134/S0965542510060011}
\isi{http://gateway.isiknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&DestLinkType=FullRecord&DestApp=ALL_WOS&KeyUT=000279192900001}
\scopus{http://www.scopus.com/record/display.url?origin=inward&eid=2-s2.0-77954072168}


Linking options:
  • http://mi.mathnet.ru/eng/zvmmf4884
  • http://mi.mathnet.ru/eng/zvmmf/v50/i6/p979

    SHARE: VKontakte.ru FaceBook Twitter Mail.ru Livejournal Memori.ru


    Citing articles on Google Scholar: Russian citations, English citations
    Related articles on Google Scholar: Russian articles, English articles
  • Журнал вычислительной математики и математической физики Computational Mathematics and Mathematical Physics
    Number of views:
    This page:312
    Full text:84
    References:36
    First page:14

     
    Contact us:
     Terms of Use  Registration  Logotypes © Steklov Mathematical Institute RAS, 2018