Numerical methods and programming
RUS  ENG    JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB  
General information
Latest issue
Archive

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS



Num. Meth. Prog.:
Year:
Volume:
Issue:
Page:
Find






Personal entry:
Login:
Password:
Save password
Enter
Forgotten password?
Register


Num. Meth. Prog., 2012, Volume 13, Issue 3, Pages 126–131 (Mi vmp78)  

Программирование

HOPLANG: advancement of the monitoring data stream processing language

A. V. Adinetz, P. A. Bryzgalov, Vad. V. Voevodin, S. A. Zhumatii, D. A. Nikitenko, K. S. Stefanov

M.V. Lomonosov Moscow State University, Research Computing Center

Abstract: The efficiency analysis of supercomputer applications is a very actual problem. The main aim of HOPSA project is the efficiency analysis using monitoring data. Because supercomputer applications are large, the amount of monitoring data is also very large. One of the most widespread tool for large data amounts is the pair formed Hadoop and PIG. Hadoop is a very famous toolkit for the distributed data processing and PIG is a language for creating requests to Hadoop. However, it was found that this pair is not suitable for HOPSA project aims. Any request is processed for a very long time because of long compiling, the data streams are not supported, very few databases are supported, and there is no support for database indices. Thus, a special language for huge monitoring data streams is required. We develop such a language named HopLang. Just now, HopLang can process real monitoring data. This paper describes the last half-year language advance and some future plans.

Keywords: parallel processing; monitoring; supercomputing.

Full text: PDF file (122 kB)
UDC: 004.021
Received: 29.09.2012

Citation: A. V. Adinetz, P. A. Bryzgalov, Vad. V. Voevodin, S. A. Zhumatii, D. A. Nikitenko, K. S. Stefanov, “HOPLANG: advancement of the monitoring data stream processing language”, Num. Meth. Prog., 13:3 (2012), 126–131

Citation in format AMSBIB
\Bibitem{AdiBryVoe12}
\by A.~V.~Adinetz, P. A. Bryzgalov, Vad.~V.~Voevodin, S. A. Zhumatii, D. A. Nikitenko, K. S. Stefanov
\paper HOPLANG: advancement of the monitoring data stream processing language
\jour Num. Meth. Prog.
\yr 2012
\vol 13
\issue 3
\pages 126--131
\mathnet{http://mi.mathnet.ru/vmp78}


Linking options:
  • http://mi.mathnet.ru/eng/vmp78
  • http://mi.mathnet.ru/eng/vmp/v13/i3/p126

    SHARE: VKontakte.ru FaceBook Twitter Mail.ru Livejournal Memori.ru


    Citing articles on Google Scholar: Russian citations, English citations
    Related articles on Google Scholar: Russian articles, English articles
  • Numerical methods and programming
    Number of views:
    This page:65
    Full text:64

     
    Contact us:
     Terms of Use  Registration to the website  Logotypes © Steklov Mathematical Institute RAS, 2022