General information
Latest issue
Impact factor

Search papers
Search references

Latest issue
Current issues
Archive issues
What is RSS

Model. Anal. Inform. Sist.:

Personal entry:
Save password
Forgotten password?

Model. Anal. Inform. Sist., 2016, Volume 23, Number 6, Pages 777–783 (Mi mais540)  

Generation of a social network graph by using Apache Spark

Yu. A. Belov, S. I. Vovchok

P.G. Demidov Yaroslavl State University, 4 Sovetskaya ul., Yaroslavl 150003, Russia

Abstract: We plan to create a method of clustering a social network graph. For testing the method there is a need to generate a graph similar in structure to existing social networks. The article presents an algorithm for the graph distributed generation. We took into account basic properties such as power-law distribution of the users communities number, dense intersections of the social networks and others. This algorithm also considers the problems that are present in similar works of other authors, for example, the multiple edges problem in the generation process. A special feature of the created algorithm is the implementation depending on the communities number parameter rather than on the connected users number as it is done in other works. It is connected with a peculiarity of progressing the existing social network structure. There are properties of its graph in the paper. We described a table containing the variables needed for the algorithm. A step-by-step generation algorithm was compiled. Appropriate mathematical parameters were calculated for it. A generation is performed in a distributed way by Apache Spark framework. It was described in detail how the tasks division with the help of this framework runs. The Erdos–Renyi model for random graphs is used in the algorithm. It is the most suitable and easy one to implement. The main advantages of the created method are the small amount of resources in comparison with other similar generators and execution speed. Speed is achieved through distributed work and the fact that in any time network users have their own unique numbers and are ordered by these numbers, so there is no need to sort them out. The designed algorithm will promote not only the efficient clustering method creation. It can be useful in other development areas connected, for example, with the social networks search engines.

Keywords: social network, generation.


Full text: PDF file (535 kB)
References: PDF file   HTML file

Bibliographic databases:

UDC: 004.9
Received: 24.10.2016

Citation: Yu. A. Belov, S. I. Vovchok, “Generation of a social network graph by using Apache Spark”, Model. Anal. Inform. Sist., 23:6 (2016), 777–783

Citation in format AMSBIB
\by Yu.~A.~Belov, S.~I.~Vovchok
\paper Generation of a social network graph by using Apache Spark
\jour Model. Anal. Inform. Sist.
\yr 2016
\vol 23
\issue 6
\pages 777--783

Linking options:

    SHARE: FaceBook Twitter Livejournal

    Citing articles on Google Scholar: Russian citations, English citations
    Related articles on Google Scholar: Russian articles, English articles
  • Моделирование и анализ информационных систем
    Number of views:
    This page:146
    Full text:57

    Contact us:
     Terms of Use  Registration  Logotypes © Steklov Mathematical Institute RAS, 2020