RUS  ENG JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB
 General information Latest issue Archive Impact factor Search papers Search references RSS Latest issue Current issues Archive issues What is RSS

 Model. Anal. Inform. Sist.: Year: Volume: Issue: Page: Find

 Model. Anal. Inform. Sist., 2016, Volume 23, Number 6, Pages 777–783 (Mi mais540)

Generation of a social network graph by using Apache Spark

Yu. A. Belov, S. I. Vovchok

P.G. Demidov Yaroslavl State University, 4 Sovetskaya ul., Yaroslavl 150003, Russia

Abstract: We plan to create a method of clustering a social network graph. For testing the method there is a need to generate a graph similar in structure to existing social networks. The article presents an algorithm for the graph distributed generation. We took into account basic properties such as power-law distribution of the users communities number, dense intersections of the social networks and others. This algorithm also considers the problems that are present in similar works of other authors, for example, the multiple edges problem in the generation process. A special feature of the created algorithm is the implementation depending on the communities number parameter rather than on the connected users number as it is done in other works. It is connected with a peculiarity of progressing the existing social network structure. There are properties of its graph in the paper. We described a table containing the variables needed for the algorithm. A step-by-step generation algorithm was compiled. Appropriate mathematical parameters were calculated for it. A generation is performed in a distributed way by Apache Spark framework. It was described in detail how the tasks division with the help of this framework runs. The Erdos–Renyi model for random graphs is used in the algorithm. It is the most suitable and easy one to implement. The main advantages of the created method are the small amount of resources in comparison with other similar generators and execution speed. Speed is achieved through distributed work and the fact that in any time network users have their own unique numbers and are ordered by these numbers, so there is no need to sort them out. The designed algorithm will promote not only the efficient clustering method creation. It can be useful in other development areas connected, for example, with the social networks search engines.

Keywords: social network, generation.

DOI: https://doi.org/10.18255/1818-1015-2016-6-777-783

Full text: PDF file (535 kB)
References: PDF file   HTML file

Bibliographic databases:

UDC: 004.9

Citation: Yu. A. Belov, S. I. Vovchok, “Generation of a social network graph by using Apache Spark”, Model. Anal. Inform. Sist., 23:6 (2016), 777–783

Citation in format AMSBIB
\Bibitem{BelVov16} \by Yu.~A.~Belov, S.~I.~Vovchok \paper Generation of a social network graph by using Apache Spark \jour Model. Anal. Inform. Sist. \yr 2016 \vol 23 \issue 6 \pages 777--783 \mathnet{http://mi.mathnet.ru/mais540} \crossref{https://doi.org/10.18255/1818-1015-2016-6-777-783} \mathscinet{http://www.ams.org/mathscinet-getitem?mr=3596161} \elib{http://elibrary.ru/item.asp?id=27517423}