journal article·2020-12-08Open access

A Framework for Identifying Influential People by Analyzing Social Media Data

Md. Sabbir Al Ahsan, Mohammad Shamsul Arefin, A. S. M. Kayes, Mohammad Hammoudeh, Omar Aldabbas

Applied Sciences· Volume 10· Issue 24

Abstract

In this paper, we introduce a new framework for identifying the most influential people from social sensor networks. Selecting influential people from social networks is a complicated task as it depends on many metrics like the network of friends, followers, reactions, comments, shares, etc. (e.g., friends-of-a-friend, friends-of-a-friend-of-a-friend). Data on social media are increasing day-by-day at an enormous rate. It is also a challenge to store and process these data. Towards this goal, we use Hadoop to store data and Apache Spark for the fast computation of the data. To select influential people, we apply the mechanisms of skyline query and top-k query. To the best of our knowledge, this is the first work to apply the Apache Spark framework to identify influential people on social sensor network, such as online social media. Our proposed mechanism can find influential people very quickly and efficiently on the data pattern of Facebook.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Complex Network Analysis Techniques · Advanced Text Analysis Techniques · Spam and Phishing Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chittagong 4349, Bangladesh

Department of Computer Science and Information Technology, La Trobe University, Melbourne, Victoria 3086, Australia

Department of Computing and Mathematics, Manchester Metropolitan University, Manchester M15 6BH, UK

Faculty of Engineering Technology, Al-Balqa’ Applied University, Amman 15008, Jordan

References (36)

Show source-provided references
1. Controlling astroturfing on the internet: A survey on detection techniques and research challenges10.1504/IJWGS.2019.099561 ↗
2. Lu, L., Dong, H., Yang, C., and Wan, L. (2012, January 27–29). A novel mass data processing framework based on Hadoop for electrical power monitoring system. Proceedings of the 2012 Asia-Pacific Power and Energy Engineering Conference, Shanghai, China.10.1109/APPEEC.2012.6307647 ↗
3. IoT streaming data integration from multiple sources10.1007/s00607-020-00830-9 ↗
4. (2020, October 01). Apache Hadoop. Available online: https://Hadoop.Apache.org/.
5. Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3–7). The Hadoop distributed file system. Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST2010), Incline Village, NV, USA.10.1109/MSST.2010.5496972 ↗
6. Dean, J., and Ghemawat, S. (2004, January 6–8). MapReduce: Simplified data processing on large clusters. Proceedings of the OSDI 2004—6th Symposium on Operating Systems Design and Implementation, San Francisco, CA, USA.
7. Tu, D.Q., Kayes, A., Rahayu, W., and Nguyen, K. (2019, January 27–29). ISDI: A new window-based framework for integrating IoT streaming data from multiple sources. Proceedings of the International Conference on Advanced Information Networking and Applications, Matsue, Japan.10.1007/978-3-030-15032-7_42 ↗
8. Integration of IoT Streaming Data With Efficient Indexing and Storage Optimization10.1109/ACCESS.2020.2980006 ↗
9. Cybersecurity data science: An overview from machine learning perspective10.1186/s40537-020-00318-5 ↗
10. (2020, October 01). Apache Spark™—What is Spark. Available online: https://databricks.com/Spark/about.
11. (2020, October 01). Apache Spark™—Unified Analytics Engine for Big Data. Available online: https://Spark.Apache.org/.
12. Finding Key Persons on Social Media by Using MapReduce Skyline
13. Qiu, J., Tang, J., Ma, H., Dong, Y., Wang, K., and Tang, J. (2018, January 19–23). DeepInf: Social influence prediction with deep learning. Proceedings of the Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, London, UK.10.1145/3219819.3220077 ↗
14. Whom to ask? Jury selection for decision making tasks on micro-blog services10.14778/2350229.2350264 ↗
15. A vector space model for ranking entities and its application to expert search
16. Lappas, T., Liu, K., and Terzi, E. (July, January 28). Finding a team of experts in social networks. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Paris, France.
17. Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., and Stoica, I. (2010, January 22). Spark: Cluster computing with working sets. Proceedings of the 2nd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2010), Boston, MA, USA.
18. Comparing Apache Spark and Map Reduce with Performance Analysis using K-Means
19. MLlib: Machine learning in Apache Spark
20. Gupta, A., Thakur, H.K., Shrivastava, R., Kumar, P., and Nag, S. (2017, January 18–21). A Big Data Analysis Framework Using Apache Spark and Deep Learning. Proceedings of the IEEE International Conference on Data Mining Workshops (ICDMW), New Orleans, LA, USA.10.1109/ICDMW.2017.9 ↗
21. Streaming twitter data analysis using Spark for effective job search
22. On the Average Number of Maxima in a Set of Vectors and Applications10.1145/322092.322095 ↗
23. On Finding the Maxima of a Set of Vectors10.1145/321906.321910 ↗
24. Borzsonyil, S., Kossmann, D., and Stocker, K. (2001, January 2–6). The Skyline Operator. Proceedings of the 17th International Conference on Data Engineering, Heidelberg, Germany.
25. Street, K., York, N., and Canada, O.M.J. (2002). Skyline with Presorting Jan Chomicki, Parke Godfrey, Jarek Gryz and Dongming Liang, Department of Computer Science, York University.
26. Tan, K.L., Eng, P.K., and Ooi, B.C. (2001, January 11–14). Efficient progressive skyline computation. Proceedings of the VLDB 2001—Proceedings of 27th International Conference on Very Large Data Bases, Roma, Italy.
27. Chan, C.Y., Jagadish, H.V., Tan, K.L., Tung, A.K., and Zhang, Z. (2006, January 27–29). Finding k-dominant skylines in high dimensional space. Proceedings of the ACM SIGMOD International Conference on Management of Data, Chicago, IL, USA.10.1145/1142473.1142530 ↗
28. Efficient distributed skylining for web information systems
29. Marian, A., Bruno, N., and Gravano, L. (2004). Evaluating top-k queries over web-accessible databases. ACM Trans. Database Syst.10.1145/1005566.1005569 ↗
30. Chang, K.C.C., and Hwang, S.W. (2002, January 3–6). Minimal probing: Supporting expensive predicates for top-K queries. Proceedings of the ACM SIGMOD International Conference on Management of Data, Madison, WI, USA.10.1145/564691.564731 ↗
31. Li, C., Chang, K.C.C., Ilyas, I.F., and Song, S. (2005, January 14–16). RankSQL: Query algebra and optimization for relational top-k queries. Proceedings of the ACM SIGMOD International Conference on Management of Data, Baltimore, MA, USA.10.1145/1066157.1066173 ↗
32. Evaluating Top-k Selection Queries
33. Probabilistic Optimization of Top N Queries
34. (2020, October 01). PySpark. Available online: https://Spark.Apache.org/docs/2.1.0/api/python/PySpark.html.
35. Opinion mining and sentiment analysis10.1561/1500000011 ↗
36. (2020, October 01). Cron Job. Available online: https://en.wikipedia.org/wiki/Cron.