Challenges and Obstacles Facing Data in the Big Data Environment
DOI:
https://doi.org/10.26713/cma.v13i1.1974Keywords:
Big data “BD”, Challenges, Solutions, Issues, Threats, Information Technology “IT”, Data SecurityAbstract
Big data is dubbed “today’s digital oil” and the “new raw resource of the twenty-first century”. BD is synonymous with the future of innovation, competition, and productivity. It can produce and find corporate value by analyzing data in ways that older methodologies could not. Regardless of its benefits, the development of big data continues to encounter various barriers, the most important of which are security and privacy concerns. As a result, this study is motivated by the need to address and evaluate big data challenges. Thus, by comparing and contrasting big data difficulties with available and potential solutions, users, developers, and businesses can find pertinent and timely responses to specific dangers, resulting in the best possible big data-based services. The objective of this essay is to highlight the inherent challenges of big data and some essential strategies for overcoming them.The purpose of this article was to extract and analyze significant works in order to contribute to the corpus of literature by emphasizing many critical difficulties in the big data domain and throwing light on how these challenges affect a range of domains, including users, sites, and business. Many issues such as data privacy, information sharing, failures in big data technologies and infrastructure, poor data quality management, managers and policymakers’ inability to learn and adapt, the absence of government policies and plans, the lack of successfully implemented big data analytics projects, and the lack of human experience are among the most frequently mentioned issues. Obstacles also exist in the areas of real-time data collection, as well as real-time data processing and visualization, among others.By combining previously identified solutions, this research addressed these concerns. The consequences for both researchers and practitioners have been discussed. Aiming to help scholars gain a comprehensive understanding of these issues and confirm the approaches used to address them, this study’s theoretical focus is broad. This study uses tried-and-true solutions to overcome these obstacles. Business and individuals using big data analytics systems will benefit from these solutions.
Downloads
References
M. Arora and D.H. Bahuguna, Big data security – the big challenge, International Journal of Science & Engineering Research 7(12) (2016), 399 – 402.
R. Bao, Z. Chen and M.S. Obaidat, Challenges and techniques in big data security and privacy: a review, Security and Privacy 1(4) (2018), p. e13, DOI: 10.1002/spy2.13.
R.K. Behera, A.K. Sahoo and C. Pradhan, Big data analytics in real time - technical challenges and its solutions, in 2017 International Conference on Information Technology (ICIT), (2017), pp. 30 – 35, DOI: 10.1109/ICIT.2017.39.
F.-Z. Benjelloun and A.A. Lahcen, Big data security: Challenges, recommendations and solutions, in: Handbook of Research on Security Considerations in Cloud Computing, K. Munir, M.S. Al-Mutairi and L.A. Mohammed (eds.), IGI Global, Hershey, PA (2015), pp. 301 – 313, DOI: 10.4018/978-1-4666-8387-7.CH014.
S. Boubiche, D.E. Boubiche, A. Bilami and H. Toral-Cruz, Big data challenges and data aggregation strategies in wireless sensor networks, IEEE Access 6 (2018), 20558 – 20571, DOI: 10.1109/ACCESS.2018.2821445.
M. Elhoseny, G. Ramírez-González, O.M. Abu-Elnasr, S.A. Shawkat, N. Arunkumar and A. Farouk, Secure medical data transmission model for IOT-based healthcare systems, IEEE Access 6 (2018), 20596 – 20608, DOI: 10.1109/ACCESS.2018.2817615.
C.A. Escobar, M.E. McGovern and R. Morales-Menendez, Quality 4.0: A review of big data challenges in manufacturing, Journal of Intelligent Manufacturing 32(8) (2021), 2319 – 2334, DOI: 10.1007/s10845-021-01765-4.
M. Hammer, K. Somers, H. Karre and C. Ramsauer, Profit per hour as a target process control parameter for manufacturing systems enabled by big data analytics and Industry 4.0 infrastructure, Procedia CIRP 63 (2017), 715 – 720, DOI: 10.1016/j.procir.2017.03.094.
M.K. Hassan, A.I. El Desouky, S.M. Elghamrawy and A.M. Sarhan, Big data challenges and opportunities in healthcare informatics and smart hospitals BT, in Security in Smart Cities: Models, Applications, and Challenges, Lecture Notes in Intelligent Transportation and Infrastructure, A.E. Hassanien, M. Elhoseny, S.H. Ahmed and A.K. Singh (eds.), Springer, Cambridge, (2018), pp. 3 – 26, DOI: 10.1007/978-3-030-01560-2_1.
M.I. Khan, S. Khan, U. Khan and A. Haleem, Modeling the big data challenges in context of smart cities – an integrated fuzzy ISM-DEMATEL approach, International Journal of Building Pathology and Adaptation, (2021), DOI: 10.1108/IJBPA-02-2021-0027.
C. Li, Y. Chen and Y. Shang, A review of industrial big data for decision making in intelligent manufacturing, Engineering Science and Technology, An International Journal 29 (2022), 101021, DOI: 10.1016/j.jestch.2021.06.001.
R. Lu, H. Zhu, X. Liu, J.K. Liu and J. Shao, Toward efficient and privacy-preserving computing in big data era, IEEE Network 28(4) (2014), 46 – 50, DOI: 10.1109/MNET.2014.6863131.
T.A. Mohammed, A. Ghareeb, H. Al-bayaty and S. Aljawarneh, Big data challenges and achievements: applications on smart cities and energy sector, in DATA’19: Proceedings of the Second International Conference on Data Science, E-Learning and Information Systems, (2019), pp. 1 – 5, DOI: 10.1145/3368691.3368717.
E. Nazari, Z. Ebnehoseini, Z. Agharezaei and H. Tabesh, Knowledge, attitude, challenges of big data analytics based on IT staffs point of view in a developing country, Frontiers in Health Informatics 9(1) (2020), Article Id 36, DOI: 10.30699/fhi.v9i1.225.
B. Nelson and T. Olovsson, Security and privacy for big data: A systematic literature review, in 2016 IEEE International Conference on Big Data (Big Data), (2016), 3693 – 3702, DOI: 10.1109/BigData.2016.7841037.
P.K. Sadineni, Mining in big data: Challenges, solutions, in: Proceedings of the 2nd International Conference on IoT, Social, Mobile, Analytics & Cloud in Computational Vision & Bio-Engineering (ISMAC-CVB 2020), 9 pages, (2020), DOI: 10.2139/ssrn.3734166.
A. Sharma, G. Singh and S. Rehman, A review of big data challenges and preserving privacy in big data BT, in: Advances in Data and Information Sciences, M. Kolhe, S. Tiwari, M. Trivedi and K. Mishra (eds.), Lecture Notes in Networks and Systems book series (LNNS, Vol. 94), (2020), 57 – 65, DOI: 10.1007/978-981-15-0694-9_7.
U. Sivarajah, M.M. Kamal, Z. Irani and V. Weerakkody, Critical analysis of Big Data challenges and analytical methods, Journal of Business Research 70 (2017), 263 – 286, DOI: 10.1016/j.jbusres.2016.08.001.
H. Sultana, R.B. Zaman and M. Zahan, Big data challenges for resource-constrained organizations in a developing economy, Journal of Information Technology Case and Application Research 22(2) (2020), 111 – 130, DOI: 10.1080/15228053.2020.1807173.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a CCAL that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
