دانلود رایگان مقاله لاتین سیستم کلان داده از سایت الزویر
عنوان فارسی مقاله:
سیر تکاملی سیستم های کلان داده: از دیدگاه کاربردهای امنیت اطلاعات
عنوان انگلیسی مقاله:
The Evolvement of Big Data Systems: From the Perspective of an Information Security Application
سال انتشار : 2015
برای دانلود رایگان مقاله سیستم کلان داده اینجا کلیک نمایید.
مقدمه انگلیسی مقاله:
1. Introduction
In a recent announcement from Google,1 MapReduce [11] is abandoned as it is unable to handle the amounts of data Google wants to analyze these days. A new hyper-scale system, DataFlow, is considered as its successor which supports both batch and streaming data processing. Programmers can create complex processing pipelines using DataFlow to manipulate a huge size of data. In fact, besides DataFlow, Google already develops a series of big data systems, such as Dremel [22], Spanner [8] and Pregel [21], to replace the original two, MapReduce and BigTable [7]. Those systems show how big data technology evolves inside Google. The same technology revolution also happens in the academic community. As the most popular open-source implementation of MapReduce, Hadoop attracts many research efforts [17] and has been widely applied to various real-world applications. However, Hadoop is also found inefficient in processing iterative jobs [4, 23]. So GraphLab [20,13] which adopts a vertex-centric processingmodel similar as Pregel is being developed to support large-scale data mining algorithms. Most existing systems such as MapReduce (Hadoop) and Pregel (GraphLab) provide a fixed programming model for users, while the flexibility of the model determines the difficulty of writing programs on top of it. To address the problem, epiC [5,14] allows users to create their own programming model, simplifying the development of big data application and improving the performance significantly. The design of big data system is also affected by the advancement in computer hardware. As memory becomes cheaper and cheaper, we can equip a compute node with a very large memory, so that data can be fulled maintained in the distributed memory of a cluster. This observation motivates the development of in-memory based processing system, such as Spark,2 which can run a job 100 times faster than Hadoop.
برای دانلود رایگان مقاله سیستم کلان داده اینجا کلیک نمایید.
کلمات کلیدی:
The Evolution of Big Data, and Where We're Headed | WIRED https://www.wired.com/insights/2014/03/evolution-big-data-headed/ But big data is evolving and smart data, identity data and people data are here to ... People data, in general, is not a real-time system, because real-time here ... The Importance of Software Architecture in Big Data Systems https://insights.sei.cmu.edu/.../the-importance-of-software-architecture-in-big-data-sys... Jan 13, 2014 - Many types of software systems, including big data applications, lend them themselves to highly incremental and iterative development ... Prototyping for Developing Big Data Systems https://insights.sei.cmu.edu/sei.../prototyping-for-developing-big-data-systems.html Jul 25, 2016 - There are several risks specific to big data system development. Software architects developing any system--big data or otherwise--must ... Evolution of Big-Data-Enhanced Higher Education Systems - IEEE ... ieeexplore.ieee.org/document/7422490/ by S Li - 2015 - Related articles There exists a significant difference between traditional data processing and today's big data technology, especially data structure and information extrac. [PDF]big data system development: an embedded case study with a global ... https://sse.uni-due.de/bigdse15/BIGDSE2015-Chen_et_al.pdf by HM Chen - Cited by 15 - Related articles Proliferation of Big Data Technology. • Rapid Big Data Technology Changes. • Complexity. • Paradigm Shifts. • Short history of big data system development. Evolution of Big Data Storage: How to Support Real-time Analytics at ... https://mapr.com/.../evolution-big-data-storage-how-support-real-time-analytics-scale/ Apr 25, 2016 - When will this be possible and practical in enterprise big data systems? The good news is that a combination of data service technologies plus ... Searches related to The Evolvement of Big Data Systems evolution of big data analytics evolution of big data pdf evolution of big data ppt big data technology evolution brief history of big data inventions that use big data evolution of data analytics in business big data inventions
