Big Data Manipulation- A new concern to the ICT world (A massive Survey/statistics along with the necessity)

Syed Jamaluddin Ahmad, Roksana Khandoker Jolly

Big Data is a new concept in the global arena. Data creates values in the economy and very parts of life. When we do some things, it creates some data. In the early history of computing data is a valuable thing to develop some new technique or new idea generation. In the beginning, there was data – first in file systems, and later in databases as the need for enterprise data management emerged. In 1970 with the rules of the relational model, began to gain commercial traction in the early 1980’s. As for “Big Data”, at least beyond the accumulation of scientific data, the need to manage “large” data volumes came later, first impacting the database world and then more recently impacting the systems community in a big way. Innovations in technology and greater affordability of digital devices have presided over today’s Age of Big Data, an umbrella term for the explosion in the quantity and diversity of high frequency digital data. Turning Big Data—call logs, mobile-banking transactions, online user-generated content such as blog posts and Tweets, online searches, satellite images, etc.—into actionable information requires using computational techniques to unveil trends and patterns within and between these extremely large socioeconomic datasets. New insights gleaned from such data mining should complement official statistics, survey data, and information generated by Early Warning Systems, adding depth and nuances on human behaviours and experiences—and doing so in real time, thereby narrowing both information and time gaps. Data have become a torrent flowing into every area of the global economy. Companies churn out a burgeoning volume of transactional data, capturing trillions of bytes of information about their customers, suppliers, and operations. millions of networked sensors are being embedded in the physical world in devices such as mobile phones, smart energy meters, automobiles, and industrial machines that sense, create, and communicate data in the age of the Internet of Things. Big Data has important, distinct qualities that differentiate it from conventional source data. The data from these innovative sources are highly distributed, loosely structured, large in volume, and often available in real-time. Big Data is also an important part of the data revolution as referenced in the recommendations made to the Secretary General by the High Level Panel of Eminent Persons on the post 2015 development agenda in their report "A New Global Partnership: Eradicate Poverty  and Transform Economies through Sustainable Development".  Better data and statistics will help governments track progress and make sure decisions are evidence based; they can also strengthen accountability. Mobile devices, sensors, tracking devices and other technologies have caused a fundamental change to the availability of source data. Digital data is now everywhere—in every sector, in every economy, in every organization and user of digital technology. While this topic might once have concerned only a few data geeks, big data is now relevant for leaders across every sector, and consumers of products and services stand to benefit from its application. The ability to store, aggregate, and combine data and then use the results to perform deep analyses has become ever more accessible as trends such as Moore’s Law in computing, its equivalent in digital storage, and cloud computing continue to lower costs and other technology barriers. A true data revolution would draw on existing and new sources of data to fully integrate statistics into decision making, promote open access to, and use of, data and ensure increased support for Analytic systems". “Big Data” being a hot topics in the field of data mining, varies seminars, symposiums and workshops are being arranged in Bangladesh, so that the section dealing with data analysis can have a better idea about the sources of data generation the huge volumes, the results that may be derived and the threats lying in Big Data analysis. Bangladesh Bureau of Statistics(BBS) being a sloe organization mandated for official Statistics, huge volume of data is generated every year, so a large section of officials is engaged in  data analysis, as a result a workshop on “Big Data” was held to give some idea of ‘what’, ‘how’, and ‘where’ about “ Big Data” . Likewise a workshop on Advance Data Management(ADM)  including ‘Big Data” was held in BUET on June 28 and 29’ 2013 in which several research papers from home and abroad were presented in this context. Our Thesis paper does not offer a grand theory of technology-driven social change in the Big Data era, rather it aims to highlight the main development and uses raised by “Big Data” management. This thesis paper covers three main issues: Big Data sources, Main challenges, and Areas of use.