Question

write in a long paragraph about the challenges in collecting, managing ,storing, querying, and analyzing various form of big data. use ur own words

Answer 1

First of all, What is data? Data is a individual unit of collection of information. Everything around us is data. Collection of huge amount of data that is in petabytes or terabytes produced by large organizations such as google, facebook, weather forecasting department and millions of people around the world. This information is impossible to store by our traditional storage methods. Information/data can come from anywhere and in any form. So, for clear understanding, Big Data is distributed in three types. Structured, Unstructured and Semi-Structured data. The data that is already in Ordered form is known as Structured Data. I can be in the form of charts or tables. Second is Unstructured data which is in the form of videos, audio, photos etc. They have no clear format of storage. The third type is Semi-Structured data. This kind of data does not have the required database format but contains some properties and reports which makes it easier to process. Collecting Big Data in traditional Storage form is not possible. Collecting accurate and more marketing data about users out of big chunk of Information is very challenging process. There are so many factors that play a important role in Big Data management. Some are security, ethicality, data backup, data cleanup, data integrity, database design planning and so on. Data Storage is a huge issue and a big challenge for this rapidly growing world where data is growing in multiple of it. Some major challenges in storing Big data is Cost and infrastructure. Storing data is very costly. Other than this some factors are compatibility, data growth, data loss, etc. Challenges faced during data quering are, scalability, ability to manipulate the data at the different levels of granularity, privacy and security, and quality assurance. The major challenges in analyzing Big Data are very less knowlwdge to correct analyzation, getting meaningful and useful insights out of analysis.