What is Big data ? | Types of big Data | Big data Technology | Big data software | Big data analytics

Big Data

This is Darksitecoder presenting this blog. We all use a smartphone but have you ever wondered how much data it generates in the form of text, email, messages, phone calls, photos, videos, and searches. Approximately 40 Exabyte data generate a single smartphone user in a month. Now multiply this 40 Exabyte * 5,000,000,000 smartphone user that is a large amount of data. In fact for managing this kind of excessive amount of data is very difficult.

Big Data

Big data is the skill of extracting your suitable data from a too large number of structured, semi-structured, and unstructured data, or we can say Big data is a term describes a collection of data and also shows that how it is huge in volume and yet growing exponentially with time. In the previous one, we talk about how much data is used by many smartphone users and how is it difficult to manage this kind of data. Let’s take a very simple example of how we generate such kind of big data per minute on the internet :

• 2.1 Million Photos share in Snapchat
• 3.8 Million Users search in Google
• 1 Million User login Facebook
• 4.5 Million videos watched in YouTube
• 188 Million emails are sent daily

That’s a lot of data.

Classification of Big Data

We can simply divide the big data into 5V’s These are as follows

1. Volume

   

   5 V's of Big Data

2. Velocity
3. Variety
4. Varsity
5. Value

Let’s take an easy example to explain those 5V’s clearly. Take an example of a hospital

• Volume: -
  There are approximately 2800 Exabyte data is recorded annually from this hospital only. Simply we can say that the amount of data is called the volume of Big data. 
• Velocity: -
  The patient records and their test results fetch a very fast way. The speed of fetching data is called the velocity of data.
  
• Variety: -
  The patient data is stored in structured, semi-structured, and unstructured form for example excel file is known as structured data, a text file is known as semi-structured data, and x-ray files are known as unstructured data.
  
• Varsity: -
  The accuracy and trustworthiness are known as varsity.
  
• Value: -
  Disease detection, better treatment, and reduced costs are the power of big data.
  

Store and Process Big data

For managing this kind of big data or we can say for managing this kind of data we have many kinds of Frameworks such as Hadoop, Spark, Flink, Storm, and Samza, these are the popular framework for managing Big data.
Let’s take an example of Hadoop as an example.

Hadoop:- 

Hadoop

Hadoop breaks your data, means Hadoop uses HDFS – Hadoop Distributed File system let you have 300mb data Hadoop stores it in many small machines like machine A, machine B, and machine C. in machine A it stored 128mb data in machine B it stores 60mb of data and in machine C it stores 112mb data and with the distribution, it makes a copy of your data with this system if a machine breaks down then your data will be stored in other machines.

Hadoop MapReduce technique:-  

In this process Hadoop process your data in a different machine for example if your data is processed in Machine A then machine A distributed this data in machine B, machine C, and machine D by this data processing is very easy and fast. This technique is also known as Parallel Processing.

Analyze of Big Data:-

We can analyze data by our mobile with very numerous applications games like PUBG and Call Of Duty, designer analyzes the data to understand in which level user pause the game restart the game or quit the game this help the designer to write the next part of the story or it can improve the user experience this can reduce the customer churn rate.
Similarly, Big data also help for disaster management. For example Earthquake, Tsunami in 2018 Big data helps the government to know which areas are more effective and they can take a suitable precaution for it.

Conclusion:-

From the above paragraphs, we get to know that Big data is not such skill but a problem in today’s world because many people want their data in various forms, you also know that Big data is just a big amount of structured, semi-structured and unstructured data. And processing and analysis of data is also included in it.
We have many kinds of a framework to manage this kind of data like Hadoop, Spark, Storm and many more in this blog we talk about Hadoop, that Hadoop is Distributed File Processes and it stores its data in many machines and also make a copy by this one machine is breakdown then the data is stored in another machine.
And last we talk about analyses of Big data that an analysis is very important for the development of the game or something else or important for the government also because by this we can know where we have to work more and where not.
Just think how much Big Data we use in our day by day.

NOTE:-

For Such Kind of blog please connect with us and if you want to know about something 
different please leave a comment below or tell me in my contact section stay connected with Darksitecoder.

Thank You.