Characteristics of BIG Data analysis.

 Today, I learned about the characteristics of BIG Data analysis. I learned that there are two perspectives for big data analysis, which are decision oriented analysis and action oriented analysis.

Decision oriented analysis looks at subsets of the data set to make generalizations which can be used to make predictions and assumptions about the rest of the data set to make business decisions.

Action oriented analysis looks at patterns that emerge and offers rapid response to leverage big data by making decisions proactively.

I learned that big data analysis can be problematic, due to big data often dealing with raw data, it can be difficult to explore the data manually and programs must be used for any kind of exploration because of the sheer amount of data.

If you have collected a huge amount of data, the analysis can be data driven as opposed to hypothesis driven big data analysis. This data driven method of data analysis can be accomplished using machine learning.

I learned about a tool called Apache Hadoop, which is software that allows users to manage massive data sets. The tool allows a network of computers to solve complicated data problems to analyse data sets which could be petabytes in size.

Comments

Post a Comment

Popular posts from this blog

Application of BIG Data techniques to a problem

In my blog posts, I have described the ways in which BIG Data can be used to benefit organisations, help with decision making and provide solutions to problems. In this blog, I will describe some methods that can be used to apply BIG Data techniques to solve the problem of designing targeted advertising. Targeted advertising is an advertising technique used by companies where they will personalise the ads to the specific user which are tailored to each user based on the data they collect about the user.  Companies such as Google and Facebook invest an immense amount of money to make sure they are able to collect and store as much data from each user as they physically can. They will then use BIG Data analysis techniques to analyse the data they collect.    These companies utilise targeted advertising as they are able to collect massive amounts of data from each of their users which makes their advertising a lot more accurate due to the massive size of their data sets....
Read more

Future applications of BIG Data

Today, I have learned about the future applications of BIG Data and the controversies associated with these applications, such as the controversy over the use of BIG Data analysis to identify, predict and take pre-emptive action against crime.  One future application of BIG Data that I learned about was to train machine learning algorithms for use in the military to provide warfighters with real-time information to give them a tactical advantage. Another application of BIG Data within the military is intelligence gathering as BIG Data analysis techniques can be used to search through data sources such as text messages and social media posts for key words or patterns to provide actionable information.  Another future application of BIG Data that I learned about was the application of BIG Data within the shipping industry. Predictive analysis is used within the shipping industry to provide insight into the condition of the ship as well as information about the ship based on data...
Read more

Strategies for Limiting the Negative Effects of BIG Data

 Today, I learned about some strategies to limit the negative effects of BIG Data. One of these strategies could be to give the person that generates the data power over the decision for how the data can be used and who is allowed to use the data, however some people believe that this solution is not enough and that there should be stronger restrictions. The data protection act 2018, which is based on the EU's GDPR legislation, is another strategy to limit the negative effects of big data. The data protection act lists strict rules for data controllers about how the data is stored and used, such as processing personal data is only allowed if consent is given by the owner of the data.   
Read more