Data collection in big data analytics

Data Collection in Big Data Analytics

It plays a crucial role .The web offers infinite data sources for different topics
The significance of this region lies on the business category
The conventional companies get a various external data sources and merges with transactional data e.g.
Developing a system that suggest restaurants
1^st step is data collection, so, restaurants reviews from various websites and accumulate the data in a database
It is employed for data analytics , in case of raw text concern
It is not that much relation where in the data is stored for developing a model
2^nd is big data technologies, to deploy an application of big data , want to construct its operation lively in real time

Sample Mini Project on Twitter

When the problem statement is identified, the next step is data collection
The underneath concept of mini project operates on gathering data from an internet and formatting it to be employed in a model of machine learning
Gather tweets from twitter and process it using R programming language
To proceed, generate an account in twitter and carry on the instructions underneath for the generation of an account for twitter developer. The instructions are as follows

Do log in the given link https://twitter.com/apps/new/
do fill the general information and move to the “settings” tab and choose “ read, write and access direct messages”
Do save the made settings
Catch the consumer key & consumer secret from “details” tab
API key along with an API secret values are accessed in the R session
Then execute the script given in the beneath section.
It installs the package twitter from its storage repository on github

To obtain the data with the string value “big_ mac” and identifying the topics out of this.
To perform this, the initial step is gathering data from the page twitter
the underneath is the script from R programming language to gather necessary data from the twitter page