4. Reasons for the growth of data

Capacity- Since capacity of hard drives and storage media is increasing, the cost of storage capacity is decreasing, roughly, the capacity doubles each year under "Kryder's Law"

Security - So many businesses use CCTV to capture video and audio footage for security purposes, which can take up large amounts of storage space after a while. System logs are also kept by many businesses which must also be stored.

Other devices - Data collected from other devices within a person or company's space such as scanners, sensors, etc, will also need to have their data stored

Social data - It is increasingly common now for businesses to collect personal data to aid things such as third party advertising for tailoring ads to users

Regulations - Regulations are constantly changing, requiring companies to keep more and more data and changing what data must be retained by the organisation

Cloud Storage - Cloud increases with popularity with each passing day and this keeps keeps the capital cost of big data low. It also allows for on demand expansion/increases in capacity and data size

Comments

7. Limitations of traditional data analysis

7. Limitations of traditional data analysis Security: Security is foremost aspect for every technology. Big data is prone to data breaches. The important information that is provided to some third party may get leaked to customers. Proper encryption must be made in order to protect the data. Large growth in data : data is growing faster than the processing power. Large volumes of data are being exploded in past years. We need some new machines to work; otherwise we will get over run by data. Large Data centres can solve this problem. Inconsistencies: Sometimes the tools we use to gather big data sets are imprecise. This will happen when the data is collecting for example, consider Google search Edinburgh College results of the search on one day will be different from other day, this is mainly due to inconsistency in data collection.

3. Growth of Big Data

3. Growth of Big Data Kryder's law - The idea that data storage will double almost every year (13 months), as the storage capacity increases, storage will decrease in price. https://searchstorage.techtarget.com/definition/Kryders-Law growth of data - Data is increasing at an exponential rate, more data has been made in the past two years than ever before combined. It is estimated that by the year 2020, 1.7MB of new data will be made every second for every human on earth. Within 5 years there will be 50 billion smart connected devices on earth. also by 2020, at least 1/3 of all the world's data will pass through the cloud. The image below contains more examples of data growth as well as a graph for visual representation https://dvmobile.io/dvmobile-blog/feeling-overwhelmed-by-a-deluge-of-iot-data-iot-data-analytics-dashboards-can-help

2. Historical development of Big Data

2. Historical development of Big Data 1980's - networks started to appear across other countries, although possible, connection was still extremely difficult without travelling, the networks had to communicate in the same language as opposed to different ones. The principle link at CERN connected the US and Europe in 1989 1990's - remote access of data in the terabytes was now easily achievable around the world. To share data more easily, the web was created so that the actually location of the data wasn't necessary to know 2000's - Big data was now so large that CERN was unable to store such a vast amount of petabytes themselves and as such had to share it between partners around the world to offload some of it. This lead to the creation of cloud computing 2005 - The term Big Data is used for the first time by Roger Mougalas, a year after the creation of the term "web 2.0" which refers to data too large to handle with traditional business methods 2009 -...

Big Data EC1702991

Search This Blog