Free Essay

Big Data

In:

Submitted By supabanana
Words 1847
Pages 8
Lecture on Big Data

Guest Speaker Simon Trang Research Member at DFG RTG 1703 and Chair of Information Management Göttingen University, Germany 2014

The City
City of Göttingen

• Founded in the Middle Ages • True geographical center of Germany • 130,000 residents
Chair of Information Management Lecture on Big Data at Macquarie University 2 2

The University
Georg-August-Universität Göttingen (founded in 1737)

• • • •

One of nine Excellence Universities in Germany 13 faculties, 180 institutes 26,300 students (2013) 11.6% students from abroad (new entrants: approximately 20%) • 13,000 employees (including hospital and medical school), including 420 professors • 115 programs of study from A as in Agricultural Science to Z as in Zoology are offered (73 bachelor / 22 master programs)

Chair of Information Management

Lecture on Big Data at Macquarie University

3

“The Göttingen Nobel Prize Wonder”
Over 40 Nobel prize winners have lived, studied, and/or lived, studied or/and researched 41 Prize researched at the University of Göttingen, among them… at the University of Göttingen, among them… • • • • • • • • • • • • • • Max von Laue, Physics, 1914 Max von Laue, physics, 1914 Max Planck, physics, 1918 Max Planck, Physics, 1918 Werner Heisenberg, physics, 1932 Werner Heisenberg, Physics, 1932 Otto Hahn, chemistry 1944 Otto Hahn, Chemistry 1944 Max Born, physics, 1954 Max Born, Physics, 1954 Manfred Eigen, chemistry, 1967 Manfred Eigen, Chemistry, 1967 Erwin Neher, medicine, 1991 Erwin Neher, Medicine, 1991

Max Planck

Werner Heisenberg

• Stefan Hell, chemistry, 2014 (together with Eric Betzig and William E. Moerner)
Manfred Eigen

Erwin Neher

Chair of Information Management

Lutz M. Kolbe

4

Famous Graduates from Göttingen
• Otto von Bismarck • Dieter Bohlen
First German chancellor, state examination in law German pop musician, M.Sc. in Administration CEO Allianz AG, law and philosophy Mathematician and director of the observatory, professor of astronomy President of SIEMENS AG, M.Sc. in Administration U.S.-American businessman, founder of J.P. Morgan & Co. Former German chancellor, state examination in law Head of German parliament, state examination in teaching, honorary professor at the University of Göttingen German federal president, state examination in law and history
J.P. Morgan Gerhard Schröder

• Michael Diekmann

• Carl Friedrich Gauß • Klaus Kleinfeld

• John Pierpont Morgan
• Gerhard Schröder • Rita Süßmuth

• Richard von Weizsäcker • Konrad Zuse

Inventor of the first binary computer, honorary professor at the University of Göttingen

Chair of Information Management

Lecture on Big Data at Macquarie University

5

Research Projects

1 Mobility (SMRG)
• • • • BESIC e-Radschnellwege Elektromobilität für Nachahmer Gap EV

Renewable Resources
Research Training Group 1703 “Resource Efficiency in Corporate Networks”

2

3 IT Departments
Chair of Information Management

Efficiency Evaluation of Service Configurations in Telemedicine

Consumerization of IT in Financial Services and Automotive

Digital Transformation
Lecture on Big Data at Macquarie University

4
6

Why Study in Göttingen?

If you want to come to Göttingen, please contact me: strang@uni-goettingen.de There are indeed a lot of very good reasons, for example:
Hamburg

Berlin
Göttingen

Munich
Chair of Information Management Lutz M. Kolbe 7

Agenda

Why Big Data?

Where does the big data come from?

What are the technologies?

Big data, a friend or foe?

Chair of Information Management

Lecture on Big Data at Macquarie University

8

Hype or Ripe?

Chair of Information Management

From Peta- to Zettabytes

Chair of Information Management

Examples of really big data sets

Chair of Information Management

Big data is particularly challenging: The three Vs
100 km, 5 Exabyte

2.5 Exabyte of new data each day!
=2,500,000,000,000,000,000 bytes

50 km

50 km 2.5 Exabyte

1 Terrabyte 2.5 Exabyte 2014
Chair of Information Management

2016

So what is Big Data?
Big data usually includes data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process the data within a tolerable elapsed time. Constant improvements in traditional DBMS technology as well as new databases like NoSQL increase the ability to handle larger amounts of data. With this difficulty, new platforms of big data tools are being developed to handle various aspects of large quantities of data. Big data is difficult to work with using most relational database management systems and desktop statistics and visualization packages, requiring instead massively parallel software running on tens, hundreds, or even thousands of servers.

Chair of Information Management

New big data analytics applications impacting core business processes can be found in all industry and service sectors

Chair of Information Management

Agenda

Why Big Data?

Where does the big data come from?

What are the technologies?

Big data, a friend or foe?

Chair of Information Management

Lecture on Big Data at Macquarie University

15

Where does all the data come from?

Pope Benedict Inauguration (2005)

Pope Francis Inauguration (2013)

Chair of Information Management

Lecture on Big Data at Macquarie University

16

Mobile service providers sell user locations for traffic jam prediction services

Low density

High density

Chair of Information Management

Lecture on Big Data at Macquarie University

17

Without regulation, companies save as much as they can Facebook, I would like to see all data you have stored about me

• After some time passed, Facebook sent him 1200 DIN A4 pages • Data that had been deleted was still in the document • His request resulted in rethinking the data privacy policies at the European level
Chair of Information Management Lecture on Big Data at Macquarie University 18

How much is your personal data worth?
Political interest: 2 AUD

Marriage: 11.5 AUD

Residence: 7 AUD

Illnesses: 30 AUD

New job: 8 AUD

Reduce weight: 11 AUD
Pregnancy: 11 AUD

House moving: 8.5 AUD

Chair of Information Management

Lecture on Big Data at Macquarie University

19

What is a fair amount to be paid for personal data?
• Controversial study of Staiano and colleagues supported by Telefonica and Telecom Italia • What is the lowest price you are willing to accept for your data? • Daily valuation of PII of 60 participants in a second bet reverse auction • The median bid across all the data categories was 2 EUR (2.8 AUD) a day -> 730 EUR (1022 AUD) a year for one category

Source: Staiano et al. (2014): Money Walks: A Human-Centric Study on the Economics of Personal Mobile Data, in Ubicomp 2014. Chair of Information Management Lecture on Big Data at Macquarie University 20

Why do we share our data with profit organizations (almost) for free?
• A new loyalty card is introduced to the customers • You would get an initial discount if you join now • A game theory approach:

No
Would you join?

Others (would they join) Yes good very bad Nash bad bad Equilibrium
21

No

Pareto ok ok Efficient

Yes
Chair of Information Management

very bad good Lecture on Big Data at Macquarie University

Agenda

Why Big Data?

Where does the big data come from?

What are the technologies?

Big data, a friend or foe?

Chair of Information Management

Lecture on Big Data at Macquarie University

22

Traditional business intelligence vs. next-generation business intelligence
Business Intelligence (BI) Next-Generation BI

• Focus on descriptive analytics • E.g., how many Wiener sausages did we recently sell to young consumers in Australia?

• Focus on predictive and prescriptive analytics • E.g., which Australian groups should be addressed in order to significantly increase our Wiener sausages sales and profit in 2015?
23

Chair of Information Management

Lecture on Big Data at Macquarie University

Techniques for Big Data analytics
• • • • • • • • • • • • • • • Hierarchical clustering Centroid-based clustering Distribution-based clustering Density-based clustering … and many more Linear regression model Discrete choice models Logistic regression Probit regression … and many more Neural networks Multilayer Perceptron (MLP) Radial basis functions Support vector machines … and many more
Lecture on Big Data at Macquarie University 24

Cluster analysis techniques

Regression analysis techniques

Machine learning techniques

Chair of Information Management

An example of a cluster analysis



Three different clusters of organizations emerged from the data Internal operations Market competitiveness Reputation management

• • •

Source: Schmidt et al. (2010): Examining the Contribution of Green IT to the Objectives of IT Departments: Empirical Evidence from German Enterprises, in Australasian Journal of Information Systems 17(2014)1. Chair of Information Management Lecture on Big Data at Macquarie University 25

Between 2002 & 2013, Target increased its revenue by 29 billion USD: An example of a probit estimation (1)

Only for you
Discount on baby clothes and cribs

“My daughter got this in the mail!” “She’s still in high school, and you’re sending her coupons for baby clothes and cribs? Are you trying to encourage her to get pregnant?”

A few days later target called back

“I had a talk with my daughter,” “It turns out there’s been some activities in my house I haven’t been completely aware of. She’s due in August. I owe you an apology.”
Lecture on Big Data at Macquarie University 26

Chair of Information Management

An example of a probit estimation (2)
• Target wanted to advertise to pregnant woman • What buying behavior can predict pregnancy?

1

Product1

2 Data sets of prior purchases
Pregnancy

Product2
Product3 Etc.

3

Product1 Product2

.30*** .01ns .21***
Probability Pregnancy

4 Data sets of new purchases
If prob. preg. > .90
27

Product3
Etc.

Chair of Information Management

Lecture on Big Data at Macquarie University

Relation of the probability of a credit default and computer fonts: An example of a Neural Network (1)

Online credit
Only if

Compute probability of default
Chair of Information Management Lecture on Big Data at Macquarie University 28

Relation of the probability of a credit default and computer fonts: An example of a Neural Network (2)

If prediction is correct -> do nothing
… either If prediction is wrong -> change weights

Iterative training of the network (with 2/3 of data)

Count correct predictions

Count wrong predictions

Success rate

Validating the network (with 1/3 of data)
Chair of Information Management Lecture on Big Data at Macquarie University 29

Agenda

Why Big Data?

Where does the big data come from?

What are the technologies?

Big data, a friend or foe?

Chair of Information Management

Lecture on Big Data at Macquarie University

30

Big Data transfers power to companies
• Controversial study of Kramer and colleagues published in PNAS 111 (2014) 24 • Can emotions be transferred to others without direct interaction? • Experiment with N = 689,003 Facebook users, maybe you?!
Manipulation through Facebook Timeline displays many positive expressions Timeline displays fewer positive expressions User reaction Positive emotions (more positive posts) Negative emotions (more negative posts)
Lecture on Big Data at Macquarie University 31

Chair of Information Management

Group 2

Group 1

Big data and related threats
• Algorithms only show correlations rather than explaining the deeper causes
Amount of storks Chocolate consumption

+ +

Rural area ??? Developed ??? country

+ +

Number of pregnancies Nobel Prizes

• Data gives power to organizations and public authorities

1

2

Chair of Information Management

Lecture on Big Data at Macquarie University

32

Thank you for your attention

“We know where you are… We know where you've been… We can more or less know what you’re thinking about”

Eric Schmidt, CEO at Google
Eric Schmidt, CEO Google, at "Second Annual Washington Ideas Forum" on 1st Oktober 2010

Chair of Information Management

Lecture on Big Data at Macquarie University

33

Similar Documents

Free Essay

Big Data

...A New Era for Big Data COMP 440 1/12/13 Big Data Big Data is a type of new era that will help the competition of companies to capture and analyze huge volumes of data. Big data can come in many forms. For example, the data can be transactions for online stores. Online buying has been a big hit over the last few years, and people have begun to find it easier to buy their resources. When the tractions go through, the company is collecting logs of data to help the company increase their marketing production line. These logs help predict buying patterns, age of the buyer, and when to have a product go on sale. According to Martin Courtney, “there are three V;s of big data which are: high volume, high variety, high velocity and high veracity. There are other sites that use big volumes of data as well. Social networking sites such as Facebook, Twitter, and Youtube are among the few. There are many sites that you can share objects to various sources. On Facebook we can post audio, video, and photos to share amongst our friends. To get the best out of these sites, the companies are always doing some type of updating to keep users wanting to use their network to interact with their friends or community. Data is changing all the time. Developers for these companies and other software have to come up with new ways of how to support new hardware to adapt. With all the data in the world, there is a better chance to help make decision making better. More and more information...

Words: 474 - Pages: 2

Free Essay

Big Data

...Article Summary - Data, data everywhere Data 2013.10.01 | Major Media Communication | Subject Understanding Digital Media | Student no 2010017713 | Professor Soochul Kim | Name Eunkang Kim | Double-side of a vast amount of information in accordance with development of technology is treated in this article. Even now, a lot of digital information beyond imagination is being accumulated all over the world. Not only the amount of information is increasing, but the production rate of one is also getting speedy. This explosion of information has some reasons. The main reason is technology development. It can actualize things which were impossible in the past. The digital technology changes a lot of information into digitization. Also, many people utilize them with the powerful mean digital device. Men communicating by information contributed to increase the amount of information. Humans who escaped from illiteracy and economic hardship have generated many kinds of information, which are utilized in several fields such as politics, economy, law, culture, science, and so on. The production rate of information is faster than the speed of technology development. Though the digital devices handling the information are getting various, storage space is not enough to store the increased information. Sea is not calm, but it has that big waves. Likewise, lots of information comes to our life. It is important to judge what information is...

Words: 614 - Pages: 3

Premium Essay

Big Data

...I. Big data emerging factor in IT area A. World’s notice for big data An appearance of tablet PC and social media was the hottest issue in IT market in last year. There are some successful global companies that go along the trends although it is not that long period since they appeared in the world, such as Apple, Google, Facebook, and Twitter. They have something in common. That is, they are based on ‘Big Data’ technology. As a result of using ‘big data’, the amount of stored data by their big data system during 2012 is much more than that of data which had been produced and stored until 2011. It helps to solve several problems in the company. Due to the geometrical increase of the amount of data, the important of big data will be continuous. Big data is selected as one of noticeable keyword in 2013 IT area with mobility, social, and cloud. It will be main factor of growth of IT infrastructure in the medium to longer term and is expected to provide new strategic superiority for many companies. It is highly acclaimed at the domestic market and also the foreign market. Several successful cases of applying big data shows that it can be positive factor helping to recover global economy. Moreover, it is not limited to IT-related business but the introduction in various areas will create value. B. Background of emerging big data In fact, there are many efforts to extract meaningful information through collection and analysis of huge amount of data. Through this effort...

Words: 2394 - Pages: 10

Free Essay

Big Data

...Big Data Management: Possibilities and Challenges The term big data describes the volumes of data generated by an enterprise, including Web-browsing trails, point-of-sale data, ATM records, and other customer information generated within an organization (Levine, 2013). These data sets can be so large and complex that they become difficult to process using traditional database management tools and data processing applications. Big data creates numerous exciting possibilities for organizations, but along with the possibilities, there are challenges. Managers must understand the pitfalls and limitations, as well as the potential of big data (Levine, 2013). The focus of this report is the business potential and implications of big data as well as understanding the challenges and limitations of big data management. The potentials for big data are numerous; however, in this report only five potentials and implications for use are discussed. These include the following: knowledge management, social media, in travel, banking, and marketing and advertising. Knowledge Management One of the greatest potential for big data is knowledge management. A goal of knowledge management is the ability to integrate information from multiple perspectives to provide the insights required for valid decision-making such as where to invest marketing dollars, how much to invest, or whether to expand into a new geographic market (Lamont, 2012). In terms of knowledge management, three dimensions...

Words: 1175 - Pages: 5

Premium Essay

Big Data

...examine the definition of big data. It also seeks to examine the components of a Unified Data Architecture and its ability to facilitate the analysis of big data. 2 WHAT IS BIG DATA Cuzzocrea, Song and Davis (2011) defined big data in part as being “enormous amounts of unstructured data produced by high-performance applications falling in a wide and heterogeneous family of application scenarios”. In recent years there has been an increasing interest and focus on big data. Many and varied definitions have been proposed but without a consensus on a single definition. The MIT Technology Review (2014), brought attention to the work of Ward and Barker (2014) which examined a number of definitions of big data that have attracted some general ICT industry support from leading ICT industry analysts and organisations such as Gartner, Oracle and Microsoft. In their work they proposed to provide a “concise definition of an otherwise ambiguous term”. The author having just attended a digital government conference with a large proportion of big data tagged presentations also noted that no single definition was offered. There was however a common content theme that supported the Ward and Barker definition of: “Big data is a term describing the storage and analysis of large and or complex data sets using a series of techniques including, but not limited to: NoSQL, MapReduce and machine learning.” 3 UNIFIED DATA ARCHITECTURE 3.1 WHAT IS THE UNIFIED DATA ARCHITECTURE? The concepts...

Words: 579 - Pages: 3

Premium Essay

Big Data

...have largely penetrated the communication industry and have since overtaken the use of computers in accessing the internet (Australian Communications and Media Authority, 2012). Consequently, business organizations have since devised better marketing and planning strategies by utilizing Big Data facilities and technologies whereby businesses are capable of deriving user requirements based on the searches potential users conduct on their mobile devices. From our initial report, we were able to highlight how Big Data is utilized in an organization and the accrued advantages against disadvantages of implementing Big Data technologies. We shall begin this report by first responding to the issues raised by management and then continue to make recommendations on the utilization of Big Data. Addressing Feedback Big Data technologies are fairly new to this organization and thus management was bound to raise issues concerning implementation and feasibility of the project. In this section, we shall briefly highlight these issues and how they may be addressed to achieve the organization’s objectives cost effectively. These issues include; i. Cost of implementing Big Data technologies – Big Data...

Words: 1262 - Pages: 6

Free Essay

Big Data

...The Situation of Big Data Technology Yu Liu International American University BUS 530: Management Information Systems Matthew Keogh 2015 Summer 2 - Section C Introduction In this paper, I will list the main technologies related to big data. According to the life cycle of the data processing, big data technology can be divided into data collection and pre-processing, data storage and management, data analysis and data mining, data visualization and data privacy and security, and so on. The reason I select topic about big data My major is computer science and I have taken a few courses about data mining before. Nowadays more and more job positions about big data are showing at job seeking website, such as Monster.com. I am planning to learn some mainstream big data technologies like Hadoop. Therefore, I choose big data as my midterm paper topic. Big data in Google Google's big data analytics intelligence applications include customer sentiment analysis, risk analysis, product recommendations, message routing, customer losing prediction, the classification of the legal copy, email content filtering, political tendency forecast, species identification and other aspects. It is said that big data will generate $23 million every day for Google. Some typical applications are as follows: Based on MapReduce, Google's traditional applications include data storage, data analysis, log analysis, search quality and other data analytical applications. Based on Dremel system...

Words: 1405 - Pages: 6

Premium Essay

Big Data

...Big Data is a massive volume of data. It's usually so massive that it becomes complicated to comprehend using tools such as on-hand database, and traditional data processing applications. Some problems that come up are storage, sharing, analysis, and search.Even though these problems do occur it still can be helpful in business operations, and better business decisions. This data can also help give companies informations which can increase profit, bring more customers, and overall increase the business's value. Characteristics of Big Data include the five V’s. The first one is volume, which is the quantity of data. The second is Variety, which the type of Data. The third is velocity, which is the speed of the data is gathered. The fourth one Variability, which is inconsistency of data can hamper processes to manage it. The final one is Veracity, which is the quality of data captured can vary. These data sets are growing rapidly mainly because they are gathered at a fairly cheap. The world's technological per-capita are doubling every 40 months. Business intelligence with data with high information density to look for trends. Big Data also increased information management specialist. Some of the largest companies like IBM and Microsoft spent over 15 billion dollars on software firms which specialize in data analytics. Governments use big data because it's efficient in terms of productivity and innovation. While gathering big data is a big benefit there are also some issues...

Words: 293 - Pages: 2

Premium Essay

Big Data

...Big Data is Scaling BI and Analytics How the information surge is changing the way organizations use business intelligence and analytics Information Management Magazine, Sept/Oct 2011 Shawn Rogers Like what you see? Click here to sign up for Information Management's daily newsletter to get the latest news, trends, commentary and more. The explosive growth in the amount of data created in the world continues to accelerate and surprise us in terms of sheer volume, though experts could see the signposts along the way. Gordon Moore, co-founder of Intel and the namesake of Moore's law, first forecast that the number of transistors that could be placed on an integrated circuit would double year over year. Since 1965, this "doubling principle" has been applied to many areas of computing and has more often than not been proven correct. When applied to data, not even Moore's law seems to keep pace with the exponential growth of the past several years. Recent IDC research on digital data indicates that in 2010, the amount of digital information in the world reached beyond a zettabyte in size. That's one trillion gigabytes of information. To put that in perspective, a blogger at Cisco Systems noted that a zettabyte is roughly the size of 125 billion 8GB iPods fully loaded. Advertisement As the overall digital universe has expanded, so has the world of enterprise data. The good news for data management professionals is that our working data won't reach zettabyte scale for some...

Words: 2481 - Pages: 10

Premium Essay

Big Data

...Introduction to Big data Every day, 2.5 quintillion bytes of complex, every changing data are generated. (IBM) Data comes from social sites, digital images, transaction records, and countless unknown resources. The amount of data we generate daily is enormous, and the rate it is being generated is accelerating. As we head into a future where technology dominates the global market, this pace will only continue accelerate. Businesses and other entities are aware of this data and its power. In a survey taken by Capgemini and the Economist, over 600 global business leaders identified their companies as data driven and identified data analytics as an integral part of their business. Big Data solutions are considered the answer for handling this data converting it into useful information. According to the O'Reilly Radar Team (Big Data Now), Big Data consists of three variables – size, velocity and variety. Data is considered big if conventional systems cannot handle its size. It is not only that size of Big Data that matters, but also the volume of transactions that come with it. The second issue is how fast the data is generated and how fast if it changes (velocity). New data and updated data is constantly generated, and it must be processed and analyzed quickly to create real value for an organization. The final issue is data structure (variety). Data is typically collected in raw form, unstructured, from a variety of sources. To acquire useful information, data needs to be processed...

Words: 2909 - Pages: 12

Premium Essay

Big Data

...era of ‘big data’? Brad Brown, Michael Chui, and James Manyika Radical customization, constant experimentation, and novel business models will be new hallmarks of competition as companies capture and analyze huge volumes of data. Here’s what you should know. The top marketing executive at a sizable US retailer recently found herself perplexed by the sales reports she was getting. A major competitor was steadily gaining market share across a range of profitable segments. Despite a counterpunch that combined online promotions with merchandizing improvements, her company kept losing ground. When the executive convened a group of senior leaders to dig into the competitor’s practices, they found that the challenge ran deeper than they had imagined. The competitor had made massive investments in its ability to collect, integrate, and analyze data from each store and every sales unit and had used this ability to run myriad real-world experiments. At the same time, it had linked this information to suppliers’ databases, making it possible to adjust prices in real time, to reorder hot-selling items automatically, and to shift items from store to store easily. By constantly testing, bundling, synthesizing, and making information instantly available across the organization— from the store floor to the CFO’s office—the rival company had become a different, far nimbler type of business. What this executive team had witnessed first hand was the gamechanging effects of big data. Of course...

Words: 3952 - Pages: 16

Premium Essay

Big Data

...Big Data Big Data and Business Strategy Businesses have come a long way in the way that information is being given to management, from comparing quarter sales all the way down to view how customers interact with the business. With so many new technology’s and new systems emerging, it has now become faster and easier to get any type of information, instead of using, for example, your sales processing system that might not get all the information that a manger might need. This is where big data comes into place with how it interacts with businesses. We can begin with how to explain what big data is and how it is used. Big data is a term used to describe the exponential growth and availability of data for both unstructured and structured systems. Back in 2001, Doug Laney (Gartner) gave a definition that ties in more closely on how big data is managed with a business strategy, which is given as velocity, volume, and variety. Velocity which is explained as how dig data is constantly and rapidly changing within time and how fast companies are able to keep up with in a real time manner. Which sometimes is a challenge to most companies. Volume is increasing also at a high level, especially with the amount of unstructured data streaming from social media such as Facebook. Also including the amount of data being collected from customer information. The final one is variety, which is what some companies also struggle with in handling many varieties of structured and unstructured data...

Words: 1883 - Pages: 8

Premium Essay

Big Data

...Big Data and its Effects on Society Kayla Seifert MGT-311 November 23, 2015 Big Data is a concept that has existed for a while but only gained proper attention a couple of years ago. One can describe Big Data as extremely large data sets that have grown so big that it becomes almost impossible to manage and analyze with traditional data processing tools. Enterprises can use Big Data by building new applications, improving the effectiveness, lowering the costs of their applications, helping with competitive advantage, and increasing customer loyalty. It can also be used in other industries to enable a better system and better decision-making. Big Data has become a valuable asset to everyone around the world and continues to impact society today. The ideology of Big Data first came up in the days before the age of computers, when unstructured data were the norm and analytics was in its infancy. The first Big Data challenge came in the form of the 1880 U.S. census when the information involving about 50 million people being gathered, classified, and reported. This census contained a lot of facts to deal with, however, limited technology was available to organize and manage it. It took over seven years to manually put the data into tables and report on the data. Thanks to Big Data, the 1890 census could be placed on punch cards that could hold about 80 variables. Instead of seven years, the analysis of the data only took six weeks. Big Data allowed the government...

Words: 1697 - Pages: 7

Premium Essay

Big Data

...Big Data/Predictive Analytics First Last Name Name of the Institution Big Data/Predictive Analytics Introduction There has been a controversial debate about the big data and the predictive analytics. With the evolution of technology and innovation, one fact needs to be appreciated that, the concept of the big data and the predictive analytics is here to stay. So it is up to the users to learn to deal with it and manage it to offset any adverse effects that may result. The proponents of the big data argue that the big data is advantageous, and the 21st-century generation benefits more from the big data and predictive analytics than the harm that the big data poses to their lives. The bottom line of the matter, however, is that, big data interferes with human’s privacy, ethics, and any unauthorized third party can access the personal data for evil purposes or their benefits. The definition of the big data takes the “3V” form; High-volume, high-variety and high-velocity information that demand the innovative forms of processing, cost-effective for improved insight and decision making. This technological definition does not encompass the societal aspect and. Therefore, it can be argued to be one-sided definition. To incorporate the societal aspect, the definition needs to be viewed in a broader manner so that the aspect of data analytics can come in. In this regard, the two terms can work together so that a meaning of full terms big data/ data analytics can denote the cloud...

Words: 4196 - Pages: 17

Premium Essay

Big Data and Data Analytics

...Big Data and Data Analytics for Managers Q1. What is meant by Big Data? How is it characterized? Give examples of Big Data. Ans. Big data applies to information that can’t be processed or analysed using traditional processes or tools or software techniques. The data which is massive in volume and can be both structured or unstructured data. Though, it is a bit challenging for enterprises to handle such huge amount fast moving data or one which exceeds the current processing capacity, still there lies a great potential to help companies to take faster and intelligent decisions and improve operations. There are three characteristics that define big data, which are: 1. Volume 2. Velocity 3. Variety * Volume: The volume of data under analysis is large. Many factors contribute to the increase in data volume, for example, * Transaction-based data stored through the years. * Unstructured data streaming in social media. * Such data are bank data (details of the bank account holders) or data in e-commerce wherein customers data is required for a transaction. Earlier there used to data storage issues, but with big data analytics this problem has been solved. Big data stores data in clusters across machines, also helping the user on how to access and analyse that data. * Velocity: Data is streaming in at unprecedented speed and must be dealt with in a timely manner. RFID tags, sensors and smart metering are driving the need to deal with...

Words: 973 - Pages: 4