While there is not yet an industry standard benchmark for measuring the performance of Hadoop systems (yes, there is work in progress -- WBDB, BigDataTop100 etc), workloads like TeraSort have become a popular choice to benchmark and stress test Hadoop clusters.
TeraSort is very simple, consists of three map/reduce programs (i) TeraGen -- generates the dataset (ii) TeraSort -- samples and sort the dataset (iii) TeraValidate -- validates the output. With multiple vendors now publishing TeraSort results, organizations can make reasonable performance comparisons while evaluating Hadoop clusters.
We conducted a series of TeraSort tests on our popular Cisco UCS Common Platform Architecture (CPA) for Big Data rack with 16 Cisco UCS C240 M3 Rack Servers equipped with two Intel Xeon E5-2665 processors, running Apache Hadoop distribution, see figure below, demonstrating industry leading performance and scalability over a range of data set sizes from 100GB to 50TB. For example, out of the box, our 10TB result is 40 percent faster than HP’s published result on 18 HP ProLiant DL380 Servers equipped with two Intel Xeon E5-2667 processors.
While Hadoop offers many advantages for organizations, the Cisco story isn’t complete without including collaborations with our ecosystem partners that enables us to offer complete solution stacks. We support leading Hadoop distributions including Cloudera, HortonWorks, Intel, MapR, and Pivotal on our Cisco UCS Common Platform Architecture (CPA) for Big Data. We just announced our Big Data Design Zone that offers Cisco Validated Designs (CVD) -- pretested and validated architectures that accelerate the time to value for customers while reducing risks and deployment challenges.
Cisco Big Data Design Zone
Cisco UCS Demonstrates Leading TeraSort Benchmark Performance
Cisco UCS Common Platform Architecture (CPA) for Big Data
Tags: Big Data, Big Data Benchmarks, Cisco UCS C240 M3 Rack Server, Cisco UCS CPA, CPA, Hadoop, TeraSort, YCSB
Your smart sprinkler system is happily pumping water to your lawn in highly efficient sprays that are “aware” of the soil, the climate, the weather, the time of day, and even whether or not your kids are playing in the backyard on a Saturday. Suddenly, a faulty valve bursts and an uncontrolled geyser erupts. One part of your property is about to be ruined by flooding while the rest of the lawn is left to yellow in the sun.
You and your family are miles away, yet you know all about it. Sensors throughout the system alert your smartphone. At the same time, machine-to-machine signals shut down the pumps, and an expert from the sprinkler company is dispatched to your home with the precise replacement part and the real-time knowledge to fix the system.
It’s a great example of how the Internet of Everything (IoE) may soon funnel precise information in real time to the people — or machines — that need it most. Many of these “remote expert“ technologies are either already here or on the horizon.
Read More »
Tags: Big Data, Cisco, Cisco Consulting Services, collaboration, Internet of Everything, IoE, M2M, Machine to Machine, remote expert
A common cornerstone of both the Internet of Things and Internet of Everything concepts is the idea of a future with billions, if not trillions, of connections to the Internet. As the Internet of Everything connects objects, data, people and processes, the future of connected things will not be traditional computers or smartphones. Rather, it may be your refrigerator, or a traffic light, or even a litter box. Basically, anything that can have a status change that will interest someone has the potential to be connected to the Internet in order to alert you to that change.
The idea of being alerted to important information automatically is appealing. After all, if your refrigerator is having a cooling issue and it can send you a text alert, you can save money by taking corrective action before your milk and other products go bad. However, not all of the data generated by the Internet of Everything will be of high value. In fact, most of it will be of little value at all.
Read More »
Tags: Big Data, Cisco, connections, Internet of Everything, internet of things, IoE, IoT, sensors, smart things
As the key delivery model for the Internet of Everything (IoE) economy, cloud is helping to drive sweeping changes across nearly all aspects of our lives. But while the growth trajectory of cloud has been carefully charted, there has been comparatively little insight into its impact on IT organizations. To gain a better understanding, Cisco® Consulting Services, in partnership with Intel®, undertook an extensive global survey of 4,226 IT leaders respondents in April-March 2013 to investigate cloud-driven IT change.
“The Impact of Cloud on IT Consumption Models” study explored the dramatic changes affecting IT at all key consumption lifecycle stages — how businesses plan for, procure, deploy, operate, and govern IT. This is part two in a four-part blog series that will explore some of the findings of this study and discuss how today’s IT leaders can prepare for the new model for IT.
One of the clearest expressions of this cloud-driven change is the emergence of lines of business (LOBs) — human resources, sales, R&D, and other areas that are end users of IT — both as direct consumers of third-party cloud-based services, and as ever more prominent influencers of companies’ IT agendas. This represents a major paradigm shift from decades of IT tradition, when IT itself set the agenda and made all planning and procurement decisions.
Read More »
Tags: Big Data, Cisco, Cisco Consulting Services, cloud, employee productivity, innovation, Internet of Everything, internet of things, IoE, IoE Value Index, IoT, IT, value at stake
Microsensors in your shoes compile data on where you go and how much you walk or run. Your workout clothes track your daily progress at the gym and tell you when to slow down or speed up. The pill you swallow reports back on the state of your digestion, vital signs, and overall well-being. And as you sleep, a headband monitors your REM patterns.
A far-fetched sci-fi fantasy? Not at all. It’s merely a glimpse Read More »
Tags: Big Data, Cisco Consulting Services, employee productivity, Enterprise, innovation, Internet of Everything, IoE, IoE Value Index, Quantified Self