Over the past quarter century, industry standard benchmarks have had a significant impact on the computing industry. Vendors use benchmark standards to illustrate performance competitiveness for their existing products, and to improve and monitor the performance of their products under development. Many buyers use the results as points of comparison when purchasing new computing systems.
Continuing on the Transaction Processing Performance Council’s commitment to bring relevant benchmarks to industry, it is my great pleasure to announce TPCx-HS – the first standard that provides verifiable performance, price/performance and energy consumption metrics for big data systems. TPCx-HS can be used to asses a broad range of system topologies and implementation methodologies for Hadoop, in a technically rigorous and directly comparable, vendor-neutral manner. And while modeling is based on a simple application, the results are highly relevant to Big Data hardware and software systems.
Developing an industry standard benchmark for a new environment like Big Data has taken the dedicated efforts of experts across many companies. I would like to thank the contributions of Andrew Bond (Red Hat), Andrew Masland (NEC), Avik Dey (Intel), Brian Caufield (IBM), Chaitanya Baru (SDSC), Da Qi Ren (Huawei), Dileep Kumar (Cloudera), Jamie Reding (Microsoft), John Fowler (Oracle), John Poelman (IBM), Karthik Kulkarni (Cisco), Meikel Poess (Oracle), Mike Brey (Oracle), Mike Crocker (SAP), Paul Cao (HP), Reza Taheri (VMware), Simon Harris (IBM), Tariq Magdon-Ismail (VMware), Wayne Smith (Intel), Yanpei Chen (Cloudera), Michael Majdalany (L&M), Forrest Carman (Owen Media) and Andreas Hotea (Hotea Solutions).
I envision that TPCx-HS will be a useful benchmark standard to buyers, as they evaluate new systems for Hadoop deployments in terms of performance, price/performance and energy efficiency. And for vendors in demonstrating competitiveness of their products.
Sincerely,
Raghunath Nambiar
(Chair TPC Big Data Committee)
Additional information
TPCx-HS Portal
TPC Press Release
Slides
TPC takes the measure of big data systems by Joab Jackson
Can it be true? A BIG DATA benchmark? Yes, says TPC by Chris Mellor
TPCTC2014/VLDB2014 paper presentation: Introducing TPCx-HS: Industry’s First Standard for Benchmarking Big Data Systems, Raghunath Nambiar (Cisco), Tariq Magdon-Ismail (VMware), Akon Dey (University of Sydney), Paul Cao (HP), Andrew Bond (Red Hat), Da Qi Ren (Huawei), Meikel Poess (Oracle), Hangzhou, China, 9/4/2014
Can it be true? A BIG DATA benchmark? Yes, says TPC:
see article by Chris Mellor
http://www.theregister.co.uk/2014/08/20/big_data_benchmark_from_tpc/