In our previous big data blogs, a number of my Cisco associates have talked about the right infrastructure, the right sizing, the right integrated infrastructure management and the right provisioning and orchestration for your clusters. But, to gain the benefits of pervasive use of big data, you’ll need to accelerate your big data deployments and make a seamless pivot of your “back of the data center” science experiment into the standard data center operational processes to speed delivery of the value of these new analytics workloads.
If you are using a “free” (hint: nothing’s free), or open source workload scheduler, or even a solution that can manage day-to-day batch jobs, you may run into problems right off the bat. Limitations may come in the form of dependency management, calendaring, error recovery, role-based access control and SLA management.
And really, this is just the start of your needs for full-scale, enterprise-grade workload automation for Big Data environments! As the number of your mission-critical big data workloads increases, predictable execution and performance will become essential.
Lucky for you Cisco has exactly what you need! Read More »
Tags: Big Data, Cisco IT, Cisco Unified Management, inside cisco it, software, Tidal Enterprise Scheduler, UCS, unified management, unlock big data, workload automation
Introducing New Adapter for Cisco UCS Manager, Lightweight Java Client, Multi-domain AD/LDAP Authentication & Runtime User Support for TES Workgroups
Managing and automating mission-critical business process is key to the success of your enterprise. By managing the delivery of the right data to the right application at the right time you can ensure that everyone in your organization has the information they need to be successful.
End-to-end Workload Management with Tidal Enterprise Scheduler (TES) 6.2
With the release of TES 6.2, Cisco continues its leadership in workload automation (WLA) and job scheduling. With hundreds of in-production customers, running complex workloads for global trading exchanges, manufactures, health care providers and technology companies, Cisco TES has proven itself in some of the most demanding data centers in the world.
Already known and cited by analysts and customers for its ease-of-use, ease-of-installation, scalability and enterprise-wide visibility, Cisco TES 6.2 ships with major performance enhancements, added user management flexibility and greater infrastructure management reach. Enhancements in this release include:
Adapter for Cisco UCS Manager
The Enterprise Adapter for UCS Manager allows users to schedule UCS Manager component infrastructure jobs through Cisco TES so that users can leverage the scheduler’s capabilities to automate, simplify, and improve job scheduling and workload performance. The UCS Manager Adapter integrates with UCS Manager using the XML API and provides for the automation of UCS Manager activities for blade and rack-mount server management in the form of UCS Manager jobs. This allows you to control and manages server instances as part of an overall infrastructure and data processing workload management solution.
Job Definitions for Cisco UCS Manager
Lightweight Java Client
For power users who are managing thousands of workloads and their associated objects in their database, the Java client syncs data directly from the Master, but it is many times faster than the client manager because all data is stored in-memory on the Java VM rather than to an external database. Many interactions through the Java client will see marked increases in performance including smooth scrolling with zero latency and faster search and filtering.
Lightweight Java Client for TES 6.2
Flexible Security Feature
For large enterprises that segment globally or for any user who creates domains for their data center, Cisco TES now supports multi-domain coverage from a single client manager allowing greater flexibility and ease of use. And for greater runtime flexibility, Cisco TES allows users to associate runtime users to workgroups to be used while defining the workloads.
Cisco TES and Big Data
TES supports end-to-end workloads that include Big Data business processes. This release strengthens our support for Apache Hadoop, Cloudera as well as MapR. If you are traveling to San Jose for the Hadoop Summit next week stop by our booth (Cisco is a Platinum Sponsor) to see the latest Cisco solution designed specifically for the Hadoop platform. See Scott Ciccone‘s blog post for more details.
June 3-5, 2014 –San Jose, California
For more on the TES 6.2 release visit http://www.cisco.com/go/workloadautomation
Data Center blogs I follow:
Tags: Big Data, Cisco IT, Cisco UCS, Cisco Unified Management, inside cisco it, software, Tidal Enterprise Scheduler, unified management, workload automation
Hey data heads! O’Reilly Strata Conference kicks off tomorrow at the Santa Clara Convention Center. If you plan to go you better have tickets because the event is sold out.
If you are attending the three days of sessions, keynotes, receptions and exhibits, please stop by the MapR booth for some face time with one of our big data partners and plan to attend their sponsored panel discussion which includes Cisco IT and other MapR customers facilitated by Mike Gualtieri from Forrester Research.
Best Practices for Hadoop In Production
“Mike Gualtieri, principal analyst at Forrester Research, Inc., will engage a panel of production Hadoop users – including Cisco IT, The Climate Corporation, The Rubicon Project, and Solutionary – to discuss the challenges and best practices for deploying Hadoop in production. Join us for an engaging conversation on tips and tricks in deploying Hadoop in production. 10:40am, Wednesday February 12 in Ballroom H” See more here.
Representing Cisco IT will be Distinguished Engineer, Piyush Bhargava. Piyush is Chief Architect for Data Architecture & Innovation and is responsible for finding new ways of harnessing value from data and for designing architectures to support data processing, analytics & data science needs.
If you can’t make it to Strata Conference or are double booked during this time slot you can get the goods on this topic from a number of other sources.
- First, check out the webinar Cisco and MapR produced with Mike that highlights the Cisco IT case study. Mike outlines the 7 Best Practices for Productionizing Hadoop, MapR follows with their best practices for data tables and Cisco IT covers their big data use case. If you want to skip to the Cisco IT use case, it starts at 34:00.
- Then, take a look at my blog post on the Cisco IT big data platform success story. Cisco IT has standardized on Cisco UCS servers and fabric interconnects for its big data infrastructure and uses MapR for data tables.
For operational workloads, Cisco IT has standardized company-wide on Cisco Tidal Enterprise Scheduler with its unique set of adapters that include API integrations to MapR, Hive and Sqoop for big data workload processing.
- Next, spend some time reading the Unleashing IT Big Data Edition. This special edition of Unleashing IT is all about big data and highlights our joint Cisco/MapR customer Solutionary who incidentally, will join Cisco IT on the Strata Conference panel discussion on Wednesday. This e-zine is packed full of big data thought leadership; best practices for infrastructure and operations; customer success stories and include our partners Intel, MapR and others.
- Finally, peruse the Cisco big data website for all the latest on our solutions, partners, services and resources to help you make the best informed decision on moving your big data platform from development to production.
Big Data blogs I follow:
Tags: Big Data, Cisco IT, Cisco UCS, Cisco Unified Management, inside cisco it, software, Strata Conference, Tidal Enterprise Scheduler, unified management, workload automation
Check out our new “on-demand” webinar: Big Data Essentials: Don’t Let Your Sandbox Turn to Quicksand
What you will learn:
- How to manage data as an asset and transform data into business value.
- Why Big Data projects fail and how to avoid common pitfalls.
- How to optimize a Big Data supply chain.
- What infrastructure is required to run and automate data workload processing.
Big Data has become the next big thing, not only for the promise of finding the “needle on the haystack” of untapped revenues, but also for the possibility of uncovering and delivering exciting new business models.
For IT, Big Data can be both exciting and daunting: By delivering analysis from huge amounts of data more quickly than with existing Business Intelligence (BI) tools, data center managers can deliver new services to the business end users; daunting because researching, selecting, buying, staffing and managing Big Data tools sets pretty much demand a separate data center.
We invited our partner Informatica to share its knowledge on managing complex data supply chains have produced this webinar with insight from leading analyst firm Gartner, that will help you align how you think about your data and the infrastructure that it runs on.
By incorporating these the Big Data essentials into your planning you can prevent your sandbox from turning into quicksand and avoiding project delays and cost overruns.
This webinar consists of three parts:
Doug Laney, Research VP at Gartner for business analytics, begins with a lesson in Infonomics – managing data as an asset, and the skills required for Big Data analytics.
John Haddad, Senior Director Big Data Product Marketing at Informatica, explains how to turn these data assets into actionable information generating business value and developing a Big Data supply chain.
Ronnie Ray, Director Product Management for Cisco Cloud and Systems Management, completes the discussion by describing a Big Data infrastructure and operations platform that will exceed your business service levels.
Many of our customers already agree: Cisco is delivering Big Data infrastructure and data workload processing management with the Cisco Common Platform Architecture (CPA). CPA is based on Cisco Unified Computing (UCS), Unified Fabric, and Unified Management. The Cisco Big Data solution delivers:
Integrated Server Management
Cisco UCS unifies computing, networking, management, virtualization, and storage access into a single integrated architecture. It’s an ideal platform for Big Data applications.
Integrated Network Management
The same Cisco network architecture can serve both traditional applications and databases and Big Data processing solutions.
Integrated Data Processing Management
Cisco provides workload automation that manages the flow of data between a wide variety of applications into and out of your Big Data processing environments.
Read More »
Tags: automation, Big Data, Gartner, informatica, Tidal Enterprise Scheduler, workload automation
Like many IT organizations, Cisco’s internal IT department is deploying Big Data solutions to mine the ever-increasing data in-flow from a wide range of sources – and thus gain competitive advantage and insights.
The typical environment includes an ecosystem of different tools and data sources that looks something like this (image courtesy of @TorstenVolk):
Source: EMA Research
Cisco IT realized that as the demand for analysis of this data increased, the demands on their infrastructure and Day 2 operations management would likely grow exponentially. So they knew that they needed an enterprise-grade workload automation solution that could manage processes involving Hadoop, MapR, Cloudera, Informatica, Teradata, SAP HANA, BusinessObjects, Tableau as well as other analytics applications, data feeds and repositories.
Fortunately, we have a workload automation software solution – Cisco Tidal Enterprise Scheduler – that meets those requirements and more:
Read More »
Tags: Big Data, Cisco IT, Cisco Unified Management, inside cisco it, software, Tidal Enterprise Scheduler, unified management, workload automation