In our previous big data blogs, a number of my Cisco associates have talked about the right infrastructure, the right sizing, the right integrated infrastructure management and the right provisioning and orchestration for your clusters. But, to gain the benefits of pervasive use of big data, you’ll need to accelerate your big data deployments and make a seamless pivot of your “back of the data center” science experiment into the standard data center operational processes to speed delivery of the value of these new analytics workloads.
If you are using a “free” (hint: nothing’s free), or open source workload scheduler, or even a solution that can manage day-to-day batch jobs, you may run into problems right off the bat. Limitations may come in the form of dependency management, calendaring, error recovery, role-based access control and SLA management.
And really, this is just the start of your needs for full-scale, enterprise-grade workload automation for Big Data environments! As the number of your mission-critical big data workloads increases, predictable execution and performance will become essential.
Lucky for you Cisco has exactly what you need! Read More »
Tags: Big Data, Cisco IT, Cisco Unified Management, inside cisco it, software, Tidal Enterprise Scheduler, UCS, unified management, unlock big data, workload automation
Introducing New Adapter for Cisco UCS Manager, Lightweight Java Client, Multi-domain AD/LDAP Authentication & Runtime User Support for TES Workgroups
Managing and automating mission-critical business process is key to the success of your enterprise. By managing the delivery of the right data to the right application at the right time you can ensure that everyone in your organization has the information they need to be successful.
End-to-end Workload Management with Tidal Enterprise Scheduler (TES) 6.2
With the release of TES 6.2, Cisco continues its leadership in workload automation (WLA) and job scheduling. With hundreds of in-production customers, running complex workloads for global trading exchanges, manufactures, health care providers and technology companies, Cisco TES has proven itself in some of the most demanding data centers in the world.
Already known and cited by analysts and customers for its ease-of-use, ease-of-installation, scalability and enterprise-wide visibility, Cisco TES 6.2 ships with major performance enhancements, added user management flexibility and greater infrastructure management reach. Enhancements in this release include:
Adapter for Cisco UCS Manager
The Enterprise Adapter for UCS Manager allows users to schedule UCS Manager component infrastructure jobs through Cisco TES so that users can leverage the scheduler’s capabilities to automate, simplify, and improve job scheduling and workload performance. The UCS Manager Adapter integrates with UCS Manager using the XML API and provides for the automation of UCS Manager activities for blade and rack-mount server management in the form of UCS Manager jobs. This allows you to control and manages server instances as part of an overall infrastructure and data processing workload management solution.
Job Definitions for Cisco UCS Manager
Lightweight Java Client
For power users who are managing thousands of workloads and their associated objects in their database, the Java client syncs data directly from the Master, but it is many times faster than the client manager because all data is stored in-memory on the Java VM rather than to an external database. Many interactions through the Java client will see marked increases in performance including smooth scrolling with zero latency and faster search and filtering.
Lightweight Java Client for TES 6.2
Flexible Security Feature
For large enterprises that segment globally or for any user who creates domains for their data center, Cisco TES now supports multi-domain coverage from a single client manager allowing greater flexibility and ease of use. And for greater runtime flexibility, Cisco TES allows users to associate runtime users to workgroups to be used while defining the workloads.
Cisco TES and Big Data
TES supports end-to-end workloads that include Big Data business processes. This release strengthens our support for Apache Hadoop, Cloudera as well as MapR. If you are traveling to San Jose for the Hadoop Summit next week stop by our booth (Cisco is a Platinum Sponsor) to see the latest Cisco solution designed specifically for the Hadoop platform. See Scott Ciccone‘s blog post for more details.
June 3-5, 2014 –San Jose, California
For more on the TES 6.2 release visit http://www.cisco.com/go/workloadautomation
Data Center blogs I follow:
Tags: Big Data, Cisco IT, Cisco UCS, Cisco Unified Management, inside cisco it, software, Tidal Enterprise Scheduler, unified management, workload automation
Hey data heads! O’Reilly Strata Conference kicks off tomorrow at the Santa Clara Convention Center. If you plan to go you better have tickets because the event is sold out.
If you are attending the three days of sessions, keynotes, receptions and exhibits, please stop by the MapR booth for some face time with one of our big data partners and plan to attend their sponsored panel discussion which includes Cisco IT and other MapR customers facilitated by Mike Gualtieri from Forrester Research.
Best Practices for Hadoop In Production
“Mike Gualtieri, principal analyst at Forrester Research, Inc., will engage a panel of production Hadoop users – including Cisco IT, The Climate Corporation, The Rubicon Project, and Solutionary – to discuss the challenges and best practices for deploying Hadoop in production. Join us for an engaging conversation on tips and tricks in deploying Hadoop in production. 10:40am, Wednesday February 12 in Ballroom H” See more here.
Representing Cisco IT will be Distinguished Engineer, Piyush Bhargava. Piyush is Chief Architect for Data Architecture & Innovation and is responsible for finding new ways of harnessing value from data and for designing architectures to support data processing, analytics & data science needs.
If you can’t make it to Strata Conference or are double booked during this time slot you can get the goods on this topic from a number of other sources.
- First, check out the webinar Cisco and MapR produced with Mike that highlights the Cisco IT case study. Mike outlines the 7 Best Practices for Productionizing Hadoop, MapR follows with their best practices for data tables and Cisco IT covers their big data use case. If you want to skip to the Cisco IT use case, it starts at 34:00.
- Then, take a look at my blog post on the Cisco IT big data platform success story. Cisco IT has standardized on Cisco UCS servers and fabric interconnects for its big data infrastructure and uses MapR for data tables.
For operational workloads, Cisco IT has standardized company-wide on Cisco Tidal Enterprise Scheduler with its unique set of adapters that include API integrations to MapR, Hive and Sqoop for big data workload processing.
- Next, spend some time reading the Unleashing IT Big Data Edition. This special edition of Unleashing IT is all about big data and highlights our joint Cisco/MapR customer Solutionary who incidentally, will join Cisco IT on the Strata Conference panel discussion on Wednesday. This e-zine is packed full of big data thought leadership; best practices for infrastructure and operations; customer success stories and include our partners Intel, MapR and others.
- Finally, peruse the Cisco big data website for all the latest on our solutions, partners, services and resources to help you make the best informed decision on moving your big data platform from development to production.
Big Data blogs I follow:
Tags: Big Data, Cisco IT, Cisco UCS, Cisco Unified Management, inside cisco it, software, Strata Conference, Tidal Enterprise Scheduler, unified management, workload automation
Let’s talk about Cisco Process Orchestrator. We recently released version 3.0 — and there are a lot of exciting features that have been introduced with this new release of our IT Process Automation (ITPA) / Run Book Automation (RBA) software.
Cisco Process Orchestrator is the foundational engine on which Cisco has built a number of data center-, application-, and network-focused automation solutions. These include our cloud management solution (Cisco Intelligent Automation for Cloud), which embeds this orchestration engine for cloud service automation and helps organizations deploy private, public, or hybrid clouds; an SAP-focused solution resold by SAP (SAP IT Process Automation by Cisco), which lowers TCO of your SAP applications and databases by integrating events and alert management data with incident response information; and a network troubleshooting and triage solution, which helps customers manage repetitive tasks and aids remediation of common issues with network operations.
In this post, I’m going to feature a few of the major highlights of the new version 3.0 release:
- A new service-oriented methodology for service encapsulation: design workflows that match to the service ordered by the business units
- Flexible automation packs and solution accelerators: build, version, re-purpose content to drive solutions
- Service automation integrated with Cisco Prime Service Catalog: optimizing the end-to-end service delivery process
Building ITPA and RBA workflows has never been easier. With Cisco Process Orchestrator‘s service-oriented orchestration you can move away from traditional static, script-based run-book automation and IT process-level automation. We have built a modeling platform where automation aligns with the highest-level services and allows you to model IT service the way that a high-level service is delivered.
A shift from static workflow design to dynamic, service-oriented design
In this “top down” approach, designing the services and their desired state is the initial step in automation design. The next step is defining the process actions for these services and then implementing the specific process workflows that traverse traditional IT boundaries to act on and automate the necessary elements to deliver the service.
Read More »
Tags: Cisco Intelligent Automation for Cloud, Cisco Network Operations Automation Service, Cisco Unified Management, cloud, Cloud Management, data center, intelligent automation, network automation, process automation, run book automation, SAP IT Process Automation, Service Orchestration, unified management
Like many IT organizations, Cisco’s internal IT department is deploying Big Data solutions to mine the ever-increasing data in-flow from a wide range of sources – and thus gain competitive advantage and insights.
The typical environment includes an ecosystem of different tools and data sources that looks something like this (image courtesy of @TorstenVolk):
Source: EMA Research
Cisco IT realized that as the demand for analysis of this data increased, the demands on their infrastructure and Day 2 operations management would likely grow exponentially. So they knew that they needed an enterprise-grade workload automation solution that could manage processes involving Hadoop, MapR, Cloudera, Informatica, Teradata, SAP HANA, BusinessObjects, Tableau as well as other analytics applications, data feeds and repositories.
Fortunately, we have a workload automation software solution – Cisco Tidal Enterprise Scheduler – that meets those requirements and more:
Read More »
Tags: Big Data, Cisco IT, Cisco Unified Management, inside cisco it, software, Tidal Enterprise Scheduler, unified management, workload automation