[ad_1]
Unwelcome…
… are platform instability, downtime, {hardware} failure, poor efficiency, cluster useful resource rivalry, repeated course of failures, runaway dwell queries, crucial companies alarms, invisibility into alarm cacophony… the listing goes on. If these are illnesses you wish to treatment …
Welcome!
To this six-part sequence, the place we’ll take a look at tips on how to get management of the well being of your Cloudera Knowledge platform (CDP) atmosphere. Out of the field, CDP performs beautifully, however over time, if information structure, information engineering, and DevOps finest practices usually are not maintained, the Knowledge Metropolis you’ve erected atop a stable CDP bedrock can turn into the wild, wild, west. Maybe it’s time for some legislation and order to forestall additional crimes towards the tech.
Greater than a case research, we’ve interwoven finest practices gleaned from a number of configurations and consumer websites right into a complete, simple to grasp set of directions to diagnose and resolve lots of the points that adversely affect CDP environmental well being.
With every weblog we’ll define the signs and root causes of widespread environmental well being challenges and prescribe options. The place we are able to, we’ll embrace worthwhile hyperlinks to step-by-step directions to information you thru profitable implementation. After we conclude the sequence, we’ll share a homegrown software, an environmental well being scorecard, to observe and handle the well being of your atmosphere.
There are numerous, many causes that an atmosphere could carry out poorly, and definitely some resolutions take effort and time, however there’s fairly succulent low hanging fruit. Our nice hope is that you just discover impactful fast wins that encourage you to pursue a number of avenues of well being enchancment. You might also determine to associate with our Cloudera Skilled Companies staff who greater than doubled a buyer’s well being rating in two quick quarters.
Classes of CDP Environmental Well being
We’ve categorized facets of environmental well being for this sequence.
Visibility and Transparency
Into the cluster, platform, companies, and processes. We received’t be capable to make a lot progress if we do not need correct visibility into the issues. That’s observability. On this weblog we offer directions and instruments on tips on how to acquire visibility, suppress alarm noise, discover and analyze the foundation causes of essentially the most vital alternatives, and proactively notify your customers when incidents happen
Knowledge Asset Standardization
Of widespread datasets, pipelines, processes, and reviews. Admittedly, information asset standardization is a multiyear journey; however, addressing solely your most problematic and resource-intensive processes and property could yield extra environmental well being enchancment than some other class. We’ll share finest practices on tips on how to find and capitalize on these alternatives.
Platform Well being
Consists of {hardware} and companies settings and configurations. Cloudera Knowledge Platform (CDP) should be configured correctly to perform effectively with excessive efficiency. Moreover, as enterprise wants regularly change, so will your use of the platform, and that may necessitate re-tuning. That can assist you on that journey, we’ll listing some widespread signs, hyperlink them to root trigger evaluation steps, present correct configuration pointers, and description the steps to correctly tune your atmosphere.
The Proper Instrument for the Job
Consists of the correct use of Impala, CDSW, Airflow, Nifi, and CM. You could be shocked on the antagonistic environmental affect of utilizing CDSW as an ETL pipeline software or utilizing Impala to put in writing unwieldy queries with an embarrassing variety of joins. We’ve executed it too. We confess. We’ll spotlight some great benefits of utilizing Airflow to handle complicated information pipelines with its facility to divide workflow into small impartial duties. We’ll listing different do’s and don’ts.
Environmental Well being Scoring
Brings all of it collectively by demonstrating tips on how to measure, rating, monitor, and management environmental well being via dashboards that we offer for you together with directions to hook them as much as your logs.
If you happen to’ve acquired the signs, the docs are in. Let the therapeutic start!
[ad_2]