Home Big Data One Massive Cluster Caught: Setting Well being Scorecard

One Massive Cluster Caught: Setting Well being Scorecard

0
One Massive Cluster Caught: Setting Well being Scorecard

[ad_1]

What We’ve Coated

All through the One Massive Cluster Caught collection we’ve explored impactful greatest practices to realize management of your Cloudera Knowledge platform (CDP) setting and considerably enhance its well being and efficiency. We’ve shared code, dashboards, and instruments that can assist you in your well being enchancment journey. We’d like to supply one final device.

The Environmental Well being Scorecard

We observe setting well being on the macro degree with a dashboard that mirrors our weblog collection methodology with a couple of additions. We set quarterly OKR (Aims and Key Outcomes) targets to enhance our rating.

At decrease ranges of grain our measurements are data-driven and automatic, however on the macro degree we choose to use some subjectivity (after all our weightings will differ from yours as we’re on a distinct journey). Our information and analytics leaders meet month-to-month to guage our well being enchancment and log subjective measures. Some could name that anecdotal proof however we worth the pairing of our data-driven evaluation with our observable actuality. 

Platform Well being 

All of it begins with platform well being which we selected to measure in 3 dimensions: {hardware} efficiency, providers efficiency, and optimum configuration/tuning. We supplied dozens of how-to manuals to acquire visibility and tune your setting

Is it shocking that we weighted platform well being solely an 8 on a 100 level scale? Our mannequin considers the length and useful resource dedication required to finish 80% of the journey, and since our platform optimization took just a few assets a couple of months, we weighted it low. When you’ve received a multiyear platform journey forward of you, you’ll weigh it extra closely.

NOTE: The Optimally configured quantity is only a depend of tunings we accomplished, and the chances are subjective evaluations.

Visibility and Transparency

Weighted a 20?! Yup. It’s that vital to us as now we have written. We selected separate measures for our personal jobs and our customers’ jobs. With 100% monitoring, alerting (notifications to DevOps), and notifications (to our clients), why didn’t we earn a 20? As a result of we weren’t as proactive in resolving points as our OKR targets indicated we must be.

Knowledge Democratization 

Though we didn’t weblog about information democratization, we discover it an vital measure of environmental well being. Each different measurement is meaningless if essential information components are unavailable to determination makers. By the way, this measure is within the reverse seat of the see-saw because the others: ungoverned information democratization is the one best reason for all the issues we’re attempting to affect. Take into consideration that.

Knowledge Course of Well being

Though we didn’t commit a weblog to this well being measure, we supplied quite a few directions to restore issues you discover. The targets we selected within the dashboard are vital to us, however select these which might be vital to you. The person scores are counts however the total well being rating isn’t a sum, it’s subjective. This can be a multiyear journey.

Knowledge Asset Standardization

This measure will get our highest weighting at 25 out of 100. The well being of the setting is most depending on the belief that customers have within the information. The better your information observability, and the better the quantity that’s accessed by way of enterprise commonplace dashboards and governance-certified sources of fact, the better the chance for belief. The belief develops by means of an understanding of the information as maintained by means of metadata in your Knowledge Catalog: classification, lineage, foreign money, and enterprise context . You possibly can see that we did nice on report standardization however now we have longer to go to certify our enriched datasets and information marts, and to repipe our customers’ belongings. One other multiyear journey.

Knowledge High quality & Knowledge Governance Extensibility

Like information standardization this goes to the guts of trusted information. We’ve 37 whole well being factors measuring information trustworthiness. Which will appear counterintuitive when utilized to an environmental “well being” measure, however that’s how we see it. You might even see these and different measures in a different way.   

Better of Luck!

We smile on the risk that we would have enabled you to be extra environment friendly or succesful (or each!). Go to our Group Web page, our blogs, and Knowledge and IT Leaders web page for a lot extra.

[ad_2]