Data governance & compliance

Data quality governance: definition, models, and strategy

A dashboard displays conflicting data. Sales reports three thousand new accounts this quarter, whereas finance reports twenty-six hundred. Organisations do not aim to create two versions of the same fact, but this is a common outcome. This is the inconsistent data that an AI model will learn from if it is not corrected.

Data quality governance connects the measurement of data accuracy and consistency across systems with the ownership and rules needed to maintain those standards. If you perform quality checks without a governance structure, staff will disregard the resulting reports. If you establish governance without quality metrics, you cannot assess whether the system is effective.

A single problem described in two words

Data quality governance is made up of two linked components that work best when they are integrated. Quality represents a particular measurement. It assesses whether a dataset reflects reality, includes all required information, and stays consistent across various systems. Governance provides the framework that preserves these measurements over time. It defines who owns the data, sets rules, and designates the individual accountable for fixing errors. Conducting quality checks without governance results in reports that no one uses. Establishing governance without quality metrics creates a committee unable to gauge its own progress.

Shipshape constructs data foundations for AI. We often notice a particular gap in the way organisations manage their data. A client might finish a data quality project by cleaning a table and eliminating duplicates. Nevertheless, the table frequently becomes disorganised again within six months. This occurs because no owner is assigned and no system exists to monitor changes. Data quality cannot be sustained without a governance framework.

The two approaches fail in distinct ways. A team that has strong governance but weak quality checks will conduct documented meetings concerning incorrect data. A team with good quality checks but lacking governance will spot problems they cannot resolve because no one possesses ownership or authority to apply a fix. Both elements need to operate together. Otherwise, you are merely organising documentation for a problem that stays unsolved.

Why bad data breaks AI before it ships

Models learn your mess, not your intentions

When you feed a model inconsistent customer records, it does not fix the errors. Rather, it interprets the inconsistency as a pattern to be followed. If your product descriptions have errors, a classification model trained on them will incorporate those errors. It will then propagate them throughout your operations far more quickly than a human employee. Teams frequently underestimate this danger. A spreadsheet containing a few incorrect rows is a small issue. However, once those identical errors appear in a training set, they dictate how the model will interpret every future datum.

We saw this scenario with a client whose sales team and inventory team used different codes for the identical product line. This remained hidden because each team's reports were internally consistent. When the two data feeds were merged into one model, the predictions turned inaccurate. It took three weeks of joint debugging to uncover a labelling mismatch that standard governance would have prevented right away.

If governance is not used to standardise definitions and enforce quality rules, a model will learn from contradictory data. It then reflects those same contradictions in its output.

Production needs someone who can say no

Moving from a pilot project to a production system demands that responsibility for particular risks be assigned before those risks cause incidents. Organisations need to identify who validated the training data, who will monitor the model for drift after deployment, and who holds the authority to disable a model that generates incorrect outputs. Many organisations fail to assign these roles ahead of time. As a result, they frequently develop these processes during a system outage, which is an ineffective moment to set up procedures. Data quality governance defines these roles, escalation paths, and approval processes prior to model deployment.

Successful organisations typically operate a small governance group that includes representatives from data engineering, business departments, and compliance. It is not a passive committee. The group sets standards and continues to meet regularly after the project launches.

People use the product because they trust it

No one acts on a recommendation they do not trust, and trust in an AI output derives from the ability to trace it: which data fed the prediction, how current that data was, and whether anyone has checked it recently. This is a straightforward lineage problem, and it is worth doing properly. Teams that can demonstrate their work see people use the model's output rather than quietly overriding it and reverting to gut feel, which defeats the purpose of building the system entirely.

Creating a functional governance framework

A governance framework is not a collection of policy documents. It consists of a few decisions that are made once and applied consistently. These decisions define the standards for data quality, identify the owner of each dataset, and establish the consequences when data fails to meet those standards.

Start from a cost, not a theory

Do not start by designing an organisational structure for a "data governance function." Instead, identify specific areas where poor data quality results in lost time or financial waste. You might find that the sales team manually reconciles customer records for several hours each week. You might discover that inventory forecasts are inaccurate because two separate systems use different classification methods for the same product. Use these specific issues as your initial focus. A clear and documented cost is the most effective way to ensure a governance programme receives funding beyond its first year.

Identify the specific quality dimension that causes the pain point. Reconciliation problems usually result from inconsistent identifiers. Forecasting failures are typically caused by incomplete or outdated product attributes. You must name the actual cause instead of saying "our data is messy," to turn a governance request into a proposal that a budget owner will approve.

Assign an owner to every dataset

Every important dataset must have a specific owner. This person needs the authority to require fixes and the responsibility to ensure they occur. When a task is assigned to everyone, it often results in no one completing it. Data stewards require two things to be effective. They must have the authority to prevent a record from being sent if a field is incomplete, and they must be held accountable if the data remains incorrect.

Stewards should work with others rather than operating by themselves. A governance council provides a place to resolve conflicts and agree on standards. This council should include representatives from IT, compliance, and the business units that use the data. The group does not have to meet weekly. However, meetings must happen frequently enough to ensure that quality issues are not left unaddressed for several months.

Establish measurable thresholds

"High quality data" is a subjective feeling rather than a specific target. A target consists of measurable goals. Examples include keeping customer records 98 per cent complete on the fields that sales staff use, refreshing pricing data within 24 hours of the source system, and maintaining duplicate account IDs below a set threshold. These are figures that a data steward can review on a Monday morning to determine immediately if the work is on schedule.

Automate these checks to notify the steward if a value decreases. Maintain a trend line to identify gradual declines before they become significant problems. A governance framework that connects to business results and uses automated monitoring will improve consistently. A framework based only on intentions is typically reviewed once a year, often after a failure has occurred.

Three ways to structure governance

The structure of governance authority is as important as the standards you set. The correct approach depends on the size of your organisation and the level of variation between your business units.

Centralised

A single team establishes the rules for the entire organisation. This includes data quality definitions, master data, and enforcement. This model is common in banking and healthcare, where consistency and audit trails are more important than the preferences of individual departments. Standards remain uniform across the company. Conflicts between departments are reduced because there is only one definition of a customer. The central team develops deep expertise because governance is their primary responsibility.

The cost is speed.

Centralised teams lack the specific knowledge that departments have regarding their own data. Requests from these departments are often delayed because they must wait for the central team to complete its existing tasks.

Federated

Business units own their own data. Sales manages customer information, operations manages inventory, and finance manages the ledger. A small coordinating group establishes general rules and resolves conflicts between departments. This model is effective for large and diverse organisations because domain experts understand their specific data better than a central team. These experts can identify and fix quality issues on the day they occur.

The risk is fragmentation.

If a coordinating body lacks actual authority, "everyone doing their own thing," and the system becomes fragmented. Six months later, it is impossible to combine sales and finance data without building a translation layer.

Hybrid

Most organisations that achieve this result do so without a specific plan. Customer and product records, which are used by everyone, are managed under central control. Operational data that is specific to one team remains with that team. This data is governed by a shared framework that the central department defines but does not manage in detail.

Hybrid work requires explicit boundaries. You must document which items are centrally managed and which are not. You also need to provide a specific process for resolving ambiguous cases. These cases will occur, and governance fails when boundaries remain undefined.

Best fit: centralised suits regulated, uniform estates; federated suits large organisations with genuinely different business units; hybrid suits most mid-size and large companies, once they have the discipline to write the boundary down. Watch for: revisit the model as the company grows. A structure that worked at 200 people rarely survives a merger untouched.

The quality dimensions that should be measured

Quality dimensions vary in importance depending on the dataset. You should identify the two or three dimensions that most affect your specific decisions and measure them accurately.

Accuracy and completeness

Accuracy indicates that the data reflects reality. This involves confirming that an address is correct, a price is up-to-date, and a transaction amount matches what was actually paid. Completeness indicates that essential fields are populated and the dataset includes every required record. A dataset may be complete yet contain errors, or it may be accurate but lack many rows. You ought to define completeness for each dataset according to its particular use instead of applying a generic template.

Consistency across systems

Customer data needs to stay consistent across every system. When a company appears as "ABC Corporation" in the CRM and as "ABC Corp" in the billing software, staff must manually reconcile the entries. This procedure consumes several hours each month until the data is corrected. Applying standardised formats for names, dates, and identifiers stops these errors from happening.

Ensure that data is consistent inside a single dataset and across all linked systems. A product code must denote the same item in the warehouse, the sales system, and the finance system. Pinpointing where these definitions diverge enables a swift correction. If these discrepancies are not detected early, they frequently lead to investigations lasting several weeks.

Timeliness and validity

Timeliness indicates whether data reflects current conditions or past periods. Outdated inventory numbers do not help in fulfilling current orders. Likewise, a price quote derived from data from the previous quarter will probably need correction later. You ought to set data refresh schedules according to the real rate of change in the business environment instead of the convenience of the processing schedule.

Validity indicates that data adheres to its defined rules. For instance, an email address must include an @ symbol, a date must correspond to an actual calendar day, and a quantity cannot be negative unless the business permits that specific value. Employing automated validation at the point of data entry prevents most errors from entering the system.

Where governance programmes stall

Getting departments to agree

Each department presents a logical case for how data ought to be organised. Sales needs records that enable relationship tracking. Marketing requires particular fields for segmentation. Finance places priority on billing accuracy. Every team holds a valid viewpoint grounded in its specific goals. To roll out a standard, you should show how consistency lowers the workload for each group instead of arguing which department has the most important needs. Sales will encounter fewer duplicate accounts, marketing will enjoy cleaner segments, and finance will encounter fewer billing disputes. Teams adopt governance when it offers them relief. They do not adopt governance when it is framed as an extra administrative task.

Knowing when to automate and when to look closer

Automated checks handle large volumes of data efficiently but cannot detect subtle errors. An address may satisfy all formatting rules yet still be incorrect if the postcode exists but the building does not. A product description can comply with every completeness rule while still delivering misleading information. You ought to determine which data categories need a person to review flagged issues and which can be handled automatically. Making these decisions ahead of time prevents a data steward from having to select a course of action for each individual flag.

Managing performance as data volume increases

Data sources grow faster than governance staff. New systems, integrations, and acquisitions generate quality issues that current rules do not address. A governance team built on prior data requirements will eventually fall behind. The remedy is to employ self-service methods instead of hiring additional staff. You ought to supply templates, automated tests, and documentation that enable teams to meet standards on their own. This method eliminates the need for a central reviewer to approve each field. These tools enable a governance department to handle expanding data sets without a proportional rise in headcount.

Surviving the departure of whoever started it

Most governance programmes begin when a particular person, for example a data lead or a head of analytics, chooses to tackle recurring reconciliation issues. These programmes usually work well while that person stays involved. When that individual moves to a new role or departs the organisation, enforcement often drops because other staff members lack the same sense of ownership. You ought to embed standards in job descriptions, onboarding processes, and technical tools instead of depending on a single person's schedule. This makes sure the programme persists even after a resignation.

Turning governance into money

Governance is effective when it enhances existing business metrics. This includes cutting the time spent reconciling records, raising the number of AI pilots that reach production, and lowering reliance on intuition instead of untrusted dashboards. You do not have to create new metrics specifically for governance. The results show up in your current data once that data is consistent and accurate.

The fastest AI rollouts happen at organisations that treat the data foundation as the primary project. These companies do not treat data as an afterthought to be handled after building the model. This stage of the work is not high profile and does not usually appear in case study screenshots. However, our experience shows that this foundation decides whether the rest of the project works correctly when using real data.

If you want a clear picture of where your own gaps are before you commit to a platform or a policy document, talk to us. We would rather spend an hour telling you what your data needs than watch another AI pilot stall for a reason that was fixable eighteen months earlier.

If you are currently addressing this issue on your roadmap, our data consultancy offers services for this specific task. We start by demonstrating the capabilities of your existing data.

Frequently asked questions

What are the differences between data governance and data quality?

Quality measures whether data matches reality, is complete, and stays consistent across different systems. Governance is the framework that maintains these measurements over time. It defines who owns the data and sets who is responsible for correcting errors. This article explains how these two functions fail in different ways if only one of them is implemented correctly.

Does data governance include data quality?

The article describes these two concepts as closely related but separate. A team with strict governance but poor quality checks will document meetings about incorrect data. A team with good quality checks but no governance will identify problems that they lack the power to resolve. Both elements must work together for the process to be effective.

What is data governance?

In this article, data governance is the system of ownership, rules, and procedures that maintains data quality over time. It defines who is responsible for each dataset and what actions are taken when data falls below an established standard. Data governance prevents a corrected table from becoming inaccurate again after a period of time.

What are the responsibilities of data governance roles?

The article states that data stewards require authority to ensure fields are completed before records are sent. They also require accountability if these tasks are not finished. These stewards work on a governance council with representatives from IT, business units, and compliance. The purpose of this council is to resolve disputes instead of simply approving decisions.

How do you define the quality of data governance?

This article evaluates quality through several specific categories. These include accuracy and completeness, the consistency of records across different systems, and timeliness, which determines if data reflects current or historical states. The author suggests selecting two or three categories that influence actual business decisions. This approach is more effective than scoring every metric, which often prevents clear prioritisation.

Start at your core.

Tell us where your data is today and what you want AI to do. We'll come back with a straight answer on what your foundation needs and where the quickest real win is.

Talk to us