Data governance & compliance

Compliance automation: controls as code and continuous evidence

Three days prior to the SOC 2 renewal, the compliance lead examined eight months of Slack messages to locate the access review said to have been completed in March. The review indeed took place, and it was carried out by someone. However, the evidence consists of a partial screenshot in a direct message, and the auditor demands a dated, exportable record rather than a recollection. By Thursday night, the team had rebuilt six months of controls evidence using email threads, ticket comments, and a spreadsheet that someone kept "just in case." The audit succeeded. No one wants to repeat that process, and everyone will, because the way the controls operate has not changed.

Compliance automation involves using software to apply controls in real time and to record those actions. This approach guarantees that evidence can be provided whenever it is asked for. A policy mandating quarterly access reviews merely states an intention. A script that carries out the review and logs the timestamped outcome turns compliance from an annual task into an ongoing operational activity.

Compliance automation employs software to apply controls in real time and to log the outcomes. This guarantees that evidence can be provided whenever it is asked for. A policy document that says access is reviewed quarterly is not the same as a script that carries out the review, flags exceptions, and logs a timestamp. Counting on the assumption that encryption is active differs from deploying a monitor that continuously checks the status and issues an alert when encryption is disabled.

Shipshape Data constructs data and AI systems for its clients. We regularly notice that organisations treat compliance as an annual event instead of a standard operating condition. They set up a framework and gather screenshots for an auditor, yet the controls lose effectiveness after the audit concludes. This situation persists until the next audit cycle starts. This guide clarifies the definition of compliance automation and the role of controls as code. It outlines how continuous monitoring uncovers issues that periodic checks overlook. It also details why the evidence trail outweighs the control and points out where human judgement is still required.

The reasons behind the recurring rush

Most compliance programmes treat the audit as the main event. Preparation occupies the period before an audit, while recovery occupies the period after. Nevertheless, risk does not adhere to an annual timetable. A misconfigured storage bucket can happen at any moment. In the same way, an employee who departs the company may keep access for six weeks if a manual offboarding checklist is not finished.

Point-in-time checks tell you about one point in time

When a control is verified quarterly, it only reflects the condition of the world on the day of that check. It gives no insight into the eleven weeks preceding or following that date. We have assisted clients whose access reviews looked correct in March yet still had four former employees with active accounts in June. This occurred because the review was a snapshot, and changes kept happening after it was completed. On paper, nobody had failed their duties. The review was conducted, someone signed off on it, and the requirement was satisfied. The gap between being "compliant on paper" and being "compliant right now" is where most real incidents happen. A calendar reminder cannot bridge this gap no matter how often it is set.

Evidence gathered after the fact is evidence you can't fully trust

When you collect evidence after the fact from memory, emails, or screenshots that an auditor requests, you are rebuilding a record rather than reading an existing one. Rebuilt records have gaps. The individual who fills those gaps often does so in the company's favour. This occurs because people usually assume the information was correct. It is not caused by deliberate dishonesty. A control that logs itself prevents this issue. The log indicates if the control ran or did not run. This claim is straightforward. Automated evidence is more honest because it removes the opportunity to improve the story. It is not more honest because software possesses more virtue than people.

What compliance automation actually means

Compliance automation is made up of two parts. The first part consists of controls that operate actively rather than being merely written descriptions. The second part demands a record of those actions that stays accessible and accurate for a minimum of eighteen months.

It differs from governance and does not substitute for it

Data governance sets the rules and names the people accountable for them. Compliance automation is the mechanism that implements those rules in everyday operations. In the absence of automation, rules stay in policy documents that are seldom revisited after being approved. Staff still need to determine that customer data must be encrypted at rest, that access adheres to the principle of least privilege, and that data subject requests are handled within defined time limits. Automation turns those decisions into scheduled processes that track status and issue alerts when requirements are not met.

Its three functions

The system automatically applies controls, relieving staff from having to recall them. It continuously monitors the status of those controls rather than waiting for periodic reviews. It also logs each check, pass, and failure. Auditors, regulators, and risk committees can directly access these records without requiring staff to rebuild the data. Most available tools provide these three functions to some degree. Only a few tools execute all three functions well. Most organisations ought to concentrate on correctly implementing one function before tackling the others. We prefer a client to fully automate evidence collection for two controls rather than buying a platform that claims all three functions for forty controls yet remains unconfigured beyond its default settings.

Controls as code: writing policies for machine verification

The phrase sounds grander than the work.

Controls as code means taking a requirement such as "production databases must not be publicly accessible" and converting it into a rule that a system can evaluate. This process transforms the requirement from a line in a document that a person must recall into an automated check.

Practical application

Cloud security posture tools examine infrastructure configurations to detect violations of written policies. These tools highlight issues like open ports, unencrypted buckets, or roles with excessive permissions. Under GDPR, a rule can check that personal data fields contain the required retention tag and notify staff if a new table is missing it. This process employs standard engineering methods. It usually involves a policy-as-code framework applied to infrastructure already defined in code. Automated control checks need the system to be described in a machine-readable format.

The catch nobody mentions in the sales deck

Writing a control as code requires a level of precision that original policy documents often lack. A statement like "Access should be reviewed regularly" cannot become a functional rule until someone defines the specific number of days, identifies the reviewers, and determines the consequences for late reviews. This decision-making process is typically more difficult than the engineering work. Most organisations avoid these discussions by keeping their policies vague. Implementing these controls correctly reveals every ambiguity in current compliance documents. This process is uncomfortable, but it is the primary goal of the task.

Best for organisations with infrastructure already defined in code (Terraform, CloudFormation, similar) and a small number of clear, checkable rules to start with, access controls and encryption settings being the easiest wins. Watch for: teams that jump straight to buying a policy-as-code platform before anyone has agreed what the policies say in unambiguous terms. The tool will happily enforce a rule that's wrong, and it will enforce it consistently, which only makes the mistake worse.

Continuous monitoring: catching drift before someone else does

A security control that is configured correctly on Monday may become incorrect by Wednesday. A system patch might accidentally open a port. A new employee might be added to a group with excessive access because copying a colleague's permissions was the fastest way to grant them entry. Configuration settings change over time. This process is constant. You must determine if you will identify these changes this week or during an audit next year.

What gets monitored

Access and permissions are the most important items to review because privilege creep is the most common finding in our audits. Encryption status for data at rest and in transit is also a priority. Logging coverage is another critical area. A system that stopped sending logs three weeks ago represents a control failure even if no other changes occurred. Quarterly reviews often miss this type of failure because reviewers frequently neglect to verify that the monitoring systems are still functioning correctly.

Alert fatigue is the actual failure mode, not the missing tool

Continuous monitoring presents a behavioural challenge rather than a technical one. If a team enables every rule at the highest sensitivity level, they will receive hundreds of alerts daily. Within two weeks, the team will stop checking the dashboard, causing them to miss critical alerts among the high volume of notifications. It is more effective for a client to begin with fifteen specific rules that require immediate action than to use two hundred rules that no one has the time to review. Monitoring that produces ignored data is the same as having no monitoring, but it is more expensive and provides a false sense of security.

Evidence collection and audit trails: the part that saves you

Auditors do not rely on verbal assurances that a control is functional. They require physical or digital evidence to verify it.

Evidence collection is the process of capturing proof automatically when a control operates. This method replaces the practice of gathering documentation manually during the week before a review.

The characteristics of high-quality evidence

A timestamped log entry shows when an access review occurred, which accounts were flagged, and the outcome for each account. Records of configuration changes to production systems identify who made the change and when it happened. Documentation for data subject access requests proves that the request was received, completed within the deadline, and sent to the correct recipient. These administrative tasks are not interesting, but they determine the length of an audit. Without this evidence, an audit can last two weeks instead of one afternoon and require three employees to stop their regular work to search for missing information.

Tracking the origin of evidence is as important as possessing the evidence itself. In a compliance context, data lineage provides this function. When an auditor asks "how do you know this field was encrypted", they require a traceable record rather than a simple assurance.

An audit trail nobody built on purpose is a trail somebody will have to build under deadline, from memory, right when it matters most.

This part of the process is difficult

It is easy to collect evidence for processes that occur within systems with built-in logging. The task becomes more difficult when a control relies on a human decision made outside of a system. Examples include verbal approvals in meetings, judgements made in email threads, or exceptions granted to meet tight deadlines. These decisions are important and difficult to automate. You must use a deliberate process to capture these actions so they are recorded properly.

What still needs a human, and why the honest answer is quite a lot

These tools do not replace the need for human judgement. Any vendor who claims they do is being dishonest. Automation can effectively verify if a rule was followed, but it cannot determine if that rule was appropriate or if an exception should be made.

Interpretation is still a person's job

Whether a specific data-sharing arrangement satisfies a regulator's expectation of "appropriate safeguards" under GDPR is a legal judgement, not a boolean. A tool can check that a data protection impact assessment exists and was signed off within the required timeframe. It can't tell you whether the assessment itself was any good, or whether the risk it accepted was acceptable. That still needs someone who understands both the regulation and the business well enough to weigh the two against each other, and it needs that person to have read the assessment rather than skimming the summary and signing where indicated.

Exceptions need a person who can say no

Control systems eventually encounter situations that their rules did not anticipate. For example, a vendor might require emergency access outside of standard approval hours because a production system fails at 2:00 a.m. The established rule forbids this access, but the business loses money for every minute the outage continues. A person must evaluate these facts and take responsibility for the final decision. Monitoring platforms should not make these choices without supervision, even if it is tempting to allow a system to automatically approve requests below a specific risk score to reduce alerts.

Best for teams who use automation to clear the routine ninety per cent of checks so the compliance function has time to think about the remaining ten per cent. Watch for: treating a clean automated dashboard as proof the organisation is compliant. A green dashboard means the rules you wrote are being followed. It says nothing about whether you wrote the right rules, and that question never automates away.

Where to start

Do not try to automate every process at the same time. You should not begin with the framework that appears most impressive in presentations. Instead, start with the specific control that causes the most difficulty during each audit cycle. Focus on the task that staff find most difficult to collect evidence for. Automating these areas provides the fastest return on investment and demonstrates the value of further automation to those who manage the budget.

Select one control and set it up to enforce its own rules and record its own evidence. Use this completed control as a model for the next one. Access reviews and encryption checks are often the simplest to automate because the systems involved already generate the necessary signals. Additionally, staff usually remember the difficulty of performing these tasks manually during previous audits. Controls that require human judgement, such as those discussed in emails or meetings, require a specific approach. These need a simple method for recording decisions and their justifications rather than a complex dashboard. Writing a one-sentence explanation of a decision when it occurs in a searchable location is more effective than using a tool later to try to explain why an exception was allowed.

Compliance automation does not eliminate the requirement for personnel who grasp regulations, business operations, and the way they intersect. Rather, it removes tasks that are not central to compliance, for example searching old communications to locate evidence of past events. If you devote excessive time to recreating evidence each audit cycle, or if you are unsure which of your current controls can automate their own enforcement and logging, talk to us. We would rather help you create a permanent record than watch you rebuild it annually.

If your team is seriously evaluating this, our data consultancy will plainly explain what it depends on and how to begin.

Frequently asked questions

What is compliance automation?

Compliance automation is software that applies a control when needed and records the action. This system does not depend on policy documents that are seldom verified. It carries out three functions: automatically enforcing the control, continuously monitoring the control's status, and logging each check. This process guarantees that evidence is available before an auditor asks for it.

What does compliance automation mean in practice?

In practice, this distinguishes a policy that mandates quarterly access reviews from a system that carries out the review, spots exceptions, and logs the time of the outcome. The article notes that this process is separate from governance. Governance defines what the rules ought to be, and automation is the mechanism that enforces those rules each day.

What is controls as code?

Controls as code means taking a requirement, such as the rule that production databases cannot be publicly accessible, and converting it into a rule that a system can assess. This method substitutes manual documentation that depends on human memory. The article notes that the main challenge is not engineering, but defining vague policy terms, for example determining precisely how many days the word regularly implies.

What does continuous monitoring catch that a point-in-time check misses?

A control checked only once per quarter gives information about conditions only on the day of the check and does not show the periods before or after. Continuous monitoring watches access and permissions, encryption status, and logging coverage continuously, detecting changes like a system that ceased sending logs three weeks earlier.

Start at your core.

Tell us where your data is today and what you want AI to do. We'll come back with a straight answer on what your foundation needs and where the quickest real win is.

Talk to us