Securing GenAI Use Requires a New Take on Data Security Governance

By Madhu Shashanka, Co-founder and Chief Scientist of Concentric AI; and Lane Sullivan, Chief Information Security and Strategy Officer of Concentric AI [ Join Cybersecurity Insiders ]
Ccsp

The GenAI era has expanded data risks in ways that today’s current frameworks, access controls, data loss prevention (DLP) solutions, and compliance checklists do not fully address. Enterprises need to focus on building out mature data security governance programs that treat data as an asset and measure exposures in quantifiable, business-relevant terms to address these evolving threats.

This process requires more than just cataloging threats. It involves adopting risk quantification methods that can measure data risk in tangible units, providing boards of directors and regulators with actionable insights. For example, understanding financial risk helps leaders evaluate trade-offs, compare scenarios, and make quicker, more informed decisions.

Effective quantification goes beyond traditional metrics to include insights into data sensitivity and context (IP, PII, financials, source code), user behavior and intent (benign use vs. shadow AI misuse), regulatory and contractual obligations, data element metadata like unique counts of personal data and toxic clustering, and access to data through access controls or vulnerability exploitation.

The specifics differ by industry and by risk appetite, but the principle remains the same: Measure what matters so boards and CISOs can allocate resources wisely. When done correctly, governance shifts from slowing innovation to enabling it to happen safely and sustainably.

When it comes to GenAI, if enterprises hesitate, they face a dual bind. On the one hand, ignoring GenAI means losing competitive ground as other companies empower employees and business teams to find new efficiencies. On the other hand, adopting GenAI without proper governance means risking multi-million-dollar breaches, regulatory penalties, and damage to their reputation.

IBM’s data tells the story. According to their research, organizations that fully implemented AI-driven security automation reduced breach costs by an average of $1.76 million compared to those that didn’t. In other words, AI is both a risk vector and the most effective shield. Executives cannot afford to see GenAI as a temporary experiment. It is already integrated into enterprise workflows, often unnoticed. Like BYOD, adoption is unavoidable. But this time, the stakes are much higher.

Data Security Governance for GenAI

The question, then, is not whether to adopt GenAI, since no doubt your employees already have, but how to do so responsibly now that it’s in your organization.

Every new technology introduces new vulnerabilities, threat vectors, and risks. We have observed that GenAI is now a fundamental layer of enterprise infrastructure, making the principles of identifying, monitoring, and mitigating risks essential. The solution lies in context-driven visibility, detective monitoring, and preventative controls. A layered defense, similar to the BYOD playbook, is necessary but must be scalable to address today’s data-driven risks. Additionally, legal and regulatory frameworks need to adapt more quickly to enforce controls around sensitive data.

There are two ways to look at securing GenAI adoption – an inside-out perspective from the enterprise point of view, and an outside-in perspective from the infrastructure point of view.

Inside-Out Governance (Data Hygiene)

The foundation here is visibility into what data exists, where it resides, and who can access it. Enterprises must categorize and classify sensitive assets – including employee and customer PII, proprietary IP, and confidential code – and they must remediate overly broad permissions.

Data loss prevention (DLP) begins with understanding what the data is and who has access, long before DLP controls are applied to data in motion. Shadow data should be removed, duplicates eliminated, and retention policies enforced. Without this basic hygiene, every GenAI interaction risks a leak.

Data categorization, which involves organizing related data into categories and subcategories, should be preferred over classification because it is more versatile and can enable flexible controls that empower the business instead of hindering it. This is because data categorization allows departments or individuals to use specific data types rather than a broad set of data based on classification. For example, the legal team could be permitted to use a particular GenAI tool with legal contracts.

Outside-In Controls (GenAI Monitoring)

While good data security governance practices can address and mitigate data risks in the long term, we also need to augment them with appropriate controls at the GenAI infrastructure layer.

It’s clear that enterprises require visibility into GenAI use itself. They need to see which tools are being accessed, what prompts are being entered, and whether sensitive data is being leaked. That visibility can be enabled through browser extensions, proxies, or API-level integrations.

From there, organizations can implement detective and preventative controls. Detective controls monitor prompts and outputs in real time, flagging risky sessions or anomalous data flows. Behavior analytics and anomaly detection (especially in the agentic world) combined with data context will be essential in identifying and detecting such risks. Preventative controls block unsanctioned tools, filter sensitive prompts before they leave, de-identify sensitive data as it’s entered into prompts, and enforce role-based restrictions on AI-driven insights. Together, this creates a feedback loop of trust. Employees can use GenAI safely, security teams maintain oversight, and business leaders gain confidence that innovation won’t come at the cost of exposure.

GenAI Governance – Enablement with Control

GenAI represents a generational paradigm shift, one that democratizes intelligent automation but also dissolves long-standing boundaries around enterprise data. If BYOD taught us anything, it is that blocking adoption only pushes employees to use unsanctioned solutions. Enablement, combined with visibility and control, is the only sustainable way forward.

But unlike BYOD, the data security risk posed by GenAI is far greater. Consider that a misplaced device can expose files, but a misplaced prompt can expose the crown jewels of an enterprise’s intellectual property. The consequences are amplified, the attack surface broader, and the governance stakes higher.

The enterprises that succeed will be those that recognize this is not about approving one more system; it is about governing an entirely new layer of enterprise risk and opportunity. Such governance requires context-driven visibility, detective and preventative controls, and a mindset that security is not a brake on innovation but the way to secure it and enable the business. The companies that master AI governance will innovate faster, attract more customers, and win the regulator’s trust. The others will spend years in pilot purgatory, burning capital while their competitors compound advantages.

Every innovation is a potential vulnerability, and every vulnerability a potential headline. Enterprises that learn this lesson the fastest will be the ones still leading when the hype cycle clears. GenAI dissolves the perimeter. The leaders who understand this will define the future of secure innovation.

Join our LinkedIn group Information Security Community!

No posts to display