ChatGPT Image Jan 22, 2026, 10_11_50 AM

The Data Integration Tax

For the first time in NASCIO history, AI has been elevated to the same tier as cybersecurity as a top CIO priority for state and local government. That’s a significant shift, and it comes with a new pressure most agencies aren’t ready for. The promise…

Share this post:

For the first time in NASCIO history, AI has been elevated to the same tier as cybersecurity as a top CIO priority for state and local government. That’s a significant shift, and it comes with a new pressure most agencies aren’t ready for. The promise of AI depends entirely on clean, connected, trustworthy data.

But most agencies are still running architectures built before that promise existed. If your data team spends a large chunk of time copying data from one system to another just so someone can run a report, the foundation likely isn’t ready, and neither is your AI strategy.

That’s not productive work. It’s maintenance. And it’s costing more than the software itself.

Most technology budgets focus on what you see: licenses, cloud storage, support contracts. But there’s a hidden cost that doesn’t show up on any invoice. It’s what your agency pays in time, in duplicate storage, in delayed decisions, just to move data around so people can use it.

We call it the integration tax.

And if your team is spending more time preparing data than analyzing it, you’re paying it.

 

The Cost You Don’t See on the Invoice

The integration tax shows up in three places that don’t get line items in your budget:

  1. Paying twice for storage

The same constituent record, the same case file, and the same transaction log all stored in your data warehouse and your data lake. You’re not just storing it twice. You’re paying twice: once for the “organized” copy that powers reports, and once for the “raw” copy that powers analytics. That redundancy isn’t just wasteful; it compounds. Every new system added to the stack adds another copy, another maintenance burden, and another contract.

  1. Paying engineers to be movers, not builders

Your data team was hired to answer questions and build tools. But if you ask them how they spend their time, most of it goes to Extract, Transform, Load (ETL) pipelines—code that copies data from one place to another, reformats it, and keeps the two systems in sync.

When a system changes, the pipeline breaks. When a report needs new data, someone has to build a new pipeline. When two reports show different numbers, someone has to trace which pipeline is wrong.

That’s not engineering. That’s plumbing. And it’s engineering capacity that could be going toward the AI applications and analytical tools that actually move the mission forward. 

  1. Paying in delays

A program director needs a report combining eligibility data with case notes. It should be simple. But eligibility lives in your reporting system, and case notes live in your document storage system. So your data team has to:

  • Export the case notes
  • Reformat them so the reporting system can read them
  • Load them into the warehouse
  • Join them with the eligibility data
  • Run the report

Three days later, the director gets an answer to a question that should have taken three minutes.

 

Why This Happens

Most agencies didn’t plan to build disconnected systems. It happened tool by tool.

You bought a BI platform to run reports and dashboards. Then you added an AI platform for predictive models and document analysis. Then you added governance tools to track who accesses what. Each one made sense at the time. But when they don’t talk to each other, your data team has to build and maintain custom pipelines just to connect them.

That maintenance burden compounds over time. And now, new AI transparency legislation is adding a compliance dimension that disconnected architectures can’t easily meet. Colorado’s AI Act takes effect in 2026, requiring documented impact assessments and transparency disclosures for high-risk AI systems. California has passed multiple AI accountability laws requiring training data disclosure and auditability of AI outputs. More than 40 states have introduced or enacted AI-related legislation since 2023, and a federal framework through NIST’s AI Risk Management Framework is already shaping procurement requirements across agencies.

If your state isn’t on that list yet, it will be. The direction is clear, and the timelines are real. If your AI outputs can’t be traced back to the data that produced them, that’s not just a technical gap. It’s a procurement and legal risk that’s moving closer every legislative session.

 

What It Costs You

Here’s a quick self-assessment. If any of these sound familiar, you’re paying the integration tax:

How many days does it take to get a new dataset “ready” for analysis?

If the answer is more than a few hours, your team is spending that time moving and reformatting data instead of using it.

How many people spend most of their time moving data instead of answering questions?

If more than half of your data team’s week goes to ETL maintenance, you’re paying them to maintain infrastructure, not deliver insight.

How often do two reports show different numbers for the same thing?

If this happens regularly, it’s because you have multiple copies of the truth, and they’ve drifted out of sync. Someone has to reconcile them manually every single time.

How long does it take to answer a new question that requires data from multiple systems?

If the answer involves days or weeks of “data prep” before anyone can even start analyzing, you’re paying the tax.

What happens when a system changes?

If the answer is “several things break and we spend days fixing pipelines,” the hidden cost is in how much time your team spends reacting to changes instead of planning for them.

 

A Different Approach

Here’s the shift: instead of maintaining separate systems for BI, AI, and governance, what if they all worked on the same live data?

A data intelligence platform brings those workloads together. Your BI team runs reports. Your AI team trains models. Your governance rules, including the lineage and audit trails required under emerging AI transparency laws, apply automatically. All on the same unified foundation. No pipelines to connect them. No copies to reconcile. No waiting for someone to prep the data.

And critically: when an auditor, a legislator, or a program director asks why the AI made a particular decision, the answer isn’t a scramble through spreadsheets and pipeline logs. It’s already there, a complete, documented trail, from raw data to outcome. That’s the difference between a “black box” and a system people can actually trust.

Example: A state health agency was spending three days every time a program director asked for a report combining claims data with an AI-generated summary of clinical notes. The BI team had the claims data. The AI team had built the clinical note summarizer. But connecting them required a custom pipeline that took days to run and broke whenever either system changed.

They moved both workloads to a unified platform. The three-day turnaround became three hours, with most of it spent on analysis, not data movement. When the AI model updated, nothing broke. It just worked. And because the data lineage was maintained throughout, the agency could demonstrate exactly how every output was produced.

The agency didn’t replace their source systems. They unified where the work happens.

 

What Becomes Possible

Cutting the integration tax isn’t just an operational improvement. It’s what makes the next generation of government service delivery possible.

Once your BI, AI, and governance workloads share a unified data foundation, you’re no longer limited to dashboards and reports. You can deploy AI agents (systems that execute high-volume, rules-based mission work autonomously), without manual handoffs at every step.

Think about what that looks like in practice:

  • Eligibility screening that runs continuously against live data, flagging cases automatically rather than waiting for a caseworker to pull a report
  • Case routing that assigns incoming requests to the right team or program based on real-time criteria, without a coordinator manually triaging each one
  • Permit processing that moves applications through review stages automatically, escalating only when human judgment is actually required

The organizations best positioned for this aren’t necessarily the ones with the most sophisticated AI models. They’re the ones that built a trustworthy foundation first. 

 

Where to Start

You don’t have to rewrite your entire architecture to reduce the integration tax. Start with one use case where the cost is visible.

Step 1: Pick one report that takes too long

Choose a report or analysis that people ask for regularly, but takes days to deliver because it requires data from multiple systems.

Step 2: Ask how much time goes to moving data vs. actually analyzing it

Break down the work. If 80% of the time is spent on ETL and only 20% is spent on analysis, that’s your integration tax.

Step 3: Pilot a “connected” approach on that one use case

Test a platform that can query across systems without copying data. Measure the time saved. If it works, expand to other use cases.

Step 4: Measure and expand

Track two things: time saved and reduction in duplicate storage. Use those numbers to build the business case for broader adoption.

 

Good News

The integration tax isn’t a permanent condition. It’s a byproduct of an architecture that predates modern requirements. Agencies that recognize this earliest won’t just cut costs; they’ll be the ones with the foundation in place when the AI mandates arrive in full force. And that foundation, built on governed, unified data, will compound in value with every use case built on top of it. 

 

To identify where you’re paying the integration tax, use The Data Unification Diagnostic.

Last updated: January 22, 2026

The first unified platform to bring the power of AI to your data and people, so you can deliver AI’s potential to every constituent.

Databricks is a leading data and artificial intelligence (AI) company, founded by the original creators of Apache Spark™, Delta Lake, and MLflow. Their mission is to simplify and democratize data and AI so that every organization can harness its full potential.