Vectimo Academy · Operations

The DIY AI
Operations Audit

A framework for finding out what AI is actually doing in your business (and whether it's worth keeping) before the regulator asks the same question.

~20 min read + work· 5 worksheets included· EU AI Act aligned

The problem

Using AI and running AI are two different things.

Most SMEs are doing the first without the second.

In a 2024 survey, over 78% of European SMEs reported that employees were using AI tools daily. Fewer than 23% had any governance in place to know which tools, on which processes, producing which outputs. The gap between "we use AI" and "we run AI intelligently" is where most of the money disappears, and where most of the regulatory risk sits.[1]

The 42% of organisations that abandoned most of their AI projects in 2025 (up from just 17% the year prior) didn't quit because AI doesn't work. They quit because they couldn't measure whether it was working, couldn't identify what to fix, and ran out of appetite to keep funding the uncertainty.[2] That's not an AI problem. That's an operations problem.

This guide walks you through the same five-step audit Vectimo runs with paying clients, stripped down for self-execution. You'll surface what AI your business is actually running, score which processes deserve more attention, check your data foundation, identify your EU AI Act obligations, and build a basic ROI picture. The whole thing should take an afternoon.

Who this is for: Business owners and operations leads at European service, trade, or transportation companies with 10–250 employees. You're already using some AI tools. You want to know whether they're earning their keep and what you're missing.
42% of companies abandoned most AI projects in 2025 Quinnox AI Readiness Report, 2025 [2]
7% of EU firms qualify as AI "Pacesetters" vs 13% globally Cisco AI Readiness Index, 2025 [3]
50% of SMEs say employees lack skills to use gen AI effectively OECD SME AI Adoption Report, 2025 [4]

Orientation

Four dimensions. One afternoon.

A complete AI operations audit covers process, data, compliance, and cost. In that order.

Most "AI audits" you'll find online are written for machine learning engineers and compliance lawyers. They ask about model architecture, training data bias, and algorithmic explainability. That's important if you're building AI. If you're using AI to run a service business, it's mostly irrelevant. What you actually need to know is: which workflows does AI touch, what quality of data feeds those workflows, what are your legal obligations, and what is this costing versus saving?

Each of the five steps below addresses one of these areas. You don't need a consultant in the room. You need a spreadsheet, an honest conversation with your team, and about half a day.

Process

Which workflows touch AI, which don't, and which should. The foundation of every other decision.

Data

Whether the information feeding your AI systems is clean, accessible, and fit for purpose.

Compliance

What the EU AI Act already requires of you, what's coming in August 2026, and what it means in practice.

Cost

What you're spending on AI tools versus what you're saving. Most companies are surprised by both numbers.

STEP 01Build your AI inventory

You can't audit what you haven't mapped. Start by listing everything.

The AI inventory is the unglamorous part of this exercise, and the most important. The goal is a single document listing every AI-powered tool, feature, or workflow in your business: who owns it, what it touches, what it costs, and what data runs through it. In our experience running this with clients, the inventory almost always reveals three things: tools nobody's actively using, significant cost duplication, and at least one system that would qualify as high-risk under the EU AI Act.

Start by asking everyone who touches operations to list every tool they use that makes a recommendation, automates a decision, generates content, or processes documents. Include the AI features embedded in tools you already use: the resume-screening widget inside your HR platform, the predictive lead scoring in your CRM, the smart scheduling feature in your field management tool. These embedded features are often the ones that create regulatory exposure, because nobody thought of them as "AI."

WORKSHEET 01

AI Inventory Table

Copy this into a spreadsheet. Fill in one row per tool or AI feature. Include embedded AI (the AI features inside tools you already use), not just standalone AI apps.

Tool / Feature Business function Owner Monthly cost (€) Data it processes EU AI Act risk flag Last reviewed
ChatGPT / Claude Content drafting, research Marketing 23–250 Internal docs, emails Minimal
Microsoft Copilot Email summarisation, drafts Multiple Bundled in M365 All email + calendar Minimal
AI CV screener (in HR tool) Candidate filtering HR Bundled Personal data, CVs High-risk
Predictive lead scoring (CRM) Sales prioritisation Sales Bundled Customer data Review needed
AI scheduling / routing Field dispatch Operations Variable Job data, locations Minimal
Document processing / OCR Invoice / form extraction Finance Variable Financial documents Minimal
AI chatbot (customer-facing) First-line customer support CX Variable Customer queries, PII Review needed
Pay attention to the "bundled" items. Tools you're paying for anyway often include AI features nobody switched on intentionally, or that nobody can switch off. Copilot processes your email. Your HR platform's AI feature screens candidates. Your CRM scores leads. These aren't side projects. They're live systems touching real decisions, often without anyone having reviewed the vendor's data handling terms or tested the output quality.

When the inventory is complete, tally your total monthly AI spend, including bundled tools where AI is the reason you upgraded. Then ask: for what percentage of these tools does someone in the business actively review outputs, measure accuracy, or own the result? The typical answer we see is under 20%.

STEP 02Score your processes

Not every task deserves AI. The matrix tells you where to push and where to be careful.

The single most useful question in an AI operations audit is: which processes does AI belong in, and which processes does it not? The answer depends on two variables that apply to nearly every task in a service or trade business: how often it happens (volume), and how much expertise it requires to do correctly (judgment intensity).

High-volume, low-judgment work is where AI pays back fastest. A field service company processing 400 invoices a month, all with the same data structure, is leaving significant money on the table by processing them manually. A boutique consultancy writing one bespoke proposal per week, where the proposal quality is the competitive differentiator, should not be automating that proposal. The matrix makes this visible.

WORKSHEET 02

Process Scoring Matrix

Score every significant repeating task in your business on two axes: volume (how many times per week?) and judgment intensity (does doing it well require expertise, relationships, or context that's hard to capture in writing?).

JUDGMENT INTENSITY →
Low volume
High volume
Low volume · High judgment

Hold off

Rare, complex tasks where mistakes are expensive. AI adds risk, not efficiency. Examples: contract negotiation, client escalations, pricing strategy.

High volume · High judgment

Assist, don't automate

AI can draft, summarise, or retrieve, but a human decides. Examples: quotation, customer email triage, performance reviews, sales follow-up.

Low volume · Low judgment

Low priority

The time savings are real but small. Worth automating once higher-priority items are done. Examples: meeting notes, internal status updates.

High volume · Low judgment  ★

Automate first

This is where AI pays off fastest. Repetitive, structured, high-frequency tasks with clear right answers. Examples: invoice extraction, job scheduling, document classification, data entry, standard customer queries.

Once you've placed your processes on this matrix, score each "Automate first" candidate against three additional criteria to prioritise your implementation roadmap:

Criterion Score 1 (low) Score 3 (medium) Score 5 (high)
Time cost: how many staff-hours per week? <2 hrs/week 2–10 hrs/week >10 hrs/week
Data availability: is the input data structured and accessible? Scattered, unstructured Partially organised Structured, accessible
Error cost: what happens when it goes wrong? Easily caught and fixed Noticeable but recoverable Costly or client-visible
The benchmark: In a study of 200 B2B AI deployments in France (2022–2025), the median ROI was +159.8% over 24 months with an 8-month payback period.[5] The implementations that hit payback fastest shared a common trait: they targeted high-volume, low-judgment processes with clean, structured input data. The ones that failed almost always tried to automate complex judgment tasks before establishing data foundations.

Process automation ranked as the top reported benefit among SMEs already using AI, cited by 53% of respondents in the OECD's 2025 SME AI adoption study.[4] The sector-specific numbers are concrete: in logistics and transportation, automated invoice auditing recovers 1–3% of total freight spend; AI-assisted load optimisation typically cuts operational costs 10–20% within six months.[6] These aren't projections. They're the midpoint of what companies report after implementation.

STEP 03Data and infrastructure check

AI is only as good as the data it runs on. Five questions that tell you where you actually stand.

The majority of AI project failures at SME level have nothing to do with the AI itself. They fail because the data feeding the system is inconsistent, inaccessible, or doesn't actually capture what the business thinks it captures. The Cisco AI Readiness Index 2025 found that 66% of EU organisations struggle to centralise data. Without centralised, structured data, most AI automation either produces poor outputs or requires so much manual cleaning that the time savings disappear.[3]

These five questions are the minimum data readiness check before you commit budget to any AI implementation. They don't require a data engineer to answer. They require honest conversations with the people who own the processes.

WORKSHEET 03

Data Readiness Checklist

Answer each question for the specific process you're planning to automate. "Yes" = ready. "Partial" = fixable. "No" = stop and fix before spending on AI.

  • Is the data captured consistently? Does the same type of information always get recorded in the same place, in the same format? Or does it depend on who did it last Tuesday? Inconsistent capture is the most common AI project killer: the model trains on one format and production data looks completely different.
  • Is the data accessible without manual extraction? Can you export or query the data programmatically, or does someone have to manually pull it from a PDF, email thread, or someone's head? If the data lives in PDF attachments, WhatsApp messages, or a spreadsheet only one person knows how to navigate, the first investment isn't AI. It's basic data infrastructure.
  • Is there enough of it? For supervised AI (where the model learns from examples), you typically need at least several hundred clean, labelled examples to start seeing reliable performance. For generative AI tasks (drafting, summarising), volume matters less. Know which type of AI you're implementing.
  • Do you know who's responsible for data quality? Not "who technically owns the database", but who actually notices when entries are wrong, incomplete, or missing, and has the authority to fix the upstream process? If the answer is nobody, the data will degrade as soon as implementation pressure eases.
  • Have you checked data-sharing obligations? Does the data you plan to feed into an AI system contain personal data under GDPR? Does your vendor contract allow them to train on your data? Does feeding client data into a third-party AI tool violate any confidentiality agreements? These questions must be answered before you build, not after.
The data trap: A 35-person transport company we audited was using AI scheduling software and reporting almost no efficiency gain. The root cause: driver availability was still being entered manually, with a 12–48 hour lag. The AI was optimising against data that was always stale. Fixing the data feed took two weeks and cost almost nothing. The scheduling tool then delivered the time savings the vendor had promised. AI doesn't fix broken data pipelines. It amplifies the consequences of them.

STEP 04EU AI Act compliance snapshot

Two obligations already apply to you. A third is three months away. Here's what matters for an SME.

The EU AI Act became law in August 2024. For most SMEs, the practical question isn't "does this apply to me?" It does, if you're using AI to make or support decisions. The question is which obligations apply, when, and what the concrete steps are. The following is not legal advice. It's an operator's reading of what the Act requires of a service or trade business using off-the-shelf AI tools.

2 February 2025: Already in force

Article 4: AI Literacy. Every organisation deploying AI systems must take measures to ensure adequate AI literacy of their staff. This doesn't mean a formal certification programme. It does mean that if a member of staff uses an AI tool to support a decision, they need sufficient understanding of what the tool does and where it can fail. You should be documenting what training you've provided.

2 August 2025: Three months away

National enforcement framework goes live. Member states must have their national market surveillance authorities operational. From this date, providers and deployers of AI systems may face civil liability if AI systems are operated by staff who haven't received adequate training and harm results.[7]

2 August 2026: Main compliance deadline

High-risk AI obligations become enforceable. If you deploy any system that qualifies as high-risk under Annex III, you must have conformity assessments, technical documentation, risk management systems, and human oversight mechanisms in place. Fines: up to €15 million or 3% of global annual turnover, whichever is higher.[8]

Which of your AI tools could be high-risk?

The Act's Annex III lists eight categories of high-risk AI. For a typical service or trade SME, three categories are most likely to be relevant:

HR
Any AI used to screen, filter, or rank job applications (including CV ranking features bundled inside HR platforms) is classified as high-risk. This includes video interview analysis, automated candidate scoring, and AI-assisted performance management.
Credit
AI used to evaluate creditworthiness or establish credit scores is high-risk. If your invoicing or factoring platform uses AI to assess customer payment risk, check whether this applies.
Safety
AI used as a safety component in critical infrastructure or road traffic management is high-risk. For transport companies specifically, AI that influences routing decisions in safety-critical contexts may qualify.
WORKSHEET 04

Four actions before August 2026

If anything in your AI inventory could qualify as high-risk, these are the steps:

  • Create an AI inventory (you're doing this in Step 1) and flag any system that might touch employment, credit, or safety decisions.
  • Contact the vendor of each flagged tool and request the CE marking documentation, technical documentation, and system card. A reputable vendor will have these. If they don't, that's material information.
  • Define at least one named person whose job includes monitoring each AI system's outputs and who has the authority to override or halt it. Document this.
  • Document what AI literacy training staff have received. It doesn't need to be elaborate: a record of who attended what briefing is enough to demonstrate compliance with Article 4.
SME-specific provisions: The Act includes meaningful accommodations for SMEs. Assessment fees must be proportional to company size (Article 62). Microenterprises (<10 employees, <€2M turnover) can comply with quality management requirements "in a simplified manner" (Article 63). SMEs have priority access to regulatory sandboxes, free of charge (Article 58). The obligations are real, but they're not designed to be enterprise-scale compliance projects.[9]

STEP 05Build the business case

The ROI calculation is simpler than you think. The inputs are harder to get honest about.

The standard failure mode in AI ROI analysis is counting the theoretical time savings and ignoring the actual costs. The implementation time, the training time, the ongoing supervision time, the tool subscriptions, the prompt engineering, the edge cases that still require a human. These add up. The accurate picture, on both the cost and savings side, is what makes the difference between a project that delivers and one that gets cancelled after six months.

The formula below is intentionally simple. It's designed to fit in a conversation with your CFO or operations lead, not to replace a financial model. Use it to pressure-test your AI inventory against real numbers before you spend further on implementation.

WORKSHEET 05

Annual ROI Calculator (per AI tool or workflow)

A. Staff time saved per week (hours) ___
B. Fully-loaded hourly cost (€) ___
C. Annual labour saving (A × B × 52) = €___
D. Annual tool subscription cost (€) − €___
E. Estimated annual supervision overhead (€) − €___
F. Implementation and training (one-time, amortised over 2 years) − €___
Annual net value (C − D − E − F) = €___

Run this calculation for every tool in your inventory. You'll typically find: two or three tools that show strong positive returns and should get more investment; several tools that are roughly break-even and need either improvement or consolidation; and at least one that's losing money on its current usage pattern.

Reference benchmarks (sector data)

Sector / function Benchmark outcome Source
B2B: cross-sector, France Median ROI +159.8% over 24 months; 8-month payback [5]
Logistics: invoice auditing Recovers 1–3% of total freight spend [6]
Logistics: load optimisation 10–20% cost reduction in 3–6 months [6]
Field service: scheduling AI 2–3x shipment volume with same team size [6]
HR: onboarding automation 2–3 hours saved per new hire for HR and management [10]
Professional services: document processing 60–90% reduction in manual extraction time [6]
On supervision overhead: Line E in the calculator is the one most implementation plans miss. An AI system that generates 200 outputs per week still needs someone to spot-check quality, handle exceptions, and catch the failures the model doesn't flag. Budget at least 10–15% of the time saved for ongoing human supervision, or you'll end up with quality degradation that erases the efficiency gains within six months.

Interpretation

Read your results.

Five worksheets complete. Here's what healthy looks like, and what should concern you.

When you've run all five steps, you should have: a complete AI inventory with cost and risk flags, a process scoring matrix with a prioritised automation roadmap, a data readiness assessment per process, a clear picture of your EU AI Act obligations, and at least a rough ROI calculation for your current tools. The table below maps common outcomes to recommended actions.

What you found Status What to do
Clear inventory, positive ROI on 2+ tools, no high-risk flags Good shape Run this audit quarterly. Your next step is prioritising the next tier of automation from your process matrix.
Clear inventory, 1–2 high-risk AI tools identified Action needed Contact vendors immediately for documentation. Assign oversight owners. Do this before August 2025.
Significant cost duplication or break-even tools Consolidate Cancel or consolidate overlapping subscriptions. Re-evaluate in 90 days with clearer usage data.
Data readiness below 3/5 on "Automate first" candidates Fix data first Don't spend on AI implementation until the data foundation is in place. The ROI projections won't hold.
No ownership, no AI literacy training documented, EU exposure unclear Urgent Stop adding AI tools. Fix governance before August 2025. If you're uncertain about your regulatory exposure, get a proper assessment.
Negative or uncalculable ROI on majority of tools Reset needed Something is structurally wrong: process selection, data quality, or implementation. A DIY audit has taken you as far as it can.

Signals that the DIY audit has found its limit

This guide gives you the framework. What it can't give you is the interpretation of edge cases, the experience of knowing which vendor documentation is credible versus boilerplate, or the ROI modelling that accounts for your specific cost structure and growth trajectory. If you've run the five steps and find yourself in any of the following situations, the next investment is a professional audit, not more self-assessment:

You found high-risk AI

You have an AI system that touches employment, credit, or safety decisions, and you're not certain of your compliance status. The fines for non-compliance are real. Get a documented assessment.

ROI numbers don't add up

Your tools show negative ROI but teams are resistant to stopping them, or you can't determine why a tool isn't delivering. An external view cuts through internal politics.

Process matrix shows 10+ priorities

You have too many automation candidates and limited implementation capacity. Prioritisation at this level requires ROI modelling against your specific cost structure, not benchmarks.

Data issues are systemic

Your data readiness check revealed problems that aren't one team's responsibility to fix. That requires an architectural view and change management support.

Vectimo · AI Operations Audit

Done the DIY.
Need the full picture?

The paid audit is two weeks, one deliverable: a prioritised AI Opportunity Roadmap with ROI modelling, vendor assessments, and an EU AI Act compliance status report specific to your business. Flat fee, no retainer required.

Book a call, €2,500 See what's included

What you get

  • Current state AI inventory
  • Top 3 opportunities by ROI
  • Quick wins (30-day window)
  • Implementation roadmap
  • EU AI Act compliance status

How it works

  • Week 1: Discovery & interviews
  • Week 2: Analysis & roadmap
  • Final presentation + written report
  • 30-day check-in included

Who runs it

Felix Steinhauser, ex-Director of AI Strategy & Delivery at SIXT SE. No vendor affiliations. No upsell on tools. Just the honest answer.

Sources

Get the next guide

New practical guides for European SMEs adopting AI, delivered when they drop. No spam, unsubscribe anytime.

Want this done for you, not just explained? Vectimo runs the AI adoption end to end.

Work with Vectimo →

Browse all free guides →