The verdict in three sentences
An AI assistant connected to your internal documents (a technique known as RAG, retrieval-augmented generation) is now a well-understood project, provided you treat access-rights security as a starting requirement rather than an add-on. For an Amsterdam company with 15,000 procedures and contracts, the market budget sits between 15,000 and 40,000 EUR for setup, plus 200 to 1,500 EUR a month in model usage. The return is measured in deflected questions: around 30% of internal requests to HR, legal and quality teams.
Why a consumer chatbot is not enough
A consumer subscription to a conversational assistant knows nothing about your quality procedures, supplier contracts or works council agreements. Pasting those documents into a public tool exposes the company to data leakage and often breaches your own confidentiality commitments to clients and partners. A RAG assistant works differently: documents stay inside your perimeter, are chunked and indexed in a vector database hosted in the European Union, and for each question the model only receives the relevant passages the user is entitled to see.
That last point separates a demo from a deployable tool. A maintenance technician must not be able to extract a sales director's employment contract through a cleverly worded question.
Options and costs in 2026
| Option | Setup, 2026 order of magnitude | Monthly cost | Document-level permissions | Hosting |
|---|---|---|---|---|
| Copilot built into the office suite | 0 to 5,000 EUR | 25 to 35 EUR per user | Inherited from the suite | Per vendor contract |
| Configured RAG SaaS platform | 5,000 to 15,000 EUR | 500 to 3,000 EUR | Partial, per workspace | EU often optional |
| Custom RAG | 15,000 to 40,000 EUR | 200 to 1,500 EUR API + hosting | Fine-grained, per document | EU, on-premise or sovereign cloud |
| Self-hosted open-source model | 30,000 to 60,000 EUR | 800 to 2,500 EUR GPU | Fine-grained | Fully internal |
For 400 users, an office-suite copilot quickly reaches 12,000 to 14,000 EUR a month and only covers documents already stored in that suite. Custom RAG becomes competitive as soon as your documents are spread across a DMS, intranet, SharePoint and file servers. At Kolonell, these assistants are delivered through our AI projects and follow the custom application grid: medium from 4,000,000 to 7,000,000 FCFA (6,100 to 10,670 EUR) or complex from 7,000,000 to 15,000,000+ FCFA (10,670 to 22,870+ EUR), depending on the number of sources and how fine the permissions are.
Security and compliance: the CIO checklist
| Requirement | What to check | Expected level in 2026 |
|---|---|---|
| Data location | Vector store, logs, backups | European Union, in the contract |
| Reuse by the model provider | No-training clause | Written exclusion, zero or max 30-day retention |
| Access rights | Filtering before anything reaches the model | Synced with the directory (Entra ID, LDAP) |
| Traceability | Questions, cited sources, user | Log kept 6 to 12 months |
| EU AI Act | System classification | Limited risk, transparency duty |
| GDPR (AVG) | DPIA if HR data is included | DPIA completed before go-live |
The EU AI Act, whose obligations phase in through 2026 and 2027, classifies an internal document assistant as limited risk in the vast majority of cases: users must be told they are interacting with an AI and the system must be documented. If the assistant is used to assess employees or screen applicants, it moves into high risk, which changes the file entirely. In the Netherlands, the Autoriteit Persoonsgegevens has also been explicit about DPIAs for AI tools processing employee data.
A typical 8 to 12 week rollout
Weeks 1 and 2 cover the source inventory and access-rights mapping. Weeks 3 to 6 handle ingestion, chunking, indexing and permission filtering. Weeks 7 to 9 are a test with a panel of 30 to 50 users and a reference set of 200 questions. The final weeks are a phased rollout by department and the setup of metrics: sourced-answer rate, "I don't know" rate, satisfaction.
Mini case study
Pieter, CIO of a 900-employee logistics company in Amsterdam, finds that HR, quality and legal together receive about 2,400 internal questions a month, at 12 minutes average handling time.
Need a professional website?
Kolonell builds websites that attract clients, optimized for the Sénégalese market. Free quote in 2 minutes.
- Questions deflected by the assistant: 30%, i.e. 720 a month.
- Time saved: 720 times 12 minutes, i.e. 144 hours a month.
- Value at 60 EUR per loaded hour: 8,640 EUR a month.
- Costs: 32,000 EUR setup, then 900 EUR a month for API and hosting.
- Net monthly gain: 7,740 EUR, payback in just over 4 months.
Even if the deflection rate is halved, the project still pays back in under 10 months.
FAQ
Are our documents used to train the model?
Not if the API contract is negotiated properly: major providers offer enterprise plans in 2026 with no training on your data and 0 to 30-day retention. The documents themselves stay in your EU-hosted vector store.
What happens when the assistant does not know the answer?
A well-tuned assistant says "I cannot find this information" rather than inventing one. On a 200-question test set, the target is under 3% unsourced answers before go-live.
What does the API really cost each month?
For 400 active users asking 5 questions per working day, usage sits between 200 and 1,500 EUR a month depending on the model. A mid-tier model handles 80% of document questions well.
Can we connect SharePoint, the DMS and a file server at once?
Yes, each source has a connector that also pulls permissions. Allow 1 to 2 weeks per unusual source, which feeds directly into the 8 to 12 week timeline.
Do we need a self-hosted open-source model?
Only if a regulatory constraint forbids any data leaving your perimeter, which applies to fewer than 10% of mid-sized companies. The extra 800 to 2,500 EUR a month in GPU is rarely justified otherwise.
Let's scope your project. We audit your document sources and permission model to scope a pilot for one department in 8 to 12 weeks. Detailed quote within 48 h. WhatsApp +221 77 596 93 33.
Mohamed Bah
Fondateur, Kolonell
Passionate about digital and entrepreneurship in Africa, Mohamed has been helping Sénégalese businesses with their digital transformation since 2020. Founder of Kolonell, he believes every SME deserves a professional and accessible online présence.