Datavision.pl — data engineering

Stateless
data infrastructure

S3 as the only source of truth

We build systems where the absence of an external database is not a limitation, but a design requirement. Deterministic routing, immutable containers, compliance built in from the ground up.

Two open-source products for organizations storing billions of files and years of logs.

Stateless-first S3-native Compliance-grade Open Source EU jurisdiction
DV DATAVISION
Products

Four products, one philosophy

Each product solves a specific engineering problem: consolidating small files, archiving logs, long-term metrics archival, and cross-product access audit. What unites them is the same architecture — statelessness and S3 as the only source of truth.

VERA
Versioned Easy Repository Archive

Consolidate billions of small files into immutable .vera containers. Deterministic routing without a lookup database. Range-GET instead of full reads. Built-in GDPR tombstones.

  • 60–80% storage TCO reduction
  • 1000× fewer objects in S3
  • <10 ms lookup with no external database
  • 48h SLA for GDPR Art. 17
SEC 17a-4 HIPAA GDPR SOC 2
View product
ELSA
Easy Log Simple Archive

Log archive with entity index and cryptographic integrity. The missing layer between hot search and cold archive. Searchable, immutable, dormant until needed.

  • 15× lower TCO vs Splunk over 3-year retention
  • <1.5 s cross-stream entity lookup
  • <5 min metastore rebuild from S3
  • Hibernatable query layer — you pay for storage, not compute
NIS2 DORA KNF GDPR Art. 17
View product
10×
MILA
Metric Indexed Long Archive

Long-term metrics archive with PromQL-compatible index. Gorilla compression, D+1 compaction, hibernatable query layer. No permanent 24/7 cluster.

  • 10–15× cheaper than Splunk Metrics
  • <3 s p95 query latency (cold)
  • 5–10× compression ratio (Gorilla)
  • $0 idle compute
PromQL MiFID II DORA HIPAA
View product
Soon
AURA
Access, Usage & Retention Audit

Cross-product access audit over VERA, ELSA, MILA. Who read which data and when. One console for GDPR Art. 17, one audit trail, regulatory reports in one click.

  • 9 / 9 regulations in one product
  • 1 console for cross-product GDPR Art. 17
  • Cross-product legal hold orchestration
  • Dogfooding — uses VERA+ELSA+MILA
GDPR Art. 30 HIPAA Access SOC 2 CC6.1 DORA Art. 9
See in DCS one-pager
4
Open-source products
VERA + ELSA + MILA + AURA
0
External databases
Stateless-first architecture
100%
S3 as source of truth
Everything else is reconstructible
5+
Regulations supported
SEC · HIPAA · GDPR · MiFID · NIS2 · DORA
Philosophy

Four principles, non-negotiable

The common DNA of our products. Every system we build starts from the same architectural assumptions — proven in production, not invented in a spec document.

01

Statelessness as a hard requirement

No external lookup database is not a limitation — it is a design goal. Deterministic functions like locate_shard(uid, ts) replace mapping tables. Every worker runs independently, no coordinator.

02

S3 as the only source of truth

Everything else — Redis, caches, indexes, manifests — is a materialized view. You can wipe it and rebuild in minutes. No vendor lock-in; AWS S3, MinIO, and Ceph/RGW compatibility is a primary feature, not an add-on.

03

Compliance built in, not bolted on

S3 Object Lock, chain-hashed audit trail, GDPR tombstones, per-entity legal hold — first-class concepts of the system, not late-stage configuration. SEC 17a-4, HIPAA, GDPR Art. 17, NIS2, DORA, KNF — architecture, not checkboxes.

04

Immutability at the infrastructure level

Append-only containers, WORM via S3 Object Lock, cryptographic chain hash in the audit log. Data mutations are documented, never hidden. An auditor sees what happened, when, and why — not a broken chain, but a readable trace.

Expertise

What we do

Beyond our open-source products, we offer implementation services, architecture consulting, and support for organizations building their own regulated data systems.

🏗️

S3-native system architecture

Design and rollout of object-storage systems at billion-file scale. Deterministic routing, sharding, lifecycle policies, multi-region disaster recovery.

⚖️

Compliance & data governance

Implementation of SEC 17a-4, HIPAA, GDPR, NIS2, DORA, KNF requirements at the architecture level. WORM, audit trail, legal hold, GDPR tombstones, auditor-ready reports.

🔬

Migrations & integrations

Safe migrations of billions of files from existing systems (PostgreSQL, MySQL, NFS) to modern storage. Watermark migration, zero-downtime, integrity validation.

📊

Data science & analytics

Data analysis, predictive models, operational dashboards. Long-standing experience in finance, telecom, and public administration.

☸️

Kubernetes & observability

Production deployment: Helm charts, HPA, CronJobs, PodDisruptionBudget. Full observability with Prometheus + Grafana, structured logging, SLO-driven alerting.

🔐

Security & secrets

OpenBao / Vault, dynamic credentials, MFA for break-glass, SSH-style PKI (Ed25519/RSA). Zero-downtime key rotation, access auditing, no hardcoded secrets.

Contact

Let's talk
about your project

Reach out to discuss a VERA or ELSA deployment, evaluate integration with your existing system, or ask about consulting services for regulated data architecture.