Notes on data, AI, IT
and security
No marketing fog. The way I think about real problems with founders and managers.
Data lake: why the lake turns into a swamp
Why the data lake concept fails without data governance, and how a manager can tell real value from architectural hype.
Microservices and data: who owns what when you have many services
When a monolith is split into services, data becomes the main source of conflict. How to organise this without creating new chaos.
\"We need a real-time dashboard\" is not a question
Why a request for real-time data usually means something else - and how to get to the actual question.
ETL pipelines fail quietly and that destroys data trust
How ETL pipelines degrade data quality without anyone noticing, and what to do before the dashboards become decorative.
Analytics databases and operational databases are different tools
Why one database cannot do both transactions and analytics well - and what to do about it.
Metadata is not an appendix to data
Why a data catalog and metadata ownership are an infrastructure question, not bureaucracy.
Knowing when your ETL pipeline is sick
Why data pipelines fail silently, what signs to watch for, and how to build monitoring before the problem shows up in a management report.
Streaming data pipelines: why batch processing is starting to show its limits
What changes when you move from nightly batch jobs to continuous data streams, and when that shift is worth the added complexity.
Event sourcing: why keeping history changes what analytics can ask
What event sourcing means as a data approach and why it is an architectural decision with long-term consequences for a company's analytical capabilities.
When a data warehouse becomes the bottleneck
Signs that your corporate data warehouse has stopped keeping up, and how to think about the next step.
Open data: what it is and why business should care
Governments and organisations around the world are opening up data for free use. A look at the practical opportunities this creates.
Why BI projects stall halfway
A look at the recurring reasons why business intelligence projects fail to reach a useful result, and what to do about them.