Incremental Data Warehouse Development – The Only Way to Fly
Bill Inmon made a statement with his post Incremental Data Warehouse Development – The Only Way to Fly.
My January 1st post called New Year’s Resolution was in line with his point that “end users cannot tell you what the actual system requirements are before the system is built. End users of analytical systems are constantly changing their minds. End users of analytical systems operate in a mode of discovery”.
The incremental and iterative approach allows end users to see what data they can get and how they can extract information, insight and knowledge out of the data to improve their decisions. After seeing and experimenting with their new BI tool, end users can then derive better requirements, hence the iterative approach.
By following an incremental and iterative approach “small part of the data warehouse is designed, programmed and populated. Then, another small part of the data warehouse is designed, programmed and populated, and so forth. A small, fast piece at a time is the way to build a data warehouse”. This process requires that the end users be an integral part of the development cycle which brings the benefits of ensuring the system does meet the end user’s expectations in addition to giving a sense of ownership to the end users as they were part of the development cycle.
Bill recommends the Data Warehouse Project Management book by Adelman and Moss which I haven’t read – yet. It’s now in my cart.