On 20.03.2007 21:35, Anthony Eden wrote:
> I have been working on the ActiveWarehouse project, which is a plugin
> for Rails designed to make it easier to develop data warehouses on
> Rails. As such I've spent the last 6 months research data warehouse
> techniques and technologies and have become quite interested as well.
> We use a denormalized dimensional model for our data warehouse, which
> is one way to develop a data warehouse, and it is working out quite
> well. With larger databases though, especially with both large facts
> and large dimensions, query response time degrades fairly quickly. In
> response to this I (and others in the AW development team) have been
> playing around with implementing alternate cube storage and query
> systems. One of the most promising is the Dwarf algorithm
> (http://citeseer.ist.psu.edu/sismanis02dwarf.html by Sismanis et. al)
> which I've been reading about for about 2 weeks now.
That sounds interesting. Thanks!
My general assumption so far was that every DWH is different and you
need to create custom solutions for specific applications - just to cope
with the exceptional data volume. But then again, maybe most DWH's
aren't that big and can be tackled with a more standardized solution.
Kind regards
robert