Sunday

Basic Datawarehousing Concepts

  • Data Warehousing A subject-oriented, integrated, time-variant, and nonvolatile collection of data in support of decision-making process.
  • Data Marts
    1. R. Kimball - “a data mart is a flexible set of data, ideally based on the most atomic (granular) data possible to extract from operational source, and presented in a symmetric (dimensional) model that is resilient when faced with unexpected user queries”
    2. “in its most simplistic form a data mart represent data from a single business process” Business process = purchase order, store inventory, etc Definitions

  • OLAP = On-line Analytical Processing

    A reporting system designed to allow different flexible analysis in real time, on-line, with data structures designed for fast retrieval, with redundancy included to support performance. Note: “On-line” doesn’t indicate data from on-line systems, rather on-the-fly


  • OLAP Basics
    1. Drill-down - decreasing the level of aggregation
    2. Drill-up/Roll-up - increasing the level of aggregation
    3. Drill-across - move between different star-join schemas using conformed dimensions and joins
    4. Slicing and dicing – ability to look at the database from different views, e.g. one slice shows all sales of product type within regions, another slice shows all sales by sales channel within each product type
    5. Pivoting - e.g. change columns to rows, rows to columns
    6. Ranking - sorting


  • Business Intelligence (BI)

    Forrester definition: A process of transforming data into information and making it available to users in time to make a difference.


  • Strategic BI (Examples: Balance scorecard, Strategic Planning)
    1. Who: strategic leaders
    2. What: formulate strategy and monitor corporate performance.

  • Operational BI (Examples: Budgeting, Sales forcasting)
    1. Who: operational managers
    2. What: execution of strategy againts objectives.

  • Analytical BI (Examples: Financial and Sales Analysis, Customer Segmentation, Clickstream analysis)
    1. Who: analysts, knowledge worker, controller
    2. What: ad-hoc analysis.

  • Dimensional Modeling The process and outcome of designing logical database schemas created to support OLAP and Data Warehousing solutions. THE Definition
  • OLTP = On Line Transactional Processing – Each transaction must be written to the database in real time, i.e. “on line” Transactional System Emphasis
  • Data structures must enable consistent and fast writing.