Showing posts with label QualityStage. Show all posts
Showing posts with label QualityStage. Show all posts

Saturday

Investigating source data using Investigate Stage

Investigating source data using Investigate Stage

Learn how to set up and process an Investigate job to provide data from which you can create reports in the IBM Information Server Web console.

Follow these steps to set up and link an Investigate job

Create a QualityStage job by adding Data Quality stages and DataStage sequential files and stages to the Designer canvas. Connect the stages together for the flow of data from source file to each stage.

The job should contain a Sequential file(Source File)--->Copy Stage--->2 Investigate Stages --->Sequential Files(3 Files.Name,AreaToken,Area Pattern)
Check this diagram for the job canvas

Introduction to WebSphere QualityStage

WebSphere QualityStage comprises a set of stages, a Match Designer, and related capabilities that provide a development environment for building data-cleansing tasks called jobs.
Using the stages and design components, you can quickly and easily process large stores of data, selectively transforming the data as needed.
WebSphere QualityStage provides a set of integrated modules for accomplishing data re-engineering tasks:
  • Investigating
  • Conditioning (standardizing)
  • Designing and running matches
  • Determining which data records survive
The probabilistic matching capability and dynamic weighting strategies of WebSphere QualityStage help you create high-quality, accurate data and consistently identify core business information such as customer, location, and product throughout the enterprise. WebSphere QualityStage standardizes and matches any type of information. By ensuring data quality, WebSphere QualityStage reduces the time and cost to implement CRM, business intelligence, ERP, and other strategic customer-related IT initiatives.
Scenarios for data cleansing
Organizations need to understand the complex relationships that they have with their customers, suppliers and distribution channels. They need to base decisions on accurate counts of parts and products to compete effectively, provide exceptional service, and meet increasing regulatory requirements. Consider the following scenarios:
  1. Banking: One view of households
To facilitate marketing and mail campaigns, a large retail bank needed a single dynamic view of its customers’ households from 60 million records in 50 source systems. The bank uses WebSphere QualityStage to automate the process. Consolidated views are matched for all 50 sources, yielding information for all marketing campaigns. The result is reduced costs and improved return on the bank's marketing investments. Householding is now a standard process at the bank, which has a better understanding of its customers and more effective customer relationship management. 2.Pharmaceutical: Operations information A large pharmaceutical company needed a data warehouse for marketing and sales information. The company had diverse legacy data with different standards and formats, information that was buried in free-form fields, incorrect data values, discrepancies between field metadata and actual data in the field, and duplicates. It was impossible to get a complete, consolidated view of an entity such as total quarterly sales from the prescriptions of one doctor. Reports were difficult and time-consuming to compile, and their accuracy was suspect. Most vendor tools lack the flexibility to find all the legacy data variants, different formats for business entities, and other data problems. The company chose WebSphere QualityStage because it goes beyond traditional data-cleansing techniques to investigate fragmented legacy data at the level of each data value. Analysts can now access complete and accurate online views of doctors, the prescriptions that they write, and their managed-care affiliations for better decision support, trend analysis, and targeted marketing. 3.Insurance: One real-time view of the customer A leading insurance company lacked a unique ID for each subscriber, many of whom participated in multiple health, dental, or benefit plans. Subscribers who visited customer portals could not get complete information on their account status, eligible services, and other details. Using WebSphere QualityStage, the company implemented a real-time, in-flight data quality check of all portal inquiries. WebSphere QualityStage and WebSphere MQ transactions were combined to retrieve customer data from multiple sources and return integrated customer views. The new process provides more than 25 million subscribers with a real-time, 360-degree view of their insurance services. A unique customer ID for each subscriber is also helping the insurer move toward a single customer database for improved customer service and marketing.