- Get row counts on all jobs in a sequence, all jobs or just one job.
- Installing EtlStats.
- Sample reports from EtlStats. Sample records for ETL_QA tables.
- Jobs and routines to extract information about jobs.
- Documentation for routines
- Routines for Generate create table scripts from DS_METADATA.,Display metadata mismatches,Put a standard long description on a job. ,Get last warning message from log file,Get shell based on OS (DOS or SH),Compare first row of sequential file with column names to lengths.
- Backup all DataStage projects on a server.
- Korn Shell, Perl, Universe and Vi help files.
- Xml Best Practices
- Tech Tips From Ascential now IBM
Saturday
Duke Consulting Tips & Tricks for Datastage
Kim Duke has been providing wonderful tips and tricks for Ascential Datastage.You can find and gain lot of information on extracing etl job statistics ,routines,basic shell scripting and much more at Duke Consulting Tips & Tricks
You can download all these documents and improve your job performance and capture job statistics.
The starting point for performance tuning is to get and track row counts. Rows per second is the leading indicator of problems. If rows start slowing down over time then why. EtlStats.zip conatins jobs and documentation to get row counts. We run this job at the end of each job sequence. The results are stored in Oracle. The DDL to create the tables is included. Also included is DSaveAsBmp.bat which will create bmp images for each job. Makes for great documentation.
