About Software –

Ab Initio Version: Co-operating system, GDE, EME

Database Version: Oracle, Sybase

Operating Systems: Ubuntu, Windows

Introduction & Connectivity

1. Ab Initio – An Introduction
2. Ab Initio Products – An Overview
3. Ab Initio Architecture
4. Parallelism in Ab Initio
5. GDE Overview
6. Establishing Connection from GDE to Co-Op and EME

Different Source Systems & Record Format Types

Data Manipulation Language

1. Fixed Length/Delimited/Mixed DML
2. Dml Creation for Other Than Flat Files

Data set Components

1. Input/ Output File/Adhoc File System
2. Lookup File/Dynamic Lookup
3. Intermediate File
4. Read Multiple files
5. Write Multiple files

XML\JSON\Excel Components –

1. Read/Write XML,ExcelSheets

Program & Design Mechanisms

Key and Expression Components

1. Sort
2. Dedup Sorted
3. Filter By Expression
4. Sort within Groups
5. Redefine Format

Transform Components

1. Reformat
2. Scan
3. Rollup
4. Join
5. Fuse
6. Normalize

Partition Components

1. Partition By Key/Key & Sort
2. Partition By Expression
3. Partition By Range, Find Splitters
4. Partition By Round Robbin

DePartiton Components

1. Gather
2. Merge
3. Concatenate
4. Interleave

Parallelism & Data Flow Process

Multifile System

1. Creation Of Multi File System/Control/Data Files
2. Multi File Based M_ Commands
3. Working with Parallelism

Staging Recovery & Root Cause Debugging

Phases & Checkpoints

Debugging –

1. Breakpoints
2. Watchers
3. Tracking Files

Rollback (m_rollback, m_cleanup) and Recovery Mechanism

Validate & Test Data Creation

Miscellaneous Components

1. Generate Records\Create Data
2. Replicate
3. Redefine
4. Run Program
5. Trash

Validate Functions and User Defined Validate Functions Database Components –

1. Run SQL
2. Input/output Table
3. Join with DB Table
4. Update DB Table

Database And Warehouse building

Types of Dimensions

Key Generation

1. Surrogate Key Generation By Next_in_sequence() or Invocation number()
2. Assign Keys

Slowly Changing Dimension Implementation

1. Type 1,2,3

Generic & Dynamic Programming

1. Parameters – An Introduction, Types, Interpretation
2. PSET creation & execution
3. Generic Graphs, Framework Design
4. Parameter Definition Language Metaprogramming (DML and Parameter Evaluations)
   1. Dynamic XFR Generation
   2. Dynamic Key Preparation
   3. File Operation
   4. Dynamic Function Preparation
   5. Dynamic DML Operations
   6. Dynamic Multistage Package Preparation

Repository Management & Migration

1. Introduction to EME
2. Project Creation
3. Code Check in/Check Out
4. Versioning & Tagging
5. Save Files & Promotion
6. AIR commands

Scheduling

1. Wrapper Scripts
2. Job Scheduling in Third Party Tools(Autosys, Control M)

Conduct It

1. Plan Task
2. Graph Task
3. Program Task
4. Sub plan
5. Wait For File
6. Wait For Event

Coding Standards & Tuning

1. Performance Tuning
2. Ab Initio m_commands
3. Typecasting, Char Conversion, Max Core Prediction.

Data Lineage

1. Metadata Hub

Monitoring & Centralization

1. Control Center

Rule Creation

1. Business Rules Engine Introduction
2. Express IT Adoption Of BRE
3. Working with EXPRESS IT and Making Dynamic Transform Rules.

Exercise

1. Scenario Based Exercises