SSIS Classroom Training (Integration Services with ETL & DWH)

SSIS provides Data Extraction, Consolidation and Loading Options (ETL), SQL Server Coding enhancements, Data Warehousing and Customizations for SQL Server Developers, Administrators, BI Engineers and Data Analysts. In our SSIS Training course, we deal with complete SSIS Design, Development and Deployment & Management of Various ETL Transformations, Data Loads, Data Cleansing, Incremental Data Loading Techniques including DWH Design, Management, SCD, Profiling, Tuning and Fact Table Loads. This SSIS Classroom Training course also includes Azure Data Factory (ADF) Pipelines and SSIS Package Migrations to ADF with Self Hosted and Integrtion Runtime ENgines, Stored Procedures Executions, Watermark Columns and Azure Data Lake with SSIS Integrations. All sessions are completely practical and realtime.

SSIS (Integration Services) Training Plans

	PLAN A	PLAN B	PLAN C
Description	SSIS	T-SQL & SSIS	T-SQL & SSIS, ADF
Total Duration	2.5 Weeks	5 Weeks	8 Weeks
SSIS: Control Flow, Data Flow; SSIS DB
SSIS: Static & Dynamic Connections
SSIS: ETL, Data Warehouse Design
SSIS: Transformations, Data Loads
SSIS: Data Cleansing, Lookups
SSIS: Catalog Databases, Usage
SSIS: Deployments, Migrations
SSIS : Star & Snowflake Schemas
SQL : Basics, DDL, DML, SELECT	❌
T-SQL : Constraints, Normal Forms	❌
T-SQL: Joins, Group By, Queries	❌
T-SQL: Merge, Pivot, Date & Time Formats	❌
T-SQL: Excel Integrations, Pivot Charts	❌
ADF : Azure Data Factory Architecture	❌	❌
ADF : Azure Data Warehouse Concepts	❌	❌
ADF : Massively Parallel Processing (MPP)	❌	❌
ADF : Copy Data Tool and ADF Portal	❌	❌
ADF : Stored Procedures For Incremental Loads	❌	❌
ADF : SSIS Package Migrations to Azure	❌	❌
Total Course Fee *	INR 5500	INR 7500	INR 15000

Trainer: Mr. Sai Phanindra T

S. No	Timings (IST)	Start Date
SSIS Training Schedules
1	7:15 AM - 8:15 AM	May 14th	Register
2	5 PM - 6 PM	Apr 10th	Register
Schedules for SQL Server Basics
1	6:15 AM - 7:15 AM	May 12th	Register
2	8:15 AM - 9:15 AM	Apr 21st	Register
3	9:30 AM - 10:30 AM	Apr 10th	Register
4	10:30 AM - 11:30 AM	Apr 28th	Register
5	11:30 AM - 12:30 PM	May 26th	Register
6	6 PM - 7 PM	May 18th	Register
7	7 PM - 8 PM	June 2nd	Register
8	8 PM - 9 PM	May 4th	Register

If above schedule does not work, opt for SSIS Training Videos

SSIS TRAINING HIGHLIGHTS :

✔ Basic to Adv. ETL	✔ Basic to Adv. DAX
✔ Data Modelling	✔ OLAP DB Design
✔ Power Query	✔ Basic to Adv. MDX
✔ Kimball BI Design	✔ Inmon BI Design
✔ Star, Snowflake	✔ Data Warehousing
✔ OLTP, File Data	✔ JSON, XML Data
✔ Resume Guidance	✔ MCSA MSBI Exam

All Session Are Completely Practical & Real Time

SSIS Classroom Training Course Contents:

Curriculum

Register Today

Module 1 : SQL Server & T-SQL Queries

Ch 1: SQL SERVER INTRODUCTION

Data, Databases and RDBMS Software
Database Types : OLTP, DWH, OLAP
Microsoft SQL Server Advantages, Use
Versions and Editions of SQL Server
SQL : Purpose, Real-time Usage Options
SQL Versus Microsoft T-SQL [MSSQL]
Microsoft SQL Server - Career Options

SQL Server Components and Usage
Database Engine Component and OLTP
BI Components, Data Science Components
ETL, MSBI and Power BI Components
Course Plan, Concepts, Resume, Project
24 x 7 Online Lab for Remote DB Access
Software Installation Pre-Requisites

Ch 5: SQL Basics - 3, T-SQL INTRO

Database Objects : Tables and Schemas
Schemas : Group Tables in Database
Schemas : Security Management Object
Creating Schemas & Batch Concept
Using Schemas for Table Creation
Data Storage in Tables with Schemas
Data Retreival and Usage with Schemas
Table Migrations across Schemas

Import and Export Wizard in SSMS
Data Imports with Excel File Data
Performing Bulk Operations in SSMS
Temporary Tables : Real-time Use
Local and Global Temporary Tables
# and ## Prefix, Scope of Usage

Ch 9: JOINS, T-SQL QUERIES Level 3

GetDate, Year, Month, Day Functions
Date & Time Styles, Data Formatting
DateAdd and DateDiff Functions
Cast and, Convert Functions in Queries
String Functions: SubString, Relicate
Len, Upper, Lower, Left and Right
LTrim, RTrim, CharIndex Functions

MERGE Statement - Comparing Tables
WHEN MATCHED and NOT MATCHED
Incremental Load with MERGE Statement
IIF() Function for Value Compares
CASE Statement : WHEN, ELSE, END
ROW_NUMBER() and RANK() Queries
Dense Rank and Partition By Queries

Ch 2: SQL SERVER INSTALLATIONS

System Configuration Checker Tool
Versions and Editions of SQL Server
SQL Server and SSMS Installation Plan
SQL Server Pre-requisites : S/W, H/W
SQL Server 2016 / 2017 Installation
SQL Server 2019 Installation
Instance Name and Server Features
Instances : Types and Properties

Default Instance, Named Instances
Port Numbers, Instance Differences
Service and Service Account Use
Authentication Modes and Logins
Windows Logins and SQL Logins
FileStream and Collation Properties

Ch 6 : CONSTRAINTS,INDEXES Basics

Constraints and Keys - Data Integrity
NULL, NOT NULL Property on Tables
UNIQUE KEY Constraints: Importance
PRIMARY KEY Constraint: Importance
FOREIGN KEY Constraint: Importance
REFERENCES, CHECK and DEFAULT
Candidate Keys and Identity Property

Database Diagrams and ER Models
Relationships Verification and Links
Indexes : Basic Types and Creation
Index Sorting and Search Advantages
Clustered and NonClustered Indexes
Primary Key and Unique Key Indexes
Need for Indexes - working with Keys

Ch 10: VIEW, SPs, Function Basics

Views : Types, Usage in Real-time
System Predefined Views and Audits
Listing Databases, Tables, Schemas
Functions : Types, Usage in Real-time
Scalar, Inline and Multi-Line Functions
System Predefined Functions, Audits
DBId, DBName, ObjectID, ObjectName
Variables & Parameters in SQL Server

Procedures : Types, Usage in Real-time
User & System Predefined Procedures
Parameters and Dynamic SQL Queries
Sp_help, Sp_helpdb and sp_helptext
sp_pkeys, sp_rename and sp_help
Important System Objects and Metadata

Ch 3: SSMS Tool, SQL BASICS - 1

SQL Server Management Studio
Local and Remote Connections
System Databases: Master and Model
MSDB, TempDB, Resource Databases
Creating Databases : Files [MDF, LDF]
Creating Tables in User Interface
Data Insertion & Storage. Limitations

SQL : Purpose and Real-time Usage
SQL Versus T-SQL : Basic Differences
DDL, DML, SELECT, DCL and TCL
Creating Tables using SQL Scripts
Data Storage, Inserts - Basic Level
Table Data Verifications with Select
SELECT Statement for Table Retrieval

Ch 7: JOINS, T-SQL Queries : Level 1

JOINS - Table Comparisons Queries
INNER JOINS For Matching Data
OUTER JOINS For (non) Match Data
Left Outer Joins with Example Queries
Right Outer Joins with Example Queries
FULL Outer Joins - Realtime Scenarios
Join Queries with "ON" Conditions

Join Unrelated Tables in SQL Server
NULL, IS NULL Operators in Joins
CROSS JOIN and CROSS APPLY
CROSS JOIN Versus CROSS APPLY
One-way & Two Way Data Comparisons
Important Join Queries in T-SQL
Join Options: Merge, Loop, Hash

Ch 11: Triggers & Transactions

Triggers - Purpose, Real-world Usage
FOR/AFTER Triggers - Real time Use
INSTEAD OF Triggers - Real time Use
INSERTED, DELETED Memory Tables
Using Triggers for Data Replication
Enable Triggers and Disable Triggers
Database Level, Server Level Triggers

Transactions : Types, ACID Properties
Transaction Types and AutoCommit
EXPLICIT & IMPLICIT Transactions
COMMIT and ROLLBACK Statements
Open Transaction Scenarios & Cause
Query Blocking Scenarios @ Real-time
NOLOCK and READPAST Lock Hints

Ch 4: SQL BASICS - 2

Creating Databases & Tables in SSMS
Single Row Inserts, Multi Row Inserts
Rules for Data Insertion Statements
SELECT Statement @ Data Retrieval
SELECT with WHERE Conditions
Batch Concept and Go Statement
AND and OR Operators Usage
IN Operator and NOT IN Operator

Between, Not Between Operators
LIKE and NOT LIKE Operators
UPDATE Statement & Conditions
DELETE & TRUNCATE Statements
Logged and Non-Logged Operations
ADD, ALTER and DROP Columns
ALTER & DROP Table Statements

Ch 8: Group By, T-SQL Queries Level 2

GROUP BY Queries and Aggregations
Group By Queries with Having Clause
Group By Queries with Where Clause
Using WHERE and HAVING in T-SQL
Rollup : Usage and T-SQL Queries
Cube : Usage and T-SQL Queries
UNION and UNION ALL Operator
EXISTS Operator, Query Conditions

Sub Queries and Alternatives to Joins
Using Joins with Group By Queries
Using Joins with Nested Sub Queries
Sub Queries with Joins and Group By
Using UNION and UNION ALL in Queries
Nested Sub Queries with Group By, Joins
Comparing WHERE, HAVING Conditions

Ch 12 : ER MODELS, NORMAL FORMS

Normal Forms for Entity Relationships
First Normal Form and Atomocity
Second Normal Form, Candidate Keys
3rd Normal Form Multi Value Dependancy
Boycee-Codd Normal Form : BNCF
Fourth Normal Form Realtime Advantages
Self Joins & Self Reference Keys
1:1, 1:M, M:1, M:M Relationship Types

Joins with Group By Queries
Joins with Sub Queries, Formating
Office Data Connections, Excel Reports
Excel Pivot Reports and Reports
SQL Queries (Auto Generated) in BI Tools
FETCH OFFSET, NEXT ROWS, Order By
Data Refresh (Manual and Automated)

Real-time Case Study - 1 (Sales & Retail)
Objective : Database Design, Table Design and Relations.
Involves Purchases, Products, Customers and Time Data with Various Data Types.

Real-time Case Study - 2 (Sales & Retail)
Objective : Queries, Excel Integration
Pivot Tables, Pivot Charts, ODC Connections

Module 2 : SSIS Training

Module I: Basic SSIS Development & ETL - DWH	Module II: Advanced SSIS Development & Deployments
Ch 1: SSIS INTRODUCTION & INSTALLATION Need for SQL Server Integration Services (SSIS) & ETL / DWH Advantages of SSIS for Data Loads, Operations, ETL, Warehouse SSIS Tools : SSDT (SQL Server Data Tools), ETL Wizards SSIS Design / Development and LIVE (Deployment) Environment Understanding Data Warehouse (DWH) Design and ETL Process DWH and ETL Structures, Implementations with MSBI SSIS SSIS ETL Operations for Data Reads, Data Cleansing, DWH Data Warehouse (DWH) Design Principles and Design Plan SSIS 2019 and SSIS 2017 : SSIS Database Installations SSIS Database & Catalog Folders - Purpose, Usage, Passwords SSIS Catalog Database (SSIS DB) : Creation, Verification SSDT Tool: SQL Server Data Tools - SSDT / Visual Studio Shell SSDT Installation and Verification of SSIS Templates Basic Vocabulary - SSIS, ETL, DWH, Data Flow, Data Buffer SSIS Package Environment and SSDT Project Creation SSIS Solutions and Project Templates - Verifications Version Control Options and SSIS Design Plan - Tools Usage SSIS & ETL Training - Lab Plan, Resources & Work Flow	Ch 7: CHECKSUM TRANSFORMATION, DWH DESIGN Configuring Checksum Transformation : 2019, 2017 Versions Checksum Transformation Logic and Parity Checks (CRC) Codes Working with CHECKSUM Transformation & Parity Bit Columns Generating Checksum Values For Type I, Type II ETL Changes DWH Dimension Tables With Checksum Transformation Working with Parity Bits, Conditional Lookup Transformation Row Redirection Options & Lookup Match, NonMatch Output OLE DB Command: SQL Statements and Input Parameters Parameter Mapping Options and Dynamic SQL for Row Updates Cache Transformation with Memory Loads, CAW Files (VM) Memory Connections and Reuse. Lookup with Cache Options Tuning Lookup Transformation: Caching Options, Index Options FULL CACHE & PARTIAL CACHE. Cache Connection Manager Pre-ETL Data Load Operations with Memory Connections Lookup with NOCACHE Options. Dependent Data Flow Tasks Post ETL, Derived Column and Fuzzy Transformations SSIS Package Internal Parameters and Query Updates OLEDB Command with Conditional Splits, Multi Row Updates
Ch 2: SSIS ETL PACKAGES: EXTRACT,TRANSFORM,LOAD Control Flow Tasks - Architecture, Purpose and Usage Data Flow Tasks - Architecture, Purpose and Usage Creating SSIS Packages For Basic Data Flow Operations SSIS Solutions, Projects and Package Creation. Tasks Need For Data Pipelines & Connections in Data Flow Tasks Understanding SSIS Package (Program) Execution Process Working with Data Flow Objects and Tasks in SSIS Using OLE DB and SQL Server Connections - Usage SSIS Package Creation Process - Using Control Flow Items Using DTSX Files for SSIS Package Execution. Audits SSIS Execution Context, SSIS Package Errors and Logs Data Flow Transformation: Conditional Split, Expressions Excel Connections, Sheets, & Memory References - Usage Using Source Assistants, Destination Assistants @ SSIS DAT File Imports, Data Flow Options, Adding Annotations SSIS Project Configuration Options - Debugging, Bit Config SSIS 64 Bit and 32 Bit Configuration Settings and Options	Ch 8: CHANGE DATA CAPTURE: DWH DIMENSIONS Understanding CDC Tables with SQL Server Connections DML Audits: Inserts, Deletes, Values before/after Updates CDC Source Connections - Usage, ADO.NET Integration CDC Control Flow Tasks and CDC State Tasks. Values INITIAL LOAD START / END. PRCESSING RANGE Using State Variables and Controls. Storing States SSIS CDC Source Connections with Net Support Changes SSIS CDC Control Tasks and Caching, State Variables Understanding State Variables and SSIS Logging Tables Initial and Incremental Dimension Loads with CDC Dynamic CDC Connections, Parameter Mapping Integrating Control Flow and Data Flow for CDC @ ETL CDC Splitter Transformation - Row Inserts and Updates CDC Splitter Precautions, Input Types and Output Range Master Packages and Child Packages, Derived Columns Defining Local and Global Variables/Parameters Parameter Bindings with Parent - Child Packages
Ch 3: MERGE, FUZZY LOOKUP, DATA CONVERSION MERGE Transformation and UNION ALL Transformation SORT Transformation, NOSORT Options, Advanced Sort Synchronous & Asynchronous Transformations, Data Loads Row and Partial Blocking Transformations. Buffer Reuse Fully Blocking Transformations - Buffer Reuse Restrictions Examples to Avoid Fully Blocking Transformation in SSIS Bulk Load Operations and Data Import Options in SSIS IsSorted and SortKey Positions with Advanced Options Measuring SSIS Package Performance & Resource Usage Data Conversion Transformation and SSIS Expressions Fuzzy Lookup Transformation, Reference Table Connections Exact, Fuzzy & Nomatch Data Cleansing with Conditional Split Index Creation, Maintenance for Faster Lookup Transformation Data Conversion Transformation - Usage. Derived Columns Data Conversion Transformation: NVARCHAR, VARCHAR Data Threshold Values Selection, Search Delimiters and Options Data Pipeline with _Similarity, _Confidence Columns. Usage Explicit Data Type Conversions and Usage. Error Redirections	Ch 9: FACT TABLE DESIGN, FACT LOADS (DWH) Fact Table - Design and Implementation Rules, ER Model Fact Table Design with STAR and SNOWFLAKE Schemas Time Dimensions - Purpose, Usage and ETL Date / Time Generating Time Dimensions for ETL, Load Identification Parent-Child Packages for Dimensional Loads, Control Flow Parent-Child Packages for Dimensions & Fact Table Loads Master Package Design: Dimension, Fact Load Integration Inferred Members and Status for NULLs in Dimensions Parameter Mapping @ ETL Updates, Component Properties ETL Load Date IDs & Expressions for Dimension Keys Error Handling & Event Handling with Master Packages Text Qualifiers and Parameters in Master-Child Packages Key Based Dimension LOOKUPs and Indexes. Fast Loads SCD Implementations with Legacy Data. ETL Load Types Fact Load Design for Initial Loads, Incremental Updates End-to-End Data Warehouse Design: Implementation Direct Data Loads and Data Stage Operations for DWH DBs STAR & SNOWFLAKE Schemas for DWH - Data Modelling
Ch 4: PACKAGE PROPERTIES, CHECKPOINT, PIVOT Execute SQL Task and OLE DB Queries - Connection Options Transaction Options For SSIS Executables - Package Level Precedence Constraints - Success / Failure / Completion SSIS Package Level Rollbacks and Restart Execution Options SSIS Checkpoints - Purpose and Usage with Data Flow Tasks Checkpoint Files and SSIS Logging Options - Package, Tasks Transactions with Checkpoint File Usage in SSIS Packages Checkpoint Options - Advantages, Usage and Limitations FailPackageOnFailure Options and Checkpoint Property Usage Transaction Property : REQUIRED / SUPPORT, NOTSUPPORTED Transaction Property Versus CHECKPOINT Files, Usage Importing Legacy Data, Need for Data Cleansing, Formatting Understanding Denormalization and Keys. Need for OLTP PIVOT Transformation, Data Reads, Connection Assistant Pivot Usage Values - Purpose and Implementation. Key Values Lineage ID in SSIS - Purpose, Usage Options. Data Mappings Lineage IDs for Column Mapping and Pivot Keys SSIS Input Columns, Mappings and Source Column Values Using Data Viewer (Debugging) for Data Transfer Verifications Explicit Data Type Conversions, Usage. Error Redirections	Ch 10: DWH MIGRATIONS with SSIS, SCRIPT Task DataWarehouse Migrations with SSIS Control Flow Using SSIS Containers and Db Integrity Task Using Pre-Database Migration Tasks, Precautions Transfer Database Task and DB File Options Online and Offline DB Transfer Options, Usage Copy / Move Options with DWH Migrations SMTP : Simple Mail Transfer Protocol For Emails Using SQL Server Agent Operators, Package Events Precedence Constraint with Containers, SSIS Tasks Using Data Profiling Task with ADO.NET Connectors XML Files Generation, Using SSIS Data Profiler Tool Script Task - Purpose and Working in SSIS Control Flow Script Task - Usage with VB.NET Programs. Compilations Variables and Parameters with SSIS Script Task. Usage Read Only and Read Write Variables. Expressions, Mapping Data Flow Limitations : Solutions with .NET Scripting SSIS Expressions and Package Debugging, Break Points SSIS Variables and Parameters - Mapping Expressions Using Control Flow File System Tasks and Limitations SQLDataAdapters & System.Data.SQLClient Connections
Ch 5: SSIS with ETL & DWH. SCD TYPE 1, TYPE 2 SSIS Package Events : Validation Events, Execution Events PreExecution, Progress and Cleanup Events in SSIS Auditing SSIS Events, Errors / Warnings / Information Configuring and Using sysssislog System Tables Package Debugging : Data Viewers and Breakpoints ForEach Loop Container Usage. File Connections, Variables Defining Variables for Connections. DFT, Control Flow Links Dynamic Connections with Variables. Connection Strings Connection Iterations, Connection Fetch, Index Mapping SSIS Expressions and Usage for ETL and DWH FOR LOOP Expressions in SSIS, Examples for ETL InitExpression, EvalExpression, AssignExpression SSIS Expression Builder, Functions, Evaluated Values Data Insertions and Data Serializations with SSIS Counter Values, Variables and Parameter Mapping Using SSIS for OS Level Drive Operations, Loops Using Execute SQL Task : Variables, Return Values	Ch 11: SSIS PROJECT DEPLOYMENT, UPGRADES SSISDB Catalog Deployments - Process & ISPAC Files SSIS Package Builds, Verification Techniques, Scripts SSIS Project Deployment Wizard : Targets and Logging SSIS DB Catalog Folders - Creation, Usage. Properties SSIS DB Catalog Projects - Creation, Usage. Properties SSIS Package Executions - Scripts, Reports, Messages Package Validations - Scripts, Reports, 32/64 bit Options Package Configurations - Parameter Management, Scripts SSIS Package Jobs @ SQL Server Agent. SSIS Job Steps SSIS Job Schedules and Notifications: Windows Event Logs Package Security Management - SSISDB Logins and Users Folder Level and Project Level Security Implementation Project Migration Utilities and Package Upgrades SSIS Package Imports and Exports with ISPAC Files Command-Line Deployments For SSIS, Execution Utilities SSIS Package Execution Reports; Validation Reports SSIS Package Versions and Restores, SSIS Rollbacks
Ch 6: DATAWAREHOUSE (DWH) DESIGN WITH SSIS Introduction to Datawarehouse (DWH) - Purpose, Usage, Access Technical Terms: Dimensions, Attributes, Members and Types Dimension Tables, Fact Tables and Relations, Inferred Members TYPE1 and TYPE2 Changes. ETL Implementation Techniques Implementing Type I Changes (SCD) for DWH : Sales Scenario Dimensional Table Design for DWH using SCD - Type 1, Type 2 Initial Data Loads with Legacy Files (DAT, TXT, CSV), Data Marts Working with Business Keys & non Identity Key Based Columns Surrogate Keys and Alternate Business Keys - Purpose, Usage Identity Columns, Key Values in DWH. Business Key Limitations Cascading Source OLTP / Stage Changes to DWH Inactive Rows Changes to Fixed Attributes, Changing Attributes. Observations Changes to Historical Attributes. Inferred Member Updated ETL Date Fields, Row Status Values and Transformations Designing Dimensions for DW - Incremental, Historical Loads Historical Attributes, Data Delta Operations, Identification SSIS SCD Transformation Limitations and Real-time Issues	Ch 12: SSIS PROJECT [ECommerce Domain] SSIS ETL & DWH with STAR Schema SSIS ETL & DWH with SNOWFLAKE Schema Dimension Table Design & Business Keys Fact Table Design & Data Integrity Incremental Data Loads with Containers Key Lookup and Business Key Identification Staging Tables, Master - Child Packages SSIS Package Deployment [Catalog Deployments] SSIS Training : Project Specifications Project Explanation and Solution Project FAQs and Resume Support Chapter Wise FAQs and Answers Concept Wise Tasks and Solutions SSIS DWH Databases with Reports Technical Resume Points in SSIS SSIS Limitations and Need for ADF End to End Implementation [MSBI]

Module I: Basic SSIS Development & ETL - DWH

Module II: Advanced SSIS Development & Deployments

Ch 1: SSIS INTRODUCTION & INSTALLATION

Need for SQL Server Integration Services (SSIS) & ETL / DWH
Advantages of SSIS for Data Loads, Operations, ETL, Warehouse
SSIS Tools : SSDT (SQL Server Data Tools), ETL Wizards
SSIS Design / Development and LIVE (Deployment) Environment
Understanding Data Warehouse (DWH) Design and ETL Process
DWH and ETL Structures, Implementations with MSBI SSIS
SSIS ETL Operations for Data Reads, Data Cleansing, DWH
Data Warehouse (DWH) Design Principles and Design Plan
SSIS 2019 and SSIS 2017 : SSIS Database Installations

SSIS Database & Catalog Folders - Purpose, Usage, Passwords
SSIS Catalog Database (SSIS DB) : Creation, Verification
SSDT Tool: SQL Server Data Tools - SSDT / Visual Studio Shell
SSDT Installation and Verification of SSIS Templates
Basic Vocabulary - SSIS, ETL, DWH, Data Flow, Data Buffer
SSIS Package Environment and SSDT Project Creation
SSIS Solutions and Project Templates - Verifications
Version Control Options and SSIS Design Plan - Tools Usage
SSIS & ETL Training - Lab Plan, Resources & Work Flow

Ch 7: CHECKSUM TRANSFORMATION, DWH DESIGN

Configuring Checksum Transformation : 2019, 2017 Versions
Checksum Transformation Logic and Parity Checks (CRC) Codes
Working with CHECKSUM Transformation & Parity Bit Columns
Generating Checksum Values For Type I, Type II ETL Changes
DWH Dimension Tables With Checksum Transformation
Working with Parity Bits, Conditional Lookup Transformation
Row Redirection Options & Lookup Match, NonMatch Output
OLE DB Command: SQL Statements and Input Parameters
Parameter Mapping Options and Dynamic SQL for Row Updates

Cache Transformation with Memory Loads, CAW Files (VM)
Memory Connections and Reuse. Lookup with Cache Options
Tuning Lookup Transformation: Caching Options, Index Options
FULL CACHE & PARTIAL CACHE. Cache Connection Manager
Pre-ETL Data Load Operations with Memory Connections
Lookup with NOCACHE Options. Dependent Data Flow Tasks
Post ETL, Derived Column and Fuzzy Transformations
SSIS Package Internal Parameters and Query Updates
OLEDB Command with Conditional Splits, Multi Row Updates

Ch 2: SSIS ETL PACKAGES: EXTRACT,TRANSFORM,LOAD

Control Flow Tasks - Architecture, Purpose and Usage
Data Flow Tasks - Architecture, Purpose and Usage
Creating SSIS Packages For Basic Data Flow Operations
SSIS Solutions, Projects and Package Creation. Tasks
Need For Data Pipelines & Connections in Data Flow Tasks
Understanding SSIS Package (Program) Execution Process
Working with Data Flow Objects and Tasks in SSIS
Using OLE DB and SQL Server Connections - Usage
SSIS Package Creation Process - Using Control Flow Items

Using DTSX Files for SSIS Package Execution. Audits
SSIS Execution Context, SSIS Package Errors and Logs
Data Flow Transformation: Conditional Split, Expressions
Excel Connections, Sheets, & Memory References - Usage
Using Source Assistants, Destination Assistants @ SSIS
DAT File Imports, Data Flow Options, Adding Annotations
SSIS Project Configuration Options - Debugging, Bit Config
SSIS 64 Bit and 32 Bit Configuration Settings and Options

Ch 8: CHANGE DATA CAPTURE: DWH DIMENSIONS

Understanding CDC Tables with SQL Server Connections
DML Audits: Inserts, Deletes, Values before/after Updates
CDC Source Connections - Usage, ADO.NET Integration
CDC Control Flow Tasks and CDC State Tasks. Values
INITIAL LOAD START / END. PRCESSING RANGE
Using State Variables and Controls. Storing States
SSIS CDC Source Connections with Net Support Changes
SSIS CDC Control Tasks and Caching, State Variables
Understanding State Variables and SSIS Logging Tables

Initial and Incremental Dimension Loads with CDC
Dynamic CDC Connections, Parameter Mapping
Integrating Control Flow and Data Flow for CDC @ ETL
CDC Splitter Transformation - Row Inserts and Updates
CDC Splitter Precautions, Input Types and Output Range
Master Packages and Child Packages, Derived Columns
Defining Local and Global Variables/Parameters
Parameter Bindings with Parent - Child Packages

Ch 3: MERGE, FUZZY LOOKUP, DATA CONVERSION

MERGE Transformation and UNION ALL Transformation
SORT Transformation, NOSORT Options, Advanced Sort
Synchronous & Asynchronous Transformations, Data Loads
Row and Partial Blocking Transformations. Buffer Reuse
Fully Blocking Transformations - Buffer Reuse Restrictions
Examples to Avoid Fully Blocking Transformation in SSIS
Bulk Load Operations and Data Import Options in SSIS
IsSorted and SortKey Positions with Advanced Options
Measuring SSIS Package Performance & Resource Usage

Data Conversion Transformation and SSIS Expressions
Fuzzy Lookup Transformation, Reference Table Connections
Exact, Fuzzy & Nomatch Data Cleansing with Conditional Split
Index Creation, Maintenance for Faster Lookup Transformation
Data Conversion Transformation - Usage. Derived Columns
Data Conversion Transformation: NVARCHAR, VARCHAR Data
Threshold Values Selection, Search Delimiters and Options
Data Pipeline with _Similarity, _Confidence Columns. Usage
Explicit Data Type Conversions and Usage. Error Redirections

Ch 9: FACT TABLE DESIGN, FACT LOADS (DWH)

Fact Table - Design and Implementation Rules, ER Model
Fact Table Design with STAR and SNOWFLAKE Schemas
Time Dimensions - Purpose, Usage and ETL Date / Time
Generating Time Dimensions for ETL, Load Identification
Parent-Child Packages for Dimensional Loads, Control Flow
Parent-Child Packages for Dimensions & Fact Table Loads
Master Package Design: Dimension, Fact Load Integration
Inferred Members and Status for NULLs in Dimensions
Parameter Mapping @ ETL Updates, Component Properties

ETL Load Date IDs & Expressions for Dimension Keys
Error Handling & Event Handling with Master Packages
Text Qualifiers and Parameters in Master-Child Packages
Key Based Dimension LOOKUPs and Indexes. Fast Loads
SCD Implementations with Legacy Data. ETL Load Types
Fact Load Design for Initial Loads, Incremental Updates
End-to-End Data Warehouse Design: Implementation
Direct Data Loads and Data Stage Operations for DWH DBs
STAR & SNOWFLAKE Schemas for DWH - Data Modelling

Ch 4: PACKAGE PROPERTIES, CHECKPOINT, PIVOT

Execute SQL Task and OLE DB Queries - Connection Options
Transaction Options For SSIS Executables - Package Level
Precedence Constraints - Success / Failure / Completion
SSIS Package Level Rollbacks and Restart Execution Options
SSIS Checkpoints - Purpose and Usage with Data Flow Tasks
Checkpoint Files and SSIS Logging Options - Package, Tasks
Transactions with Checkpoint File Usage in SSIS Packages
Checkpoint Options - Advantages, Usage and Limitations
FailPackageOnFailure Options and Checkpoint Property Usage
Transaction Property : REQUIRED / SUPPORT, NOTSUPPORTED
Transaction Property Versus CHECKPOINT Files, Usage

Importing Legacy Data, Need for Data Cleansing, Formatting
Understanding Denormalization and Keys. Need for OLTP
PIVOT Transformation, Data Reads, Connection Assistant
Pivot Usage Values - Purpose and Implementation. Key Values
Lineage ID in SSIS - Purpose, Usage Options. Data Mappings
Lineage IDs for Column Mapping and Pivot Keys
SSIS Input Columns, Mappings and Source Column Values
Using Data Viewer (Debugging) for Data Transfer Verifications
Explicit Data Type Conversions, Usage. Error Redirections

Ch 10: DWH MIGRATIONS with SSIS, SCRIPT Task

DataWarehouse Migrations with SSIS Control Flow
Using SSIS Containers and Db Integrity Task
Using Pre-Database Migration Tasks, Precautions
Transfer Database Task and DB File Options
Online and Offline DB Transfer Options, Usage
Copy / Move Options with DWH Migrations
SMTP : Simple Mail Transfer Protocol For Emails
Using SQL Server Agent Operators, Package Events
Precedence Constraint with Containers, SSIS Tasks
Using Data Profiling Task with ADO.NET Connectors
XML Files Generation, Using SSIS Data Profiler Tool

Script Task - Purpose and Working in SSIS Control Flow
Script Task - Usage with VB.NET Programs. Compilations
Variables and Parameters with SSIS Script Task. Usage
Read Only and Read Write Variables. Expressions, Mapping
Data Flow Limitations : Solutions with .NET Scripting
SSIS Expressions and Package Debugging, Break Points
SSIS Variables and Parameters - Mapping Expressions
Using Control Flow File System Tasks and Limitations
SQLDataAdapters & System.Data.SQLClient Connections

Ch 5: SSIS with ETL & DWH. SCD TYPE 1, TYPE 2

SSIS Package Events : Validation Events, Execution Events
PreExecution, Progress and Cleanup Events in SSIS
Auditing SSIS Events, Errors / Warnings / Information
Configuring and Using sysssislog System Tables
Package Debugging : Data Viewers and Breakpoints
ForEach Loop Container Usage. File Connections, Variables
Defining Variables for Connections. DFT, Control Flow Links
Dynamic Connections with Variables. Connection Strings
Connection Iterations, Connection Fetch, Index Mapping

SSIS Expressions and Usage for ETL and DWH
FOR LOOP Expressions in SSIS, Examples for ETL
InitExpression, EvalExpression, AssignExpression
SSIS Expression Builder, Functions, Evaluated Values
Data Insertions and Data Serializations with SSIS
Counter Values, Variables and Parameter Mapping
Using SSIS for OS Level Drive Operations, Loops
Using Execute SQL Task : Variables, Return Values

Ch 11: SSIS PROJECT DEPLOYMENT, UPGRADES

SSISDB Catalog Deployments - Process & ISPAC Files
SSIS Package Builds, Verification Techniques, Scripts
SSIS Project Deployment Wizard : Targets and Logging
SSIS DB Catalog Folders - Creation, Usage. Properties
SSIS DB Catalog Projects - Creation, Usage. Properties
SSIS Package Executions - Scripts, Reports, Messages
Package Validations - Scripts, Reports, 32/64 bit Options
Package Configurations - Parameter Management, Scripts
SSIS Package Jobs @ SQL Server Agent. SSIS Job Steps

SSIS Job Schedules and Notifications: Windows Event Logs
Package Security Management - SSISDB Logins and Users
Folder Level and Project Level Security Implementation
Project Migration Utilities and Package Upgrades
SSIS Package Imports and Exports with ISPAC Files
Command-Line Deployments For SSIS, Execution Utilities
SSIS Package Execution Reports; Validation Reports
SSIS Package Versions and Restores, SSIS Rollbacks

Ch 6: DATAWAREHOUSE (DWH) DESIGN WITH SSIS

Introduction to Datawarehouse (DWH) - Purpose, Usage, Access
Technical Terms: Dimensions, Attributes, Members and Types
Dimension Tables, Fact Tables and Relations, Inferred Members
TYPE1 and TYPE2 Changes. ETL Implementation Techniques
Implementing Type I Changes (SCD) for DWH : Sales Scenario
Dimensional Table Design for DWH using SCD - Type 1, Type 2
Initial Data Loads with Legacy Files (DAT, TXT, CSV), Data Marts
Working with Business Keys & non Identity Key Based Columns

Surrogate Keys and Alternate Business Keys - Purpose, Usage
Identity Columns, Key Values in DWH. Business Key Limitations
Cascading Source OLTP / Stage Changes to DWH Inactive Rows
Changes to Fixed Attributes, Changing Attributes. Observations
Changes to Historical Attributes. Inferred Member Updated
ETL Date Fields, Row Status Values and Transformations
Designing Dimensions for DW - Incremental, Historical Loads
Historical Attributes, Data Delta Operations, Identification
SSIS SCD Transformation Limitations and Real-time Issues

Ch 12: SSIS PROJECT [ECommerce Domain]

SSIS ETL & DWH with STAR Schema
SSIS ETL & DWH with SNOWFLAKE Schema
Dimension Table Design & Business Keys
Fact Table Design & Data Integrity
Incremental Data Loads with Containers
Key Lookup and Business Key Identification
Staging Tables, Master - Child Packages
SSIS Package Deployment [Catalog Deployments]

SSIS Training : Project Specifications
Project Explanation and Solution
Project FAQs and Resume Support
Chapter Wise FAQs and Answers
Concept Wise Tasks and Solutions
SSIS DWH Databases with Reports
Technical Resume Points in SSIS
SSIS Limitations and Need for ADF
End to End Implementation [MSBI]

Module 3 : Azure Data Factory

Module I: AZURE DATA FACTORY - 1	Module II: AZURE DATA FACTORY - 2
HOUR 1: ADF INTRODUCTION Introduction to Cloud and Advantages Cloud Architecture : IaaS,PasS,SaaS Microsoft Cloud Advantages : Azure Azure Data Factory (ADF) : Need Purpose of ADF & Advantages ADF Components Overview, Use Lab Plan : Azure Data Studio (ADS) SQL Server Data Tools (SSDT) Azure Data Factory Architecture ADF : Data Processing Components ADF : Data Movement Components Data Pipelines and ADF Activities Data Orchestration and Advantages Validations, Deployments, Triggers Need for Azure Data Warehouse SSIS Lift and Shift with ADF ADF with Azure Services, Resources	HOUR 6 : AZURE DATA FACTORY - 3 Incremental Data Loads with ETL Incremental Loads in ADF Portal Source Data & Watermark Column Watermark Tables : Creation, Use TimeStamp For Incremental Loads Configuration Procedures for ETL Using Lookup Activities in ADF Lookup Transformation with ADF Watermark Column Extraction Activity Connections in ADF Portal Lookup Output Row Level Audits Expressions and Usage in ADF Generating New Watermark Columns Stored Procedures and Dynamic Values Parameterized Values for Data Extraction Using ADF Run IDs for Connections Parameter Imports and Staging Options
HOUR 2: AZURE SQL CONFIG, DTU Azure Registrations & Resources Azure SQL Server (Logical Server) Resource Groups and Azure Regions Azure SQL Databases, Pricing Tiers Static Pools and Elastic Pools DTUs : Basic, Standard, Premium DTUs : Provisioned, Serverless General Purpose & Business Critical Compute Generation : Gen 4, Gen 5 Firewall Rules and Virtual Networks Azure SQL DB Access from SSDT Azure SQL DB Access from SSMS Azure SQL DB Access from ADS DTU Concept and Automated Tuning Azure Storage Resources, Purpose Azure Storage Containers, Tools LRS, GRS and RA-GRS Azure Types Azure Storage Explorer Tool Databse Migrations : Export/Import	HOUR 7 : AZURE DATA FACTORY - 4 Incremental Loads - Multiple Tables Data Prep for Watermark Store ForEach Activity and Real-time use Lookup Activities Use in ADF Linked Service Parameters, Use Copy Data Activity for ETL in ADF Stored Procedure Activity for ETL Data Pipelines Parameters in ADF Object Name Parameters, Iteractions Using Self Hosted IR Engine in ADF Incremental Loads with Azure Storage Pipelines with Source Parameters Dynamic Sources and Destinations Data Preview & Dynamic Content Linked Services & Datasets Creations ADF Pipeline Executions, Run IDs Dynamic File Formats and Connections ADF Pipeline Monitoring Options Trigger Monitoring and Execution Runs
HOUR 3: AZURE DATA WAREHOUSE Azure Data Warehouse (ADW) Key Benefits of ADWH, Creation ADWH Resource Creation in SQL Server Scaling Options, Compute Engine ADW Connection from SSMS Tool Data Warehouse Details: Name, Server cDWU & DWU : Real-time Usage, Pricing DWs and Scaling Options: DW Series Massively Parallel Processing (MPP) Sharding Benefits with MPP in DWH Control Node and Compute Node Data Distribution Components in ADW DMS : Data Movement Service Hash Functions, Distributed Tables Round-robin Distributed Tables Replicated Tables in Azure DWH Queries Distribution, Nodes in ADW Dynamic Management Views (DMV)	HOUR 8: AZURE DATA FACTORY - 5 Azure Data Lake Storage Environment Azure Data Lake Gen 1 and Gen 2 Using ADF to get data from Data lake ADF Integration with Azure Data Store Scale-Out and Managed Data Transfer Copy Data Performance Monitoring Monitor, Activity Runs and Options Data Partition Recommendations in ADL Size Limitations and ADF Activities Copy Activity Performance in ADF ADF for Large Scale Data Migrations Azure Data Lake and EDW Sources Performance and Scalability Options ADF Serverless Architecture with Lake Data Size and Bandwidth Ccomparisons ADF Copy Activity Scaling Options ADF control flow, DIUs, Nodes Usage Performance Tuning Steps in ADF
HOUR 4: AZURE DATA FACTORY - 1 Azure Data Factory (ADF) : Purpose Creating ADF Resource in Azure, Use Pipeline Creation and Usage Options Copy Data Tool in ADF Portal, Use Linked Service Creation in ADF Dataset Creation, Connection Reuse Staging Dataset with Azure Storage ADF Pipeline Deployments, Triggers Polybase Benefits for Data Staging Using Azure Data Factory (ADF) Portal Pipeline Creation, Resources in Portal Pipeline Activities and Properties in ADF Linked Service Creation and Datasets ADF Pipeline Validations in Portal Publish Options & Pipeline Deployment Pipeline Monitoring and RUN IDs Trigger Now and Monitoring Options	HOUR 9: AZURE DATA FACTORY - 6 Azure Data Factory (ADF) Management Security and Audits. Monitoring Options Data Format and Compressions in ADF Data Movement Security & Encryptions Data Movement Scenarios with ADF Cloud and Hybrid Data Movement in ADF RBAC Access Controls and Real-time Usage Data Discovery & Classification in ADF Credential Encryption, Security in ADF DWH (Azure Data Warehouse) Management Threat Detection, Advanced Threat Protection Dynamic resource classes, ADW Queries Resource Class Operations & Precedence Backups and Restores with ADWH Export and Import Options with ADWH Security Management, Role Based Access Azure Data Warehouse CheatSheet
HOUR 5: AZURE DATA FACTORY - 2 Copy Data From Azure SQL Database Azure SQL Datawarehouse Sinks DataSets Creation & ADF Data Pipelines Activities : Move & Transform for ETL Actions and View Activity Runs ADF Pipeline Monitoring and Refresh ADF Triggers - Manual, Automatic Azure Database to Azure Data Warehouse Staging Dataset with Polybase, BLOB Data Integration Units [DIU] Usage Azure Data Factory Runtime Engine On-Premise Data Extraction and Loads Self Hosted IR in Copy Data Tool IR Engine Installation, Key Concepts Data From Azure BLOB, Azure Warehouse IR Connections & Authentication Methods IR Tool Configuration and Monitoring	HOUR 10: AZURE DATA FACTORY - 7 Execute SSIS Packages in Azure Azure-SSIS Integration Runtime, SSDT Azure-SSIS IR Creation and Use SSISDB Project Deployment Model Azure Enabled SSIS Projects SSIS Project Connections to ADF ADF Connection Wizard From SSDT Azure Storage for SSIS Packages Execute SSIS packages in Azure AzureDTExec Command Prompt Utility AzureDTExec Runs from SSMS Tool SSIS Package Migrations to ADF SSIS Catalog DB with ADF On-Premise SSIS Versus Azure SSIS Lift and Shift with ADF IR CPU & IR Memory Reports in ADF Branching and Chaining in ADF