SSIS Online Training with ETL & DWH, ADF (LIVE, Instructor Led)

SSIS  provides Data Extraction, Consolidation and Loading Options (ETL), SQL Server Coding enhancements, Data Warehousing and Customizations for SQL Server Developers, Administrators, BI Engineers and Data Analysts. In our SSIS Training course, we deal with complete SSIS Design, Development and Deployment & Management of Various ETL Transformations, Data Loads, Data Cleansing, Incremental Data Loading Techniques including DWH Design, Management, SCD, Profiling, Tuning and Fact Table Loads. This SSIS Online Training course also includes Azure Data Factory (ADF) Pipelines and SSIS Package Migrations to ADF with Self Hosted and Integrtion Runtime ENgines, Stored Procedures Executions, Watermark Columns and Azure Data Lake with SSIS Integrations. All sessions are completely practical and realtime.

SSIS (Integration Services) Training Plans

  PLAN A PLAN B PLAN C
Description SSIS T-SQL & SSIS T-SQL & SSIS, ADF
Total Duration 2.5 Weeks 5 Weeks 8 Weeks
SSIS: Control Flow, Data Flow; SSIS DB Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS: Static & Dynamic Connections Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS: ETL, Data Warehouse Design Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS: Transformations, Data Loads Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS: Data Cleansing, Lookups Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS: Catalog Databases, Usage Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS: Deployments, Migrations Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SSIS : Star & Snowflake Schemas Check-Symbol-for-Yes Check-Symbol-for-Yes Check-Symbol-for-Yes
SQL : Basics, DDL, DML, SELECT Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL : Constraints, Normal Forms Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL: Joins, Group By, Queries Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL: Merge, Pivot, Date & Time Formats Check-Symbol-for-Yes Check-Symbol-for-Yes
T-SQL: Excel Integrations, Pivot Charts Check-Symbol-for-Yes Check-Symbol-for-Yes
ADF : Azure Data Factory Architecture Check-Symbol-for-Yes
ADF : Azure Data Warehouse Concepts Check-Symbol-for-Yes
ADF : Massively Parallel Processing (MPP) Check-Symbol-for-Yes
ADF : Copy Data Tool and ADF Portal Check-Symbol-for-Yes
ADF : Stored Procedures For Incremental Loads Check-Symbol-for-Yes
ADF : SSIS Package Migrations to Azure Check-Symbol-for-Yes
Total Course Fee * INR 7,000
USD 95
INR 11,000
USD 149
INR 19,000
USD 257

*+ 18% GST applicable for INR Payments, 6% Paypal Charges for USD Payments

Trainer: Mr. Sai Phanindra T

S. No Timings (IST) Start Date  
SSIS Training Schedules
1 7:15 AM - 8:15 AM July 15th Register
2 5 PM - 6 PM July 22nd Register
Schedules for SQL Server Basics
1 6:15 AM - 7:15 AM Aug 5th Register
2 8:15 AM - 9:15 AM Sep 15th Register
3 9:30 AM - 10:30 AM Aug 17th Register
4 10:30 AM - 11:30 AM July 6th Register
5 6 PM - 7 PM Aug 31st Register
6 8 PM - 9 PM July 22nd Register

If above schedule does not work, opt for SSIS Training Videos

 

SSIS TRAINING HIGHLIGHTS :

✔ Basic to Adv. ETL ✔ Lookup, Fuzy Lookup
✔ SSIS Catalog Database ✔ ETL Type 1 & Type 2
✔ Fast Loads, ETL Tuning ✔ Errors, SSIS Logs
✔ Kimball BI Design ✔ Inmon BI Design
✔ Star, Snowflake ✔ Data Warehousing
✔ ADF Migrations ✔ Data Lake Storage
✔ Resume Guidance ✔ MCSA MSBI Exam

All Session Are Completely Practical & Real Time

SSIS Online Training Course Contents:

Ch 1: SQL SERVER INTRODUCTION

  • Data, Databases and RDBMS Software
  • Database Types : OLTP, DWH, OLAP
  • Microsoft SQL Server Advantages, Use
  • Versions and Editions of SQL Server
  • SQL : Purpose, Real-time Usage Options
  • SQL Versus Microsoft T-SQL [MSSQL]
  • Microsoft SQL Server - Career Options
  • SQL Server Components and Usage
  • Database Engine Component and OLTP
  • BI Components, Data Science Components
  • ETL, MSBI and Power BI Components
  • Course Plan, Concepts, Resume, Project
  • 24 x 7 Online Lab for Remote DB Access
  • Software Installation Pre-Requisites

Ch 5: SQL Basics - 3, T-SQL INTRO

  • Database Objects : Tables and Schemas
  • Schemas : Group Tables in Database
  • Schemas : Security Management Object
  • Creating Schemas & Batch Concept
  • Using Schemas for Table Creation
  • Data Storage in Tables with Schemas
  • Data Retreival and Usage with Schemas
  • Table Migrations across Schemas
  • Import and Export Wizard in SSMS
  • Data Imports with Excel File Data
  • Performing Bulk Operations in SSMS
  • Temporary Tables : Real-time Use
  • Local and Global Temporary Tables
  • # and ## Prefix, Scope of Usage

Ch 9: JOINS, T-SQL QUERIES Level 3

  • GetDate, Year, Month, Day Functions
  • Date & Time Styles, Data Formatting
  • DateAdd and DateDiff Functions
  • Cast and, Convert Functions in Queries
  • String Functions: SubString, Relicate
  • Len, Upper, Lower, Left and Right
  • LTrim, RTrim, CharIndex Functions
  • MERGE Statement - Comparing Tables
  • WHEN MATCHED and NOT MATCHED
  • Incremental Load with MERGE Statement
  • IIF() Function for Value Compares
  • CASE Statement : WHEN, ELSE, END
  • ROW_NUMBER() and RANK() Queries
  • Dense Rank and Partition By Queries

Ch 2: SQL SERVER INSTALLATIONS

  • System Configuration Checker Tool
  • Versions and Editions of SQL Server
  • SQL Server and SSMS Installation Plan
  • SQL Server Pre-requisites : S/W, H/W
  • SQL Server 2016 / 2017 Installation
  • SQL Server 2019 Installation
  • Instance Name and Server Features
  • Instances : Types and Properties
  • Default Instance, Named Instances
  • Port Numbers, Instance Differences
  • Service and Service Account Use
  • Authentication Modes and Logins
  • Windows Logins and SQL Logins
  • FileStream and Collation Properties

Ch 6 : CONSTRAINTS,INDEXES Basics

  • Constraints and Keys - Data Integrity
  • NULL, NOT NULL Property on Tables
  • UNIQUE KEY Constraints: Importance
  • PRIMARY KEY Constraint: Importance
  • FOREIGN KEY Constraint: Importance
  • REFERENCES, CHECK and DEFAULT
  • Candidate Keys and Identity Property
  • Database Diagrams and ER Models
  • Relationships Verification and Links
  • Indexes : Basic Types and Creation
  • Index Sorting and Search Advantages
  • Clustered and NonClustered Indexes
  • Primary Key and Unique Key Indexes
  • Need for Indexes - working with Keys

Ch 10: VIEW, SPs, Function Basics

  • Views : Types, Usage in Real-time
  • System Predefined Views and Audits
  • Listing Databases, Tables, Schemas
  • Functions : Types, Usage in Real-time
  • Scalar, Inline and Multi-Line Functions
  • System Predefined Functions, Audits
  • DBId, DBName, ObjectID, ObjectName
  • Variables & Parameters in SQL Server
  • Procedures : Types, Usage in Real-time
  • User & System Predefined Procedures
  • Parameters and Dynamic SQL Queries
  • Sp_help, Sp_helpdb and sp_helptext
  • sp_pkeys, sp_rename and sp_help
  • Important System Objects and Metadata

Ch 3: SSMS Tool, SQL BASICS - 1

  • SQL Server Management Studio
  • Local and Remote Connections
  • System Databases: Master and Model
  • MSDB, TempDB, Resource Databases
  • Creating Databases : Files [MDF, LDF]
  • Creating Tables in User Interface
  • Data Insertion & Storage. Limitations
  • SQL : Purpose and Real-time Usage
  • SQL Versus T-SQL : Basic Differences
  • DDL, DML, SELECT, DCL and TCL
  • Creating Tables using SQL Scripts
  • Data Storage, Inserts - Basic Level
  • Table Data Verifications with Select
  • SELECT Statement for Table Retrieval

Ch 7: JOINS, T-SQL Queries : Level 1

  • JOINS - Table Comparisons Queries
  • INNER JOINS For Matching Data
  • OUTER JOINS For (non) Match Data
  • Left Outer Joins with Example Queries
  • Right Outer Joins with Example Queries
  • FULL Outer Joins - Realtime Scenarios
  • Join Queries with "ON" Conditions
  • Join Unrelated Tables in SQL Server
  • NULL, IS NULL Operators in Joins
  • CROSS JOIN and CROSS APPLY
  • CROSS JOIN Versus CROSS APPLY
  • One-way & Two Way Data Comparisons
  • Important Join Queries in T-SQL
  • Join Options: Merge, Loop, Hash

Ch 11: Triggers & Transactions

  • Triggers - Purpose, Real-world Usage
  • FOR/AFTER Triggers - Real time Use
  • INSTEAD OF Triggers - Real time Use
  • INSERTED, DELETED Memory Tables
  • Using Triggers for Data Replication
  • Enable Triggers and Disable Triggers
  • Database Level, Server Level Triggers
  • Transactions : Types, ACID Properties
  • Transaction Types and AutoCommit
  • EXPLICIT & IMPLICIT Transactions
  • COMMIT and ROLLBACK Statements
  • Open Transaction Scenarios & Cause
  • Query Blocking Scenarios @ Real-time
  • NOLOCK and READPAST Lock Hints

Ch 4: SQL BASICS - 2

  • Creating Databases & Tables in SSMS
  • Single Row Inserts, Multi Row Inserts
  • Rules for Data Insertion Statements
  • SELECT Statement @ Data Retrieval
  • SELECT with WHERE Conditions
  • Batch Concept and Go Statement
  • AND and OR Operators Usage
  • IN Operator and NOT IN Operator
  • Between, Not Between Operators
  • LIKE and NOT LIKE Operators
  • UPDATE Statement & Conditions
  • DELETE & TRUNCATE Statements
  • Logged and Non-Logged Operations
  • ADD, ALTER and DROP Columns
  • ALTER & DROP Table Statements

Ch 8: Group By, T-SQL Queries Level 2

  • GROUP BY Queries and Aggregations
  • Group By Queries with Having Clause
  • Group By Queries with Where Clause
  • Using WHERE and HAVING in T-SQL
  • Rollup : Usage and T-SQL Queries
  • Cube : Usage and T-SQL Queries
  • UNION and UNION ALL Operator
  • EXISTS Operator, Query Conditions
  • Sub Queries and Alternatives to Joins
  • Using Joins with Group By Queries
  • Using Joins with Nested Sub Queries
  • Sub Queries with Joins and Group By
  • Using UNION and UNION ALL in Queries
  • Nested Sub Queries with Group By, Joins
  • Comparing WHERE, HAVING Conditions

Ch 12 : ER MODELS, NORMAL FORMS

  • Normal Forms for Entity Relationships
  • First Normal Form and Atomocity
  • Second Normal Form, Candidate Keys
  • 3rd Normal Form Multi Value Dependancy
  • Boycee-Codd Normal Form : BNCF
  • Fourth Normal Form Realtime Advantages
  • Self Joins & Self Reference Keys
  • 1:1, 1:M, M:1, M:M Relationship Types
  • Joins with Group By Queries
  • Joins with Sub Queries, Formating
  • Office Data Connections, Excel Reports
  • Excel Pivot Reports and Reports
  • SQL Queries (Auto Generated) in BI Tools
  • FETCH OFFSET, NEXT ROWS, Order By
  • Data Refresh (Manual and Automated)
Real-time Case Study - 1 (Sales & Retail)
Objective : Database Design, Table Design and Relations.
Involves Purchases, Products, Customers and Time Data with Various Data Types.
Real-time Case Study - 2 (Sales & Retail)
Objective : Queries, Excel Integration
Pivot Tables, Pivot Charts, ODC Connections

Module I: Basic SSIS Development & ETL - DWH

Module II: Advanced SSIS Development & Deployments

Ch 1: SSIS INTRODUCTION & INSTALLATION

  • Need for SQL Server Integration Services (SSIS) & ETL / DWH
  • Advantages of SSIS for Data Loads, Operations, ETL, Warehouse
  • SSIS Tools : SSDT (SQL Server Data Tools), ETL Wizards
  • SSIS Design / Development and LIVE (Deployment) Environment
  • Understanding Data Warehouse (DWH) Design and ETL Process
  • DWH and ETL Structures, Implementations with MSBI SSIS
  • SSIS ETL Operations for Data Reads, Data Cleansing, DWH
  • Data Warehouse (DWH) Design Principles and Design Plan
  • SSIS 2019 and SSIS 2017 : SSIS Database Installations
  • SSIS Database & Catalog Folders - Purpose, Usage, Passwords
  • SSIS Catalog Database (SSIS DB) : Creation, Verification
  • SSDT Tool: SQL Server Data Tools - SSDT / Visual Studio Shell
  • SSDT Installation and Verification of SSIS Templates
  • Basic Vocabulary - SSIS, ETL, DWH, Data Flow, Data Buffer
  • SSIS Package Environment and SSDT Project Creation
  • SSIS Solutions and Project Templates - Verifications
  • Version Control Options and SSIS Design Plan - Tools Usage
  • SSIS & ETL Training - Lab Plan, Resources & Work Flow

Ch 7: CHECKSUM TRANSFORMATION, DWH DESIGN

  • Configuring Checksum Transformation : 2019, 2017 Versions
  • Checksum Transformation Logic and Parity Checks (CRC) Codes
  • Working with CHECKSUM Transformation & Parity Bit Columns
  • Generating Checksum Values For Type I, Type II ETL Changes
  • DWH Dimension Tables With Checksum Transformation
  • Working with Parity Bits, Conditional Lookup Transformation
  • Row Redirection Options & Lookup Match, NonMatch Output
  • OLE DB Command: SQL Statements and Input Parameters
  • Parameter Mapping Options and Dynamic SQL for Row Updates
  • Cache Transformation with Memory Loads, CAW Files (VM)
  • Memory Connections and Reuse. Lookup with Cache Options
  • Tuning Lookup Transformation: Caching Options, Index Options
  • FULL CACHE & PARTIAL CACHE. Cache Connection Manager
  • Pre-ETL Data Load Operations with Memory Connections
  • Lookup with NOCACHE Options. Dependent Data Flow Tasks
  • Post ETL, Derived Column and Fuzzy Transformations
  • SSIS Package Internal Parameters and Query Updates
  • OLEDB Command with Conditional Splits, Multi Row Updates

Ch 2: SSIS ETL PACKAGES: EXTRACT,TRANSFORM,LOAD

  • Control Flow Tasks - Architecture, Purpose and Usage
  • Data Flow Tasks - Architecture, Purpose and Usage
  • Creating SSIS Packages For Basic Data Flow Operations
  • SSIS Solutions, Projects and Package Creation. Tasks
  • Need For Data Pipelines & Connections in Data Flow Tasks
  • Understanding SSIS Package (Program) Execution Process
  • Working with Data Flow Objects and Tasks in SSIS
  • Using OLE DB and SQL Server Connections - Usage
  • SSIS Package Creation Process - Using Control Flow Items
  • Using DTSX Files for SSIS Package Execution. Audits
  • SSIS Execution Context, SSIS Package Errors and Logs
  • Data Flow Transformation: Conditional Split, Expressions
  • Excel Connections, Sheets, & Memory References - Usage
  • Using Source Assistants, Destination Assistants @ SSIS
  • DAT File Imports, Data Flow Options, Adding Annotations
  • SSIS Project Configuration Options - Debugging, Bit Config
  • SSIS 64 Bit and 32 Bit Configuration Settings and Options

Ch 8: CHANGE DATA CAPTURE: DWH DIMENSIONS

  • Understanding CDC Tables with SQL Server Connections
  • DML Audits: Inserts, Deletes, Values before/after Updates
  • CDC Source Connections - Usage, ADO.NET Integration
  • CDC Control Flow Tasks and CDC State Tasks. Values
  • INITIAL LOAD START / END. PRCESSING RANGE
  • Using State Variables and Controls. Storing States
  • SSIS CDC Source Connections with Net Support Changes
  • SSIS CDC Control Tasks and Caching, State Variables
  • Understanding State Variables and SSIS Logging Tables
  • Initial and Incremental Dimension Loads with CDC
  • Dynamic CDC Connections, Parameter Mapping
  • Integrating Control Flow and Data Flow for CDC @ ETL
  • CDC Splitter Transformation - Row Inserts and Updates
  • CDC Splitter Precautions, Input Types and Output Range
  • Master Packages and Child Packages, Derived Columns
  • Defining Local and Global Variables/Parameters
  • Parameter Bindings with Parent - Child Packages

Ch 3: MERGE, FUZZY LOOKUP, DATA CONVERSION

  • MERGE Transformation and UNION ALL Transformation
  • SORT Transformation, NOSORT Options, Advanced Sort
  • Synchronous & Asynchronous Transformations, Data Loads
  • Row and Partial Blocking Transformations. Buffer Reuse
  • Fully Blocking Transformations - Buffer Reuse Restrictions
  • Examples to Avoid Fully Blocking Transformation in SSIS
  • Bulk Load Operations and Data Import Options in SSIS
  • IsSorted and SortKey Positions with Advanced Options
  • Measuring SSIS Package Performance & Resource Usage
  • Data Conversion Transformation and SSIS Expressions
  • Fuzzy Lookup Transformation, Reference Table Connections
  • Exact, Fuzzy & Nomatch Data Cleansing with Conditional Split
  • Index Creation, Maintenance for Faster Lookup Transformation
  • Data Conversion Transformation - Usage. Derived Columns
  • Data Conversion Transformation: NVARCHAR, VARCHAR Data
  • Threshold Values Selection, Search Delimiters and Options
  • Data Pipeline with _Similarity, _Confidence Columns. Usage
  • Explicit Data Type Conversions and Usage. Error Redirections

Ch 9: FACT TABLE DESIGN, FACT LOADS (DWH)

  • Fact Table - Design and Implementation Rules, ER Model
  • Fact Table Design with STAR and SNOWFLAKE Schemas
  • Time Dimensions - Purpose, Usage and ETL Date / Time
  • Generating Time Dimensions for ETL, Load Identification
  • Parent-Child Packages for Dimensional Loads, Control Flow
  • Parent-Child Packages for Dimensions & Fact Table Loads
  • Master Package Design: Dimension, Fact Load Integration
  • Inferred Members and Status for NULLs in Dimensions
  • Parameter Mapping @ ETL Updates, Component Properties
  • ETL Load Date IDs & Expressions for Dimension Keys
  • Error Handling & Event Handling with Master Packages
  • Text Qualifiers and Parameters in Master-Child Packages
  • Key Based Dimension LOOKUPs and Indexes. Fast Loads
  • SCD Implementations with Legacy Data. ETL Load Types
  • Fact Load Design for Initial Loads, Incremental Updates
  • End-to-End Data Warehouse Design: Implementation
  • Direct Data Loads and Data Stage Operations for DWH DBs
  • STAR & SNOWFLAKE Schemas for DWH - Data Modelling

Ch 4: PACKAGE PROPERTIES, CHECKPOINT, PIVOT

  • Execute SQL Task and OLE DB Queries - Connection Options
  • Transaction Options For SSIS Executables - Package Level
  • Precedence Constraints - Success / Failure / Completion
  • SSIS Package Level Rollbacks and Restart Execution Options
  • SSIS Checkpoints - Purpose and Usage with Data Flow Tasks
  • Checkpoint Files and SSIS Logging Options - Package, Tasks
  • Transactions with Checkpoint File Usage in SSIS Packages
  • Checkpoint Options - Advantages, Usage and Limitations
  • FailPackageOnFailure Options and Checkpoint Property Usage
  • Transaction Property : REQUIRED / SUPPORT, NOTSUPPORTED
  • Transaction Property Versus CHECKPOINT Files, Usage
  • Importing Legacy Data, Need for Data Cleansing, Formatting
  • Understanding Denormalization and Keys. Need for OLTP
  • PIVOT Transformation, Data Reads, Connection Assistant
  • Pivot Usage Values - Purpose and Implementation. Key Values
  • Lineage ID in SSIS - Purpose, Usage Options. Data Mappings
  • Lineage IDs for Column Mapping and Pivot Keys
  • SSIS Input Columns, Mappings and Source Column Values
  • Using Data Viewer (Debugging) for Data Transfer Verifications
  • Explicit Data Type Conversions, Usage. Error Redirections

Ch 10: DWH MIGRATIONS with SSIS, SCRIPT Task

  • DataWarehouse Migrations with SSIS Control Flow
  • Using SSIS Containers and Db Integrity Task
  • Using Pre-Database Migration Tasks, Precautions
  • Transfer Database Task and DB File Options
  • Online and Offline DB Transfer Options, Usage
  • Copy / Move Options with DWH Migrations
  • SMTP : Simple Mail Transfer Protocol For Emails
  • Using SQL Server Agent Operators, Package Events
  • Precedence Constraint with Containers, SSIS Tasks
  • Using Data Profiling Task with ADO.NET Connectors
  • XML Files Generation, Using SSIS Data Profiler Tool
  • Script Task - Purpose and Working in SSIS Control Flow
  • Script Task - Usage with VB.NET Programs. Compilations
  • Variables and Parameters with SSIS Script Task. Usage
  • Read Only and Read Write Variables. Expressions, Mapping
  • Data Flow Limitations : Solutions with .NET Scripting
  • SSIS Expressions and Package Debugging, Break Points
  • SSIS Variables and Parameters - Mapping Expressions
  • Using Control Flow File System Tasks and Limitations
  • SQLDataAdapters & System.Data.SQLClient Connections

Ch 5: EVENTS, LOOPS, EXPRESSIONS

  • SSIS Package Events : Validation Events, Execution Events
  • PreExecution, Progress and Cleanup Events in SSIS
  • Auditing SSIS Events, Errors / Warnings / Information
  • Configuring and Using sysssislog System Tables
  • Package Debugging : Data Viewers and Breakpoints
  • ForEach Loop Container Usage. File Connections, Variables
  • Defining Variables for Connections. DFT, Control Flow Links
  • Dynamic Connections with Variables. Connection Strings
  • Connection Iterations, Connection Fetch, Index Mapping
  • SSIS Expressions and Usage for ETL and DWH
  • FOR LOOP Expressions in SSIS, Examples for ETL
  • InitExpression, EvalExpression, AssignExpression
  • SSIS Expression Builder, Functions, Evaluated Values
  • Data Insertions and Data Serializations with SSIS
  • Counter Values, Variables and Parameter Mapping
  • Using SSIS for OS Level Drive Operations, Loops
  • Using Execute SQL Task : Variables, Return Values

Ch 11: SSIS PROJECT DEPLOYMENT, UPGRADES

  • SSISDB Catalog Deployments - Process & ISPAC Files
  • SSIS Package Builds, Verification Techniques, Scripts
  • SSIS Project Deployment Wizard : Targets and Logging
  • SSIS DB Catalog Folders - Creation, Usage. Properties
  • SSIS DB Catalog Projects - Creation, Usage. Properties
  • SSIS Package Executions - Scripts, Reports, Messages
  • Package Validations - Scripts, Reports, 32/64 bit Options
  • Package Configurations - Parameter Management, Scripts
  • SSIS Package Jobs @ SQL Server Agent. SSIS Job Steps
  • SSIS Job Schedules and Notifications: Windows Event Logs
  • Package Security Management - SSISDB Logins and Users
  • Folder Level and Project Level Security Implementation
  • Project Migration Utilities and Package Upgrades
  • SSIS Package Imports and Exports with ISPAC Files
  • Command-Line Deployments For SSIS, Execution Utilities
  • SSIS Package Execution Reports; Validation Reports
  • SSIS Package Versions and Restores, SSIS Rollbacks

Ch 6: DATAWAREHOUSE (DWH) DESIGN WITH SSIS

  • Introduction to Datawarehouse (DWH) - Purpose, Usage, Access
  • Technical Terms: Dimensions, Attributes, Members and Types
  • Dimension Tables, Fact Tables and Relations, Inferred Members
  • TYPE1 and TYPE2 Changes. ETL Implementation Techniques
  • Implementing Type I Changes (SCD) for DWH : Sales Scenario
  • Dimensional Table Design for DWH using SCD - Type 1, Type 2
  • Initial Data Loads with Legacy Files (DAT, TXT, CSV), Data Marts
  • Working with Business Keys, non Identity Key Based Columns
  • Surrogate Keys and Alternate Business Keys - Purpose, Usage
  • Identity Columns, Key Values in DWH. Business Key Limitations
  • Cascading Source OLTP / Stage Changes to DWH Inactive Rows
  • Changes to Fixed Attributes, Changing Attributes. Observations
  • Changes to Historical Attributes. Inferred Member Updated
  • ETL Date Fields, Row Status Values and Transformations
  • Designing Dimensions for DW - Incremental, Historical Loads
  • Historical Attributes, Data Delta Operations, Identification
  • SSIS SCD Transformation Limitations and Real-time Issues

Ch 12: SSIS PROJECT [ECommerce Domain]

  • SSIS ETL & DWH with STAR Schema
  • SSIS ETL & DWH with SNOWFLAKE Schema
  • Dimension Table Design & Business Keys
  • Fact Table Design & Data Integrity
  • Incremental Data Loads with Containers
  • Key Lookup and Business Key Identification
  • Staging Tables, Master - Child Packages
  • SSIS Package Deployment [Catalog Deployments]
  • SSIS Training : Project Specifications
  • Project Explanation and Solution
  • Project FAQs and Resume Support
  • Chapter Wise FAQs and Answers
  • Concept Wise Tasks and Solutions
  • SSIS DWH Databases with Reports
  • Technical Resume Points in SSIS
  • SSIS Limitations and Need for ADF
  • End to End Implementation [MSBI]

Module I: AZURE DATA FACTORY - 1

Module II: AZURE DATA FACTORY - 2

HOUR 1: ADF INTRODUCTION

  • Introduction to Cloud and Advantages
  • Cloud Architecture : IaaS,PasS,SaaS
  • Microsoft Cloud Advantages : Azure
  • Azure Data Factory (ADF) : Need
  • Purpose of ADF & Advantages
  • ADF Components Overview, Use
  • Lab Plan : Azure Data Studio (ADS)
  • SQL Server Data Tools (SSDT)
  • Azure Data Factory Architecture
  • ADF : Data Processing Components
  • ADF : Data Movement Components
  • Data Pipelines and ADF Activities
  • Data Orchestration and Advantages
  • Validations, Deployments, Triggers
  • Need for Azure Data Warehouse
  • SSIS Lift and Shift with ADF
  • ADF with Azure Services, Resources

HOUR 6 : AZURE DATA FACTORY - 3

  • Incremental Data Loads with ETL
  • Incremental Loads in ADF Portal
  • Source Data & Watermark Column
  • Watermark Tables : Creation, Use
  • TimeStamp For Incremental Loads
  • Configuration Procedures for ETL
  • Using Lookup Activities in ADF
  • Lookup Transformation with ADF
  • Watermark Column Extraction
  • Activity Connections in ADF Portal
  • Lookup Output Row Level Audits
  • Expressions and Usage in ADF
  • Generating New Watermark Columns
  • Stored Procedures and Dynamic Values
  • Parameterized Values for Data Extraction
  • Using ADF Run IDs for Connections
  • Parameter Imports and Staging Options

HOUR 2: AZURE SQL CONFIG, DTU

  • Azure Registrations & Resources
  • Azure SQL Server (Logical Server)
  • Resource Groups and Azure Regions
  • Azure SQL Databases, Pricing Tiers
  • Static Pools and Elastic Pools
  • DTUs : Basic, Standard, Premium
  • DTUs : Provisioned, Serverless
  • General Purpose & Business Critical
  • Compute Generation : Gen 4, Gen 5
  • Firewall Rules and Virtual Networks
  • Azure SQL DB Access from SSDT
  • Azure SQL DB Access from SSMS
  • Azure SQL DB Access from ADS
  • DTU Concept and Automated Tuning
  • Azure Storage Resources, Purpose
  • Azure Storage Containers, Tools
  • LRS, GRS and RA-GRS Azure Types
  • Azure Storage Explorer Tool
  • Databse Migrations : Export/Import

HOUR 7 : AZURE DATA FACTORY - 4

  • Incremental Loads - Multiple Tables
  • Data Prep for Watermark Store
  • ForEach Activity and Real-time use
  • Lookup Activities Use in ADF
  • Linked Service Parameters, Use
  • Copy Data Activity for ETL in ADF
  • Stored Procedure Activity for ETL
  • Data Pipelines Parameters in ADF
  • Object Name Parameters, Iteractions
  • Using Self Hosted IR Engine in ADF
  • Incremental Loads with Azure Storage
  • Pipelines with Source Parameters
  • Dynamic Sources and Destinations
  • Data Preview & Dynamic Content
  • Linked Services & Datasets Creations
  • ADF Pipeline Executions, Run IDs
  • Dynamic File Formats and Connections
  • ADF Pipeline Monitoring Options
  • Trigger Monitoring and Execution Runs

HOUR 3: AZURE DATA WAREHOUSE

  • Azure Data Warehouse (ADW)
  • Key Benefits of ADWH, Creation
  • ADWH Resource Creation in SQL Server
  • Scaling Options, Compute Engine
  • ADW Connection from SSMS Tool
  • Data Warehouse Details: Name, Server
  • cDWU & DWU : Real-time Usage, Pricing
  • DWs and Scaling Options: DW Series
  • Massively Parallel Processing (MPP)
  • Sharding Benefits with MPP in DWH
  • Control Node and Compute Node
  • Data Distribution Components in ADW
  • DMS : Data Movement Service
  • Hash Functions, Distributed Tables
  • Round-robin Distributed Tables
  • Replicated Tables in Azure DWH
  • Queries Distribution, Nodes in ADW
  • Dynamic Management Views (DMV)

HOUR 8: AZURE DATA FACTORY - 5

  • Azure Data Lake Storage Environment
  • Azure Data Lake Gen 1 and Gen 2
  • Using ADF to get data from Data lake
  • ADF Integration with Azure Data Store
  • Scale-Out and Managed Data Transfer
  • Copy Data Performance Monitoring
  • Monitor, Activity Runs and Options
  • Data Partition Recommendations in ADL
  • Size Limitations and ADF Activities
  • Copy Activity Performance in ADF
  • ADF for Large Scale Data Migrations
  • Azure Data Lake and EDW Sources
  • Performance and Scalability Options
  • ADF Serverless Architecture with Lake
  • Data Size and Bandwidth Ccomparisons
  • ADF Copy Activity Scaling Options
  • ADF control flow, DIUs, Nodes Usage
  • Performance Tuning Steps in ADF

HOUR 4: AZURE DATA FACTORY - 1

  • Azure Data Factory (ADF) : Purpose
  • Creating ADF Resource in Azure, Use
  • Pipeline Creation and Usage Options
  • Copy Data Tool in ADF Portal, Use
  • Linked Service Creation in ADF
  • Dataset Creation, Connection Reuse
  • Staging Dataset with Azure Storage
  • ADF Pipeline Deployments, Triggers
  • Polybase Benefits for Data Staging
  • Using Azure Data Factory (ADF) Portal
  • Pipeline Creation, Resources in Portal
  • Pipeline Activities and Properties in ADF
  • Linked Service Creation and Datasets
  • ADF Pipeline Validations in Portal
  • Publish Options & Pipeline Deployment
  • Pipeline Monitoring and RUN IDs
  • Trigger Now and Monitoring Options

HOUR 9: AZURE DATA FACTORY - 6

  • Azure Data Factory (ADF) Management
  • Security and Audits. Monitoring Options
  • Data Format and Compressions in ADF
  • Data Movement Security & Encryptions
  • Data Movement Scenarios with ADF
  • Cloud and Hybrid Data Movement in ADF
  • RBAC Access Controls and Real-time Usage
  • Data Discovery & Classification in ADF
  • Credential Encryption, Security in ADF
  • DWH (Azure Data Warehouse) Management
  • Threat Detection, Advanced Threat Protection
  • Dynamic resource classes, ADW Queries
  • Resource Class Operations & Precedence
  • Backups and Restores with ADWH
  • Export and Import Options with ADWH
  • Security Management, Role Based Access
  • Azure Data Warehouse CheatSheet

HOUR 5: AZURE DATA FACTORY - 2

  • Copy Data From Azure SQL Database
  • Azure SQL Datawarehouse Sinks
  • DataSets Creation & ADF Data Pipelines
  • Activities : Move & Transform for ETL
  • Actions and View Activity Runs
  • ADF Pipeline Monitoring and Refresh
  • ADF Triggers - Manual, Automatic
  • Azure Database to Azure Data Warehouse
  • Staging Dataset with Polybase, BLOB
  • Data Integration Units [DIU] Usage
  • Azure Data Factory Runtime Engine
  • On-Premise Data Extraction and Loads
  • Self Hosted IR in Copy Data Tool
  • IR Engine Installation, Key Concepts
  • Data From Azure BLOB, Azure Warehouse
  • IR Connections & Authentication Methods
  • IR Tool Configuration and Monitoring

HOUR 10: AZURE DATA FACTORY - 7

  • Execute SSIS Packages in Azure
  • Azure-SSIS Integration Runtime, SSDT
  • Azure-SSIS IR Creation and Use
  • SSISDB Project Deployment Model
  • Azure Enabled SSIS Projects
  • SSIS Project Connections to ADF
  • ADF Connection Wizard From SSDT
  • Azure Storage for SSIS Packages
  • Execute SSIS packages in Azure
  • AzureDTExec Command Prompt Utility
  • AzureDTExec Runs from SSMS Tool
  • SSIS Package Migrations to ADF
  • SSIS Catalog DB with ADF
  • On-Premise SSIS Versus Azure
  • SSIS Lift and Shift with ADF
  • IR CPU & IR Memory Reports in ADF
  • Branching and Chaining in ADF

Our SSIS Online Trainings are completely practical, realtime. Register today for free Demo

 

Benefits of our SSIS Training Course :

  • Completely Practical and Realtime
  • Theory Material provided in Advance
  • Highly Interactive and Interesting
  • Daily Tasks and Weekly Assignments
  • Certification Guidance and FAQs
  • 24x7 Server Access with Realtime DBs

After the SSIS Online Training course participants should be able to:

  • Design and Understand Datawarehouses (DWH)
  • Decide to use SCD, CDC and Checksum Techniques
  • Implement ETL and Data Delta with Caching Techniques
  • Handle Events and Errors with Tuning Options
  • Perform .NET Scripting and Parameterized Fuzzy Operations
  • Deploy and Implement SSIS Package Security with Jobs
 

SQL Server, SQL DBA, MSBI DWH Trainings :