get app
    Download Careers360 App

    ETL Framework for Data Warehouse Environments

    BY
    Udemy

    Brochure Enquire
    Mode

    Online

    Fees

    ₹ 2299

    Quick Facts

    particular details
    Medium of instructions English
    Mode of learning Self study
    Mode of Delivery Video and Text Based

    Course and certificate fees

    Fees information
    ₹ 2,299
    certificate availability

    Yes

    certificate providing authority

    Udemy

    The syllabus

    Getting Started

    • Introduction
    • What are we getting into?
    • Quick note on the commonly asked questions.
    • The Architecture which will be used for this course
    • Different stages of the Architecture

    Metadata Categories

    • Business Metadata
    • Technical Metadata
    • Operational Metadata

    ETL Framework - Process Flow

    • ETL Framework - The Process Flow

    Data Sourcing

    • What is Data Sourcing?
    • What are the different events of Data Sourcing?
    • Scheduled Events
    • CDC - Change Data Capture Events
    • Pub - Sub Events
    • WebServices/API Events

    Data Sourcing - Classification

    • Push and Pull
    • Architectural Classification

    Scripts Requirements for Data Sourcing

    • What functionality should be part of the Scripts for Data Sourcing?

    File Validation

    • File Validation Process
    • Post File Validation Steps
    • File Validation Failure Notifications

    The Staging Layer

    • What is the need for a Staging layer?
    • What is Reference Data and Should it be stored in the Staging Layer?
    • Different Real time examples of Reference Data Set up and Usage.
    • Are Audit columns required for the Staging and Reference Data?
    • How many days of data should be stored in the staging area?
    • Do we need to set up the Partitions based on the Data Retention?
    • What kind of DB Standards should be followed for the Staging area setup?

    Business Validation Layer

    • What is the the Business Validation Layer?
    • Different situations possible during the data processing at this layer
    • Indirect Data Load Porcess - Using Informatica
    • Concurrent Workflow Process
    • Partitions in Stage Layer and Business Validation Layer

    Data Warehouse Layer

    • Dimension Load
    • Fact Load Process
    • Fact Partitions/ Fact Summary Load
    • Fact Summary Load
    • Source File Managment/Archival

    Exception Handling/Error Handling

    • Data Model for Exception Handling
    • Error Category
    • Error Code
    • Different Solutions for Exception handling

    Project Setup

    • Steps to download the sample project and the codebase
    • Importing and Creting the Database metadata and the sample data
    • Project explanation and aligning to the architecture
    • Review of the project and the code base

    Extending the Operational Metadata's Data Model

    • Supporting Operational Metadata for Exception Handling
    • Additional tables required to support the Exception Handling
    • Why do we need so many tables?

    Error Handing Data Model

    • System Stage Table
    • Data Source Metadata Table
    • Data Source Detail Table
    • Data Source System Table
    • Job Details Table
    • Changes to the Error Log Table

    Mapping Example

    • Modify the existing mapping to load the wrong data into the ERROR_LOG Table
    • Other Possible ways of implemeting the Error handling
    • Using PMREP Tables for Error Handling

    Audit Balance and Control

    • Metadata Management
    • Need for Operational Metadata
    • Different technical components involved for Audit Balance and Control
    • Table Structure for Audit Balance and Control
    • Structure of the Workflow with the re-usable sessions
    • RUN_ID, the Unique Attribute
    • The Re-usable Stored Procedure
    • Sequence Generator with Trigger
    • Workflow Setup
    • Assignments and What else is left?

    Configuration Management

    • What is Configuration Management?
    • What are the different subject areas under Configuration Management?
    • Incident Management
    • Change Management
    • Release Management
    • Capacity Management
    • Service Level Management
    • Disaster Recovery and Availability Management

    Instructors

    Mr Sid Inf
    Instructor
    Freelancer

    Trending Courses

    Digital Marketing Courses Fashion Design Courses Data Science Courses Interior Design Courses Graphic Designing Courses Cyber Security Courses Nursing Courses Tally Courses Data Analysis Courses Web Designing Courses Artificial Intelligence Courses Ethical Hacking Courses Free Digital Marketing Courses And certifications Free Artificial Intelligence Courses And Certifications Free Data Analysis Courses And Certifications Free Cyber Security Courses And Certifications Free Data Science Courses And Certifications Free Cloud Computing Courses And Certifications Free Python Courses And Certifications Free Fashion And Textiles Courses And Certifications Free Graphic Designing Courses And Certifications Free Web Designing Courses And Certifications

    Popular Courses

    General Management Courses Public Health Courses Teaching and Education Courses Financial Management Courses Web Development Courses Mathematics Courses Cyber Security Courses Programming Courses Data Science Courses Digital Marketing Courses Law Courses Mechanical Engineering Courses Explore all courses

    Popular Platforms

    upGrad Courses Udemy Courses Edx Courses Swayam Courses Coursera Courses NPTEL Courses Futurelearn Courses Mindmajix Technologies Courses Vskills Courses IIT Kharagpur Courses Emeritus Courses IIT Kanpur Courses Explore all platforms

    Learn more about the Courses

    10 Reasons to Enrol Yourself in a Digital Marketing Course 8 Must-Have Skills for AWS Cloud Architects Planning to Upskill Yourself? Enrol for a Program in Data Science 25+ Tips for Improving Your Graphic Design Skills Top Universities in India Offering Cyber Security Courses 15+ Courses for Learning Data Mining How to Make a Career in the Field of Artificial Intelligence Top 10 Benefits Of Holding A Certification In Business Intelligence Which are the best certification courses for Photography in India A Beginner's Guide to Pursue Python Programming Want to Pursue a Career in Blockchain Technology? Here is all that you need to Know How Entrepreneurs Can Use Machine Learning to Make their Business Successful? The Scope of Artificial Intelligence in India Top 10 Online Courses for Travel Lovers 10 Best Certification Courses After Hospital and Healthcare Management
    Providers
    Close
    Download Careers360 App
    All this at the convenience of your phone

    • Regular Exam Updates

    • Best College Recommendations

    • College & Rank predictors

    • Detailed Books and Sample Papers

    • Question and Answers

    google play
    students
    400M+ Students
    Colleges
    36K+ Colleges
    Exams
    500+ Exams
    eBooks
    3K+ eBooks
    Certification
    16K+ Certifications
    mobile