Snowflake Mastery: Easy steps to gain expertise [2024]

Following modules will be covered in a very easily step by step approach

1. Snowflake Architecture and Performance Management

1. Introduction
   1. Create Trial account
   2. Know your UI interface
   3. Shared and Non Shared Disk Architecture
   4. High Level Architecture
   5. Create Virtual Warehouses
   6. Scaling Policy
   7. Create First Database and Table
   8. Load CSV from public S3 bucket
2. Snowflake Architecture
   1. Snowflake Editions
   2. Credits
   3. Credit Usage Scenarios
   4. Credit to Dollar Storage cost
   5. Credit Storage Consumption
3. Performance Management
   1. Performance Improvement Methods
   2. Dedicated Virtual Warehouses
   3. Dedicated Virtual Warehouses Creation
   4. Scale Up and Scale Down
   5. Scale Out and Scale In
   6. Maximize Caching
   7. Maximize Caching demonstration
   8. Clustering Keys
   9. Clustering Cost
   10. Clustering Performance
   11. Micropartitions

2. Access management and snowflake objects

1. Access management
   1. Access control and RBAC
   2. Securable objects
   3. Roles
2. Tables in snowflake
   1. Table Types
   2. Database and schema type
3. User Defined Functions (UDF’s) and Stored Procedures
   1. User defined functions (UDF’s)
   2. Stored procedures (SP’s)
   3. Secure UDF’s and SP’s
4. Views
   1. Non Materialized views
   2. Materialized views

3. Data Movement – Techniques and Unloading

1. Data Loading techniques
   1. Types of Data load
   2. Know snowflake stages
   3. Install Snowsql
   4. Internal Stages
      1. Userstage
      2. Tablestage
      3. Namedstage
   5. External Stages
   6. COPY Command
   7. COPY Transformation
   8. File Format Object
2. COPY OPTIONS
   1. ON ERROR
   2. SIZE LIMIT
   3. RETURN_FAILED_ONLY
   4. ENFORCE_LENGTH / TRUNCATECOLUMNS
   5. FORCE / LOAD_UNCERTAIN_FILES
   6. LOAD_HISTORY
   7. VALIDATION MODE
   8. Logging rejected records
   9. Data loading best practices
3. Data Unloading
   1. Data unloading theory
   2. COPY into location – Internal Stage -> User stage
      1. Resolving max_workers must be greater than 0
   3. COPY into location – Internal Stage -> Table stage
   4. COPY into location – Internal Stage -> Named Internal Stage
   5. Unloading using Query
   6. Unloading to Multiple Files
4. Data Movement – Data loading

1. Loading from AWS
   1. Create AWS free-tier account
   2. Create S3 bucket, file and role
   3. Storage integration object
   4. Load file from AWS
   5. Unload data to AWS
2. Loading from Azure
   1. Create Azure free trial account
   2. Create storage and container
   3. Integration object
   4. Load data from Azure
   5. Unload data to Azure
3. Loading from GCP
   1. Create GCP free trial account, create bucket and upload file
   2. Integration object
   3. Load data from GCP
   4. Unload data to GCP
4. Loading Semi-Structured Data
   1. Introduction
   2. Process and understanding the demo data
   3. JSON: Load raw data and analyze nested objects
   4. JSON: FLATTEN
      1. Array/Objects
      2. Hierarchical
   5. JSON: Data transformation and load
   6. JSON: Querying Data
   7. PARQUET: File load and transformation
5. Snowpipe
   1. Overview
   2. Create snowpipe, load and configure
   3. Troubleshooting and pipe refresh
   4. Manage snowpipe

5. Dynamic Data Masking and Visualization
   1. Dynamic data masking
      1. Overview
      2. Create masking policy
      3. Change, Unset and replace masking policy
      4. Conditional masking
6. Data Visualization
   1. Snowsight – Dashboard and Visualization
   2. Getting started with Tableau
   3. Tableau visualization from snowflake data
7. Partner Connect
   1. Overview
   2. Partner connect categories

6. Data Sharing and Data Protection

1. Data Sharing
   1. Overview
   2. Data sharing demo of Table, External tables and UDF’s.
   3. Data share to a reader account
   4. Imported privileges
   5. Data share – entire database
   6. Data share operations – DDL and DML affect
   7. Sharing views and materialized views

2. Time Travel
   1. Overview and retrieve data using “at” and “before”
   2. Data restoration using direct method
   3. Data restoration using indirect method
   4. UNDROP
   5. Understanding retention time
3. Fail-Safe
   1. Overview
   2. Fail Safe demo
4. Zero-Copy Cloning
   1. Overview
   2. Cloning permanent tables
   3. Copy grants and clone temporary external tables
   4. Clone schema and database
   5. Swap
   6. Clone using time travel and understand sharing vs cloning
5. Streams
   1. Overview
   2. Consuming streams using insert, update and delete
   3. Types of streams – default, append only. Consume stream using false condition
   4. Insert only streams for external tables
   5. Multiple consumers with streams
   6. Changes clause
   7. Streams consideration and stale after attribute
   8. Recreate, rename and clone effect on stream
6. Tasks
   1. Understanding tasks
   2. Create task using procedure when and troubleshoot task
   3. Scheduling tasks using CRON
   4. CRON – Daylight savings considerations
   5. DAG – Tree of tasks
   6. Task with stream
   7. User managed tasks and warehouse considerations
7. Sampling Data
   1. Overview
   2. Row sampling method
   3. System block method
8. Access management in practice
   1. System defined roles and its users
   2. Custom roles and its users
   3. Create objects from sysadmin role and assign to developer role
   4. Create custom users – developer1, developer2,qa1 and reader1
   5. Problems due to unassigned custom roles
   6. Solution of the problems
   7. Public Role
9. Best Practices
   1. Auto resume, success and failure and long running queries
   2. Resource monitor
   3. Columns storage cost and benchmarking the queries