“ELT Data Pipelining in Snowflake Data Warehouse — using Streams and Tasks” by Christopher Tao https://link.medium.com/zBy9C8AOf6
Medium
ELT Data Pipelining in Snowflake Data Warehouse — using Streams and Tasks
In my previous post:
“Snowflake’s SnowPro Certification Exam Preparation Guide — How to pass in 3 days” by Jeno Yamma https://link.medium.com/MhsljnhJX7
Medium
Snowflake’s SnowPro Certification Preparation Guide — How to pass in 3 days
SnowPro Certification
Queries related to Snowflake, please hit the Discuss tab to join the Forum and get inputs from other members of group.
Snowflake Developer Community pinned «Queries related to Snowflake, please hit the Discuss tab to join the Forum and get inputs from other members of group.»
Queries related to Snowflake, ideas on preparing for certification.. please hit the Discuss tab to join the Forum and get inputs from other members of group.
Introduction to External Functions — Snowflake Documentation
https://docs.snowflake.com/en/sql-reference/external-functions-introduction.html
https://docs.snowflake.com/en/sql-reference/external-functions-introduction.html
The Most Awesome New Snowflake features for Data Science & Engineering.
https://www.linkedin.com/pulse/most-awesome-new-snowflake-features-data-science-nick-akincilar
https://www.linkedin.com/pulse/most-awesome-new-snowflake-features-data-science-nick-akincilar
LinkedIn
The Most Awesome New Snowflake features for Data Science & Engineering.
Snowflake is a never-ending improvement machine and as part of this, we announced a number of new features that will be rolling out soon and I want to take few minutes to go through a few of them and explain how these features can impact your business. The…
Hey folks,
I'm Shoaib, data engineer with 5+ years of experience with expertise in SQL, Spark, Python, Big data and cloud technology.
I would like to train and mentor individuals on the different tech stack.
Starting off with *SQL Bootcamp* which will cover basics to advanced sql skill training.
The target audience would be final year engineering students, freshers and individuals having less than an year of working experience.
The training would be *Free of Cost* and the batch size would be 10-15 people only.
Registration closes by 15th May 2021.
Interested people please fill out the form :
https://forms.gle/cXvmALf5WJ4qVmN77
I'm Shoaib, data engineer with 5+ years of experience with expertise in SQL, Spark, Python, Big data and cloud technology.
I would like to train and mentor individuals on the different tech stack.
Starting off with *SQL Bootcamp* which will cover basics to advanced sql skill training.
The target audience would be final year engineering students, freshers and individuals having less than an year of working experience.
The training would be *Free of Cost* and the batch size would be 10-15 people only.
Registration closes by 15th May 2021.
Interested people please fill out the form :
https://forms.gle/cXvmALf5WJ4qVmN77
Google Docs
SQL Bootcamp
This will be a free workshop organised on Friday evening and Saturday afternoon/evening.
Batch size restricted to 10-15 members.
No prior technical experience is required, all you need is personal laptop.
Batch size restricted to 10-15 members.
No prior technical experience is required, all you need is personal laptop.
Databricks Developer Forum
https://t.me/databricksdevforum
Join the group to post queries related to Databricks.
https://t.me/databricksdevforum
Join the group to post queries related to Databricks.
SQL Cheat Sheet.pdf
1.8 MB
Emailing SQL Cheat Sheet.pdf
Probable Interview Questions on Snowflake :
Snowflake being relatively new most of the interview questions would be based on how you have implemented and used it in your project.
Some which I could recall are -
1. Snowflake Architecture and it's various components
2. Data loading and challenges faced
3. Data loading include copy command, how do you create stages, various stage - table/internal/external.
4. How does stages differ from each other.
5. How to create external stage referencing S3 bucket/ADSL
6. Scenarios like how do you handle duplicates as integrity constraints are not enforced in SF.
7. What are warehouses and how do you design it.
8. Performance optimization - Auto Scaling, Caching and clustering
9. Scenarios where you have used time travel feature.
10. UDF and how have you used it.
11. Restrictions in SF as compared to RDBMS database.
12. If you have worked on migration what are challenges faced and how did you overcome it.
13. Task, streams implementation scenario.
14. Structured/semi- structured files how have you loaded them.
15. Volume of data you have handled.
16. Architecture of your project.
17. Orchestration of SF pipelines - tools being used for it.
18. How do you handle transactional transactions in Snowflake.
19. Snowpipe
20.Data Unloading.
21. Role based access management - important to have knowledge on this.
22. How does normal views and materials views differ in Snowflake
There can be various scenario based question based on what you explain about your project and how knowledgeable interviewer is.
With Snowflake you need to have basic to intermediate knowledge on cloud technology and orchestration will be add on.
Snowflake being relatively new most of the interview questions would be based on how you have implemented and used it in your project.
Some which I could recall are -
1. Snowflake Architecture and it's various components
2. Data loading and challenges faced
3. Data loading include copy command, how do you create stages, various stage - table/internal/external.
4. How does stages differ from each other.
5. How to create external stage referencing S3 bucket/ADSL
6. Scenarios like how do you handle duplicates as integrity constraints are not enforced in SF.
7. What are warehouses and how do you design it.
8. Performance optimization - Auto Scaling, Caching and clustering
9. Scenarios where you have used time travel feature.
10. UDF and how have you used it.
11. Restrictions in SF as compared to RDBMS database.
12. If you have worked on migration what are challenges faced and how did you overcome it.
13. Task, streams implementation scenario.
14. Structured/semi- structured files how have you loaded them.
15. Volume of data you have handled.
16. Architecture of your project.
17. Orchestration of SF pipelines - tools being used for it.
18. How do you handle transactional transactions in Snowflake.
19. Snowpipe
20.Data Unloading.
21. Role based access management - important to have knowledge on this.
22. How does normal views and materials views differ in Snowflake
There can be various scenario based question based on what you explain about your project and how knowledgeable interviewer is.
With Snowflake you need to have basic to intermediate knowledge on cloud technology and orchestration will be add on.
Questions specific to data loading/unloading :
1. Difference between copy and put command.
2. Steps involved in creation of stages.
3. Different type of stages.
4. Rejected/bad records- how to view them.
5. Considering a scenario where you need to load files as soon as it arrives, how would you implement it.
6. Loading semi structured data - through variant column.
7. How does snowflake always load the incremental data files ignoring the ones already loaded.
8. How would you force to load all the files in a given folder/directory.
9. Can you query data on external storage without loading them, if yes how ?
10. Bulk vs Continuous loading.
1. Difference between copy and put command.
2. Steps involved in creation of stages.
3. Different type of stages.
4. Rejected/bad records- how to view them.
5. Considering a scenario where you need to load files as soon as it arrives, how would you implement it.
6. Loading semi structured data - through variant column.
7. How does snowflake always load the incremental data files ignoring the ones already loaded.
8. How would you force to load all the files in a given folder/directory.
9. Can you query data on external storage without loading them, if yes how ?
10. Bulk vs Continuous loading.