Data Engineer

• What is surrogate key in data warehouse? (Learn)
• What is Change data capture(CDC) and how does it increase efficiency in database systems? 
• Why is data partitioning important in big data systems? (Learn)

• How to handle late arriving data in a customer data table, such that the downtime is minimal? 
• How can we utilise a common date dimension in three entity tables, ensuring no data redundancy is there?

Given a string 'S', you are supposed to return the number of distinct substrings(including empty substring) of the given string. You should implement the program using a trie.

Note :

A string ‘B’ is a substring of a string ‘A’ if ‘B’ that can be obtained by deletion of, several characters(possibly none) from the start of ‘A’ and several characters(possibly none) from the end of ‘A’. 

Two strings ‘X’ and ‘Y’ are considered different if there is at least one index ‘i’  such that the character of ‘X’ at index ‘i’ is different from the character of ‘Y’ at index ‘i’(X[i]!=Y[i]).

• What is the best way to manage logs being written to a single azure notebook from various microservices?
• What is the importance of delta tables in Azure Databricks?
• How to use autoloader in Databricks, when a library is not working well with streaming data.

• How can you calculate the difference between two columns containing date type data in SQL? (Learn)
• How to check which employee has logged in for 6 or more consecutive days?

• How can you load a file of size 1GB in snowflake? 
• Which features in snowflake can be used to boost the efficiency of complex SQL queries?