Oindrila ChakrabortyData Security: Column Level Encryption in DatabricksData Security is one of the important concepts in any Data Engineering Platform. Most companies spend a huge amount of money in…5 min read·2 hours ago----
Oindrila ChakrabortyCache vs. Persist in DatabricksWhat are “Cache” and “Persist”?11 min read·6 days ago--3--3
Oindrila ChakrabortyDeveloping a Simple “Streaming Application” Using “Spark” in DatabricksWhy “Streaming Application” is Required to be “Developed”?11 min read·Nov 1, 2023----
Oindrila ChakrabortyPerform “SCD Type 1” Using “MERGE” Operation on Delta Table Using “SPARK SQL” and “PySpark” in…What is “Slowly Changing Dimension”?13 min read·Oct 7, 2023--4--4
Oindrila ChakrabortyDifferent Types of “Join Strategies” in “Apache Spark”What is “Join Selection Strategy”?17 min read·Oct 6, 2023--1--1
Oindrila ChakrabortyUsage of “Broadcast Variable” in “Joins” in “Apache Spark”Why “Broadcast Variable” is Used?7 min read·Oct 6, 2023--1--1
Oindrila ChakrabortyIntroduction to “Partition” in “Apache Spark”What is the “Importance” of “Partition”?8 min read·Sep 15, 2023--1--1
Oindrila ChakrabortyHow to “Optimize” the “Delta Tables” in DatabricksHow “Delta Tables” Become “Slow” to “Query”?6 min read·Sep 15, 2023--1--1
Oindrila ChakrabortyIntroduction to “Delta Lake” in Databricks“Disadvantages” of “Storing Data” in “Data Lake”5 min read·Aug 15, 2023--1--1