Oindrila Chakraborty – Medium

Oindrila Chakraborty

Oindrila Chakraborty

Developing a Simple “Streaming Application” Using “Spark” in Databricks

Why “Streaming Application” is Required to be “Developed”?

11 min readNov 1, 2023

--

Developing a Simple “Streaming Application” Using “Spark” in Databricks

--

Oindrila Chakraborty

Perform “SCD Type 1” Using “MERGE” Operation on Delta Table Using “SPARK SQL” and “PySpark” in…

What is “Slowly Changing Dimension”?

13 min readOct 7, 2023

--

4

Perform “SCD Type 1” Using “MERGE” Operation on Delta Table Using “SPARK SQL” and “PySpark” in…

--

4

Oindrila Chakraborty

Different Types of “Join Strategies” in “Apache Spark”

What is “Join Selection Strategy”?

17 min readOct 6, 2023

--

1

Different Types of “Join Strategies” in “Apache Spark”

--

1

Oindrila Chakraborty

Usage of “Broadcast Variable” in “Joins” in “Apache Spark”

Why “Broadcast Variable” is Used?

7 min readOct 6, 2023

--

1

Usage of “Broadcast Variable” in “Joins” in “Apache Spark”

--

1

Oindrila Chakraborty

Introduction to “Partition” in “Apache Spark”

What is the “Importance” of “Partition”?

8 min readSep 15, 2023

--

1

Introduction to “Partition” in “Apache Spark”

--

1

Oindrila Chakraborty

How to “Optimize” the “Delta Tables” in Databricks

How “Delta Tables” Become “Slow” to “Query”?

6 min readSep 15, 2023

--

--

Oindrila Chakraborty

Introduction to “Delta Lake” in Databricks

“Disadvantages” of “Storing Data” in “Data Lake”

5 min readAug 15, 2023

--

1

Introduction to “Delta Lake” in Databricks

--

1

Oindrila Chakraborty

Introduction to “Unity Catalog” in Databricks

What is “Unity Catalog”?

10 min readAug 14, 2023

--

2

Introduction to “Unity Catalog” in Databricks

--

2

Oindrila Chakraborty

Introduction To “Tuple”

What is a “Tuple”?

6 min readAug 11, 2023

--

Introduction To “Tuple”

--

Oindrila Chakraborty

Operations On “List”

“Usage” of “Multiplication Operator” on “List”

8 min readAug 11, 2023

--

Operations On “List”

--

Oindrila Chakraborty

Oindrila Chakraborty

I have 11+ experience in IT industry. I love to learn about the data and work with data. I am happy to share my knowledge with all. Hope this will be of help.

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams