Naveen - (Founder & Trainer @ NPN Training)

26 Followers

Memory Consumption of Hadoop NameNode

Each file or directory or block occupies about 150 bytes in the namenode memory. So a cluster with a namenode with 32G RAM can support a…

2 min readAug 8, 2022

Naveen - (Founder & Trainer @ NPN Training)

Various Entry Points for Apache Spark

In Data Engineering Apache Spark is probably one of the most popular framework to process huge volume of data. In this blog post I am…

1 min readSep 27, 2021

Naveen - (Founder & Trainer @ NPN Training)

Apache Spark Architecture

Learn the fundamentals of apache spark architecture, and various components of apache spark, Masters Node, Workder Node, Executor, Task etc

2 min readApr 2, 2021

Naveen - (Founder & Trainer @ NPN Training)

SparkContext & SparkSession

Learn the difference between SparkContext and SparkSession which is used in spark 1.x and 2.x, how to create both of them

1 min readMar 19, 2021

Naveen - (Founder & Trainer @ NPN Training)

Getting Started with Containerization and Docker

In this blog post we will learn the fundamentals of Containerization and Docker.

1 min readMar 4, 2021

Getting Started with Containerization and Docker

Naveen - (Founder & Trainer @ NPN Training)

Scala Language Fundamentals

1 min readFeb 28, 2021

Naveen - (Founder & Trainer @ NPN Training)

Data Skew Problem in Spark

Learn how to solve one of the biggest problem to improve the performance of Spark i.e Data Skew

2 min readFeb 25, 2021

Naveen - (Founder & Trainer @ NPN Training)

Flight delay dataset Analysis using Hive

Hive is a data ware house infrastructure built on top of Hadoop ecosystem to query and analyze structured data. It gives SQl like…

2 min readFeb 25, 2021

Naveen - (Founder & Trainer @ NPN Training)

Getting Started with Sqoop — Part I

Most of the organizations store their operational data in relational databases. So, there was a need for a tool which can import and…

5 min readFeb 24, 2021

Naveen - (Founder & Trainer @ NPN Training)

Multi Module Project with Maven

In this blog post I will explain Multi Module Project with Apache Maven. First we will understand what is Multi Module Project in Maven.

1 min readFeb 19, 2021

Memory Consumption of Hadoop NameNode

Each file or directory or block occupies about 150 bytes in the namenode memory. So a cluster with a namenode with 32G RAM can support a…

Various Entry Points for Apache Spark

In **Data Engineering** Apache Spark is probably one of the most popular framework to process huge volume of data. In this blog post I am…

Apache Spark Architecture

Learn the fundamentals of apache spark architecture, and various components of apache spark, Masters Node, Workder Node, Executor, Task etc

SparkContext & SparkSession

Learn the difference between SparkContext and SparkSession which is used in spark 1.x and 2.x, how to create both of them

Getting Started with Containerization and Docker

In this blog post we will learn the fundamentals of Containerization and Docker.

Scala Language Fundamentals

Data Skew Problem in Spark

Learn how to solve one of the biggest problem to improve the performance of Spark i.e Data Skew

Flight delay dataset Analysis using Hive

Hive is a data ware house infrastructure built on top of Hadoop ecosystem to query and analyze structured data. It gives SQl like…

Getting Started with Sqoop — Part I

Most of the organizations store their operational data in relational databases. So, there was a need for a tool which can import and…

Multi Module Project with Maven

In this blog post I will explain Multi Module Project with Apache Maven. First we will understand what is Multi Module Project in Maven.

Naveen - (Founder & Trainer @ NPN Training)

In Data Engineering Apache Spark is probably one of the most popular framework to process huge volume of data. In this blog post I am…