Apache Pig Operators with Syntax and Examples
1. Apache Pig Operators Tutorial There is a huge set of Apache Pig Operators available in Apache Pig. In this article, “Introduction to Apache Pig Operators” we will discuss all types of Apache Pig...
TechVidvan Blog
Scala Tuples with Scala Tuple type and Examples
1. Scala Tuples What are Scala Tuples? How do we iterate over them? How do we convert tuples in Scala to strings or swap their elements? These are the questions we will answer in...
7 shining Apache Spark SQL Features: A Quick Guide
1. Objective There are several shining Spark SQL features available. In this article, we will focus on all those features of SparkSQL, such as unified data access, high compatibility and many more. Although, We...
Hadoop Spark Integration: Quick Guide
1. Objective There is one question always arise in mind, that how does Apache Spark fit in the Hadoop ecosystem. Also, sometimes question strikes how one can run spark in an existing Hadoop cluster....
Apache Spark Design Principles- Why Spark Matters
1. Objective Recently, we have seen Apache Spark became a prominent player in the big data world. There is a huge spark adoption by big data companies, even at an eye-catching rate. But then...
Spark Streaming Window Operations- A Quick Guide
1. Objective Spark streaming leverages advantage of windowed computations in Apache Spark. It offers to apply transformations over a sliding window of data. In this article, we will learn the whole concept of Apache...
Apache Spark Executor – For Executing Tasks
1. Objective There are some distributed agents in spark, which are responsible for executing tasks, those distributed agents are Spark Executor. In this blog, we will learn the whole concept of Apache spark executor....
Spark Modes of Deployment – Cluster mode and Client Mode
1. Objective While we talk about deployment modes of spark, it specifies where the driver program will be run, basically, it is possible in two ways. At first, either on the worker node inside...
Apache Spark Stage- Physical Unit Of Execution
1. Objective In Apache Spark, a stage is a physical unit of execution. We can say, it is a step in a physical execution plan. In this document, we will learn the whole concept...
Spark Streaming Execution Flow and Streaming Model
1. Objective Spark Streaming enables fast, scalable and fault-tolerant processing of live data streams. In this article, we will learn the whole concept of spark streaming execution flow. For better understanding, we will start...
Spark Streaming Fault Tolerance- How it is achieved
1. Objective The recovery of failures of machines is already inbuilt in Apache spark streaming. This feature is what we call spark streaming fault tolerance property. In this blog, we will learn the whole...