Forem

# spark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Unit testing your PySpark library
Cover image for Unit testing your PySpark library

Unit testing your PySpark library

9
Comments
9 min read
How to recover from a deleted _spark_metadata folder in Spark Structured Streaming

How to recover from a deleted _spark_metadata folder in Spark Structured Streaming

10
Comments 3
5 min read
Spark and Docker: Your Spark development cycle just got 10x faster !

Spark and Docker: Your Spark development cycle just got 10x faster !

15
Comments
7 min read
How-to guide: Set up, Manage & Monitor Spark on Kubernetes

How-to guide: Set up, Manage & Monitor Spark on Kubernetes

20
Comments
10 min read
Apache Spark Java Tutorial: Simplest Guide to Get Started
Cover image for Apache Spark Java Tutorial: Simplest Guide to Get Started

Apache Spark Java Tutorial: Simplest Guide to Get Started

11
Comments
3 min read
Is Structured Streaming Exactly-Once? Well, it depends...

Is Structured Streaming Exactly-Once? Well, it depends...

10
Comments
4 min read
can a map function be executed on multiple executors for an item in RDD.

can a map function be executed on multiple executors for an item in RDD.

3
Comments
1 min read
Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

9
Comments
10 min read
Using Aerospike Connect For Spark
Cover image for Using Aerospike Connect For Spark

Using Aerospike Connect For Spark

6
Comments
5 min read
Migrating from a plain Spark Application to ZIO with ZparkIO

Migrating from a plain Spark Application to ZIO with ZparkIO

9
Comments
6 min read
Spark: unit, integration and end-to-end tests.

Spark: unit, integration and end-to-end tests.

20
Comments
5 min read
Spark Journey begins...
Cover image for Spark Journey begins...

Spark Journey begins...

8
Comments
3 min read
Working with nested structures in Spark

Working with nested structures in Spark

7
Comments 1
3 min read
Intoduction to Apache Spark
Cover image for Intoduction to Apache Spark

Intoduction to Apache Spark

10
Comments
6 min read
Spark Side Menu Micro-Interactions Deconstruction
Cover image for Spark Side Menu Micro-Interactions Deconstruction

Spark Side Menu Micro-Interactions Deconstruction

3
Comments
2 min read
Unit Testing Apache Spark Structured Streaming using MemoryStream
Cover image for Unit Testing Apache Spark Structured Streaming using MemoryStream

Unit Testing Apache Spark Structured Streaming using MemoryStream

7
Comments
4 min read
Setting up IntelliJ IDEA for Apache Spark and Scala development
Cover image for Setting up IntelliJ IDEA for Apache Spark and Scala development

Setting up IntelliJ IDEA for Apache Spark and Scala development

6
Comments
2 min read
Exploiting Schema Inference in Apache Spark
Cover image for Exploiting Schema Inference in Apache Spark

Exploiting Schema Inference in Apache Spark

2
Comments
3 min read
How to create a low-cost Apache Spark cluster on Microsoft Azure

How to create a low-cost Apache Spark cluster on Microsoft Azure

7
Comments
4 min read
How to make a column non-nullable in Spark Structured Streaming

How to make a column non-nullable in Spark Structured Streaming

5
Comments
2 min read
Hadoop vs Spark: Which is a better framework to select for processing Big Data?
Cover image for Hadoop vs Spark: Which is a better framework to select for processing Big Data?

Hadoop vs Spark: Which is a better framework to select for processing Big Data?

6
Comments
5 min read
Why are we building DevOps platform for Big Data?
Cover image for Why are we building DevOps platform for Big Data?

Why are we building DevOps platform for Big Data?

3
Comments
3 min read
The Big Data Bravura: Introducing Apache Spark
Cover image for The Big Data Bravura: Introducing Apache Spark

The Big Data Bravura: Introducing Apache Spark

21
Comments 2
3 min read
Spark NLP: State of the art natural language processing at scale

Spark NLP: State of the art natural language processing at scale

4
Comments
2 min read
Install Apache Spark (and Apache Hadoop) smoothly
Cover image for Install Apache Spark (and Apache Hadoop) smoothly

Install Apache Spark (and Apache Hadoop) smoothly

8
Comments
1 min read
loading...