Troubleshooting Apache Spark

Rating 3.28 out of 5 (9 ratings in Udemy)

What you'll learn

Solve long-running computation problems by leveraging lazy evaluation in Spark
Avoid memory leaks by understanding the internal memory management of Apache Spark
Rework problems due to not-scaling out pipelines by using partitions
Debug and create user-defined functions that enrich the Spark API
Choose a proper join strategy depending on the characteristics of your input data
Troubleshoot APIs for joins - DataFrames or DataSets …

Rating 3.28 out of 5 (9 ratings in Udemy)

What you'll learn

Solve long-running computation problems by leveraging lazy evaluation in Spark
Avoid memory leaks by understanding the internal memory management of Apache Spark
Rework problems due to not-scaling out pipelines by using partitions
Debug and create user-defined functions that enrich the Spark API
Choose a proper join strategy depending on the characteristics of your input data
Troubleshoot APIs for joins - DataFrames or DataSets
Write code that minimizes object creation using the proper API
Troubleshoot real-time pipelines written in Spark Streaming

Description

Apache Spark has been around quite some time, but do you really know how to solve the development issues and problems you face with it? This course will give you new possibilities and you'll cover many aspects of Apache Spark; some you may know and some you probably never knew existed. If you take a lot of time learning and performing tasks on Spark, you are unable to leverage Apache Spark's full capabilities and features, and face a roadblock in your development journey. You'll face issues and will be unable to optimize your development process due to common problems and bugs; you'll be looking for techniques which can save you from falling into any pitfalls and common errors during development. With this course you'll learn to implement some practical and proven techniques to improve particular aspects of Apache Spark with proper research

You need to understand the common problems and issues Spark developers face, collate them, and build simple solutions for these problems. One way to understand common issues is to look out for Stack Overflow queries. This course is a high-quality troubleshooting course, highlighting issues faced by developers in different stages of their application development and providing them with simple and practical solutions to these issues. It supplies solutions to some problems and challenges faced by developers; however, this course also focuses on discovering new possibilities with Apache Spark. By the end of this course, you will have solved your Spark problems without any hassle.

About the Author

Tomasz Lelek is a Software Engineer, programming mostly in Java and Scala. He is a fan of microservice architectures and functional programming. He dedicates considerable time and effort to getting better every day. He is passionate about nearly everything associated with software development, and believes that we should always try to consider different solutions and approaches before solving a problem. Recently he was a speaker at conferences in Poland -, Confitura and JDD (Java Developers Day), and also at Krakow Scala User Group. He has also conducted a live coding session at Geecon Conference.

Duration 1 Hours 58 Minutes

Paid

Self paced

Intermediate Level

English (US)

Rating 3.28 out of 5 (9 ratings in Udemy)

Go to the Course
We have partnered with providers to bring you collection of courses, When you buy through links on our site, we may earn an affiliate commission from provider.