Getting started with Spark big data bootcamp

Mainly aimed at students with a science and engineering background who hope to engage in data science-related work in the future. By completing typical spark projects in the industry, students can master the skills and thinking methods required for the next data science project in the big data era, greatly improving their competitiveness in applications and job hunting.

In recent years, an unprecedented big data revolution has taken place around the world. In an Internet company with more than 100 million daily active users, the common pandas and scikit-learn can no longer meet daily needs, and spark has become the most popular big data processing framework. The industry has an increasing demand for spark talents, but spark is not common in school courses. This course will start with basic concepts and lead students step by step to complete the first complete spark project. At the same time, we will also share the most commonly used operating techniques and ways of thinking in the industry, so that you can better understand the core logic of processing big data.

The total duration of the bootcamp is four weeks. In the first week, the instructor communicates with the students online, introduces basic concepts, and learns Spark data processing; in the second week, they learn Spark text processing and machine learning related operations, and complete a simple sentiment analysis model. In the last two weeks, you will apply the knowledge you have learned and complete a practical project using spark. This project is based on Yelp data and uses both user data and review text to build a fake review detection system