Job Description:

We are hiring a Data Engineer with strong hands-on experience in PySpark, Scala, and Python. You must have solid expertise in Apache Spark, as it will be the core technology used for building and managing large-scale data processing pipelines.

Experience with cloud platforms like Google Cloud Platform (GCP), Microsoft Azure, or AWS is a plus.

Required Skills:

• Strong hands-on experience with Apache Spark

• Proficient in PySpark

• Experience in Scala and Python

• Knowledge of ETL processes and data pipeline design

• Understanding of distributed data processing

• Familiarity with version control tools like Git

• Basic knowledge of cloud platforms (GCP, AWS, or Azure)

Nice to Have:

• Experience with cloud-native data tools (e.g., Dataproc, Glue, EMR, BigQuery)

• Familiarity with workflow/orchestration tools like Airflow or Cloud Composer

• Experience with CI/CD for data engineering

• Exposure to both structured and unstructured data