Big Data Engineer

Your Skills Proficiency in building data pipelines with Scala and PySpark, with over five years of experience At least one year of experience in managing workflows with Airflow Familiarity with Hadoop and Cloudera platforms, particularly in handling Parquet files Strong communication skills to effectively collaborate with team members Experience in an agile environment, including task creation and management What You Will Do Develop and maintain data pipelines using Scala and PySpark to ensure