Location: Bangalore – Hybrid
Experience: 5–6 Years
Job Description
We are looking for an experienced Data Engineer with strong expertise in building and maintaining scalable data pipelines and modern data platforms using Python, PySpark, Databricks, Spark, and Snowflake.
Key Responsibilities
Design and develop scalable data ingestion and transformation pipelines.
Build ETL/ELT workflows for structured and semi-structured datasets.
Develop data processing solutions using Python, PySpark, Apache Spark, and Scala.
Work with Databricks and Snowflake for large-scale data processing and warehousing.
Perform data validation, reconciliation, and quality checks.
Develop and maintain data warehouse solutions.
Process multiple data formats including XML, JSON, Avro, and Parquet.
Troubleshoot data pipeline failures and optimize processing performance.
Required Skills
PySpark
Python
Databricks
Apache Spark
Scala
Snowflake
ETL / ELT
Data Warehousing
XML / JSON
Avro
Parquet
Data Validation
Data Quality