How to match your resume to a Big Data Engineer job description
We are looking for a Big Data Engineer to build large-scale batch and streaming data processing jobs. You will tune Spark jobs for cost and runtime, and design data lake layouts and retention. Required: hands-on experience with Spark, Distributed computing, Partitioning strategy, Data lake design, and working knowledge of Databricks, Hadoop, Kafka. Preferred: Databricks Certified Data Engineer Professional. Success in this role is measured by job runtime, cluster cost, data freshness.
Required skills to mirror
- Spark
- Distributed computing
- Partitioning strategy
- Data lake design
- Streaming ingestion
- Scala or Python
- Performance tuning
- Schema evolution
Seniority ladder
- Data Engineer
- Big Data Engineer
- Data Platform Lead
Title variants
- Hadoop Engineer
- Spark Developer