Lead/Senior/Mid-level Data Engineers

• 2-10+ Yrs
• Globally
• 15 Dec 2021
• Job Description

• We are hiring passionate Data Engineers globally for xFusion Technologies.

  • Overall 2 to 10+ years of experience in Data Engineering, designing and implementing complex large scale Data Pipelines for processing data from various data sources.
  • Experience in designing, implementing, and optimizing large scale data pipelines in production tools and technologies listed in the technology stack on the cloud, specifically AWS.
  • Fluent in Python, Java and Scala
  • Experience Apache Spark, Scala, Java and Delta Lake
  • Experience in designing and implementing templated ETL/ELT data pipelines
  • Expert level experience in Data Pipeline Orchestration using Apache Airflow for large scale production deployment
  • Experience in visualizing data from various tasks in the data pipeline using Apache Zeppelin/Plotly or any other visualization library.
  • Log management and log monitoring using ELK/Grafana
  • Git Hub Integration
• Desired Candidate Profile

• Overall 2 to 10+ years of experience and passion with Data Engineering with fluency in Python, Java, and Scala and well versed with Apache Spark, Scala, Java, and Delta Lake

• Key Skills
• • Apache Spark
  • Spark SQL
  • SparkR
  • Scala
  • Apache Athena
  • Apache Airflow
  • Python
  • PySpark
  • Apache Zeppelin
  • Plotly
  • AWS EMR
  • EC2
  • S3
  • Kubernetes
  • ELK
  • Grafana
  • Apache Arrow/Parquet
  • Java
• Salary
• Open to be discussed; Based on experience and ability
• Industry
• Information technology
• Functional Area
• Data Engineer
• Role
• Data Engineer
• Employment Type
• Contract or full time