Hlavní informace

Popis úkolů a požadavky

My customer is searching the market for a candidate with proven experience in ETL development, especially with tools and technologies such as Apache Spark, Hive and Hadoop.

Job Title: ETL Developer
Location: Remote 100%
Duration: 12 Months

Required Skills:
• Bachelor's degree or higher degree in computer science, information technology or a related field.
• Proven experience in ETL development, especially with tools and technologies such as Apache Spark, Hive and Hadoop.
• Very good knowledge of programming languages ​​such as Python, Java or Scala.
• Good knowledge of REST API integration, including authentication methods
• Experience with data transformation and cleansing techniques.
• Familiarity with database and data warehousing concepts
• Knowledge of version control systems and code management best practices.
• Experience with big data technologies

Frameworks:
Python:
• asyncIO
• requests
• pyspark
• pandas
• pydantic

Scala:
• sttp
• akka-http
• spark

Kategorie