Data Engineer - Bogotá, Colombia - Epsilon

Descripción

We are seeking a talented Data Engineer to join our team, focusing on the creation and maintenance of robust data pipelines. The ideal candidate will have a strong background in data engineering, with expertise in designing, developing, and optimizing data pipelines to support our data-driven initiatives.

Responsibilities:

• Implement and manage Databases.
• Develop ETLs to feed services or data models.
• Develop monitoring and data quality systems.
• Develop APIs to connect multiple services or data models.
• Achieve Sprint objectives.
• Document your developments
• Design data architectures
• Have the ability to communicate your development to non-technical people.

• Knowledge of cloud technologies in Amazon Web Services.
• Experience with SQL and NoSQL databases such as MySQL, MondoDB or Redis.
• Proven experience in Python or Scala.
• Experience working with data pipelines.
• Experience with Git.
• Experience using Spark, or equivalent technology, to manipulate large volumes of data.
• Intermediate English.
• Experience designing a Data Lake
• Have developed REST APIs.
• Have used Atlassian Jira and Confluence.
• Have worked with agile methodologies.
• Have used HDFS / Hadoop to store data.
• Knowledge of Airflow.

We offer:

• Being part of a leading team in an industry in full growth and with great international projection.
• Medical insurance
• Work modality: hybrid
• Holidays: 15 days
• Training and Development Programs
• Language training (English and/or Portuguese)