Senior Data Engineer - Cali, Colombia - Endava

Endava
Endava
Empresa verificada
Cali, Colombia

hace 1 semana

Carolina González

Publicado por:

Carolina González

beBee Recruiter
Descripción

Responsibilities:


  • Work closely with the Data Analyst/Data Scientist in order to understand evolving needs and define the data processing flow or interactive reports
  • Discuss with the stakeholders from the other teams in order to have a better understanding about how data flows are used within the existing environment
  • Propose solutions for the cloudbased architecture and deployment flow
  • Design and build processes, data transformation and metadata that will meet business requirements and platform needs
  • Design and propose solutions for the Relational and Dimensional Model based on platform capabilities
  • Proficient in develop, maintain, test and evaluate big data solutions
  • Focus on production status and data quality of the data environment
  • Pioneer initiatives around data quality, integrity and security
  • Strong analytic skills related to working with structured and unstructured data sets

Qualifications and Experience:

- +5 years of experience in Data Engineering.

  • Proficiency in Apache Spark
  • Proficiency in Python.
  • Some experience leading IT projects and stakeholders management.
  • Experience implementing ETL/ELT process and Data pipelines.
  • Experience with Snowflake.
  • Strong SQL scripting experience.
  • Background and experience with cloud data technologies and tools.
  • Familiar with data tools and technologies like:
  • Spark, Hadoop, Apache beam, Dataproc or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Realtime pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.
  • English level from B2.
Más ofertas de trabajo de Endava
Ver todas las ofertas de empleo de Endava