Data Engineer Lead M/F
Sanofi
Barcelona
hace 1 día

Within the Digital Factory 4.0 initiative, the primary objective is to increase performance and agility in Sanofi’s operations.

As Data Engineer you will be involved at the heart of Data Platform, one the key foundation supporting the initiative.

Initial role of the Data Engineer position is to support the development of Industrial Affairs Data Platform and derived Data Products by providing solid foundations to Digital Products with the aim of building key features such as :

  • Acquisition of data from source systems in batch mode (Data Lake)
  • Acquisition of events from source systems in near real time (ex : SAP iDocs)
  • Streaming sensor data from shopfloor & laboratory instruments (Time Series)
  • Data Processing capabilities and more specifically, orchestration of Data Pipelines (Spark, Airflow)
  • Effective intregration with consumers of data (Digital Products, BI, Data Science)
  • As part of the Digital Industrial Affairs Data & Analytics teams, Data Engineer contributes to :

  • Design and build features in alignement with best practices : Design architectures and solutions in a Cloud context (Data Platform is built on top of AWS),Code (Python, Scala)Test (Unit test, Integration, .
  • CICD (Infra as Code, GitLab CI)
  • Support operations with the appropriate mindset oriented Operation Excellence
  • Enforce compliance requirements of the solution in regards of GxP regulation
  • The role will require strong interfaces with :

  • Cloud & Data architects
  • Product Owners
  • Scrum Masters
  • Developemnt teams
  • External Partners
  • Key accountabilities :

  • Design & develop optimized modules meeting reliability, reusability, latency & performance & requirements
  • Adapt the modules to optimize the running costs
  • Support the Data modules engineers for designing optimized data models
  • Insure le level 3 support of the modules in operation
  • Requirements :

  • 5 years experience in development in a cloud & data engineering environment with high quality standards
  • Strong AWS managed services skills and experience including IAM, S3, Glue, Containers, MSK, RDS, Lambda, Step functions, MWAA, CloudFormation
  • Strong experience with Python, SQL & Scala / Spark
  • Experience on Airflow and Kafka is a plus
  • Experience with CI / CD. Gitlab CI is a plus.
  • Snowflake experience is a plus
  • Fluent English as it the primary working language
  • Reportar esta oferta
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Inscribirse
    Mi Correo Electrónico
    Al hacer clic en la opción "Continuar", doy mi consentimiento para que neuvoo procese mis datos de conformidad con lo establecido en su Política de privacidad . Puedo darme de baja o retirar mi autorización en cualquier momento.
    Continuar
    Formulario de postulación