Lead Data Engineer
Hewlett Packard
Sant Cugat del Valles, Barcelona, Spain
hace 6 días

We all know that a company’s ultimate goal is to increase their revenue, raise sales, and optimize costs. What better way to do this than through data?

In our commercial organisation we want to invest in the power of data and that is why we have created our Pricing and Analytics dream team composed by : data scientist, data analysts, data engineers, project managers, business analysts, digital analysts and a long list of highly skilled professionals that work together bringing insights from data to help the organisation thrive faster and better.

Do you want to have a direct impact on our company’s growth and revenue? Don’t miss this opportunity to join our diverse and dynamic team and shape HP’s future.

The data engineering team is currently building a company-wide Data Lake in the Cloud (AWS) that enables us to optimize our Sales priorities, our Marketing spend & Pricing

In this role you will be leading a team of 10+ data engineers, who are responsible for bringing any data requested by the teams of data scientists into this data lake and you will make sure that those assets are properly built, documented, and evangelized to a broad audience of users.

Key Responsibilities :

  • Manage large amount of production level data pipelines across multiple platforms and types
  • Organize your team in a follow the sun (Global workflow) organization, and leverage to have footprints in all continents
  • Assigns responsibilities, provides direction, leadership and coaching, removes barriers as needed to enable teams to execute their roles and achieve objectives and goals.
  • People recruitment and development
  • Cost management, and direction-setting within the area of responsibility.
  • Give guidance, advise and bring into our data lake any data required, constrained by our context and technology stack
  • Leverage our stack in the fastest & most efficient manner : S3, Kubernetes cluster, Dataiku DSS, Spark (pySpark, Scala, Spark R), python, R, Julia languages, data partitioning
  • Guide and coach customers to access and use this data appropriately
  • Architecture organization of data subjects, and segment by gold / silver / platinum qualities
  • Requirements :

  • Typically, 8+ years of relevant experience
  • Bachelor's degree in Computer Science, Engineering
  • Experience directly leading and developing a team
  • Familiar with Agile Project Management.
  • In-depth understanding of technology in direct responsibility.
  • Deep understanding of Spark (experience on Spark optimization would be ideal)
  • Proficiency with pySpark
  • Experience working in a big data environment is required (hdfs, partitioning concept)
  • SQL proficiency, experience of ETL activities
  • Experience with Cloud environment (AWS preferred)
  • Experience with Kubernetes, docker
  • Nice to have :
  • Go & Julia
  • Go & Julia
  • Experience with Dataiku DSS
  • Python & R, Scala is a plus
  • What we offer :

  • Opportunity to work in an international organization with colleagues coming from all over the world.
  • Diverse, continued internal growth and career opportunities. Including HP’s own learning platform and LinkedIn Learning.
  • An attractive benefits package.
  • Our Women Network organizes activities such as; Networking, the promotion of STEM vocations, talks on; improving business acumen, work life balance and skills of the future etc.
  • Reportar esta oferta

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Mi Correo Electrónico
    Al hacer clic en la opción "Continuar", doy mi consentimiento para que neuvoo procese mis datos de conformidad con lo establecido en su Política de privacidad . Puedo darme de baja o retirar mi autorización en cualquier momento.
    Formulario de postulación