About the Role
The Infrastructure team manages multiple clusters :
Pipeline clusters, built on bare metal servers at a hosting provider. It has more than 1000 threads, more than 6TB of RAM and 500TB of storage, and it is backed by CoreOS and Kubernetes.
It has two main goals : on the one hand, it stores all the available public code in a distributed filesystem and on the other hand, it runs intensive computation jobs over the stored data on top of Apache Spark.
Machine Learning research cluster, built on bare metal servers at our Madrid office. It is backed by CoreOS and Kubernetes too and it has GPUs available on every server to run deep learning algorithms.
Multiple Google Kubernetes Engine clusters for public-facing services.All clusters are managed with Terraform, Kubernetes and Helm.
The team also maintains several services such as databases, queues, continuous integration, monitoring, logging, etc.At source d , we care about Open Source, which is why we as the infrastructure team we contribute to projects such as Terraform & CoreOS and create our own.
We maintain the official Terraform provider for Helm ().We are looking for someone with background on Linux, networking and containers, passion for automation and experience working at scale.
Finally, knowledge of at least one backend / scripting language who cares about best development practices. Teams at source d Engineering consists of five different teams that represent the architecture of our product : Applications, Machine Learning, Data Processing, Language Analysis, Data Retrieval & Infrastructure.
We care about Open Source. Everything we develop is available for anyone to read, modify, and contribute (under Apache 2.
0 or GPL3 license). Some examples of our projects are :
a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.
a library to build and apply Machine Learning models on top of Universal Abstract Syntax Trees.
a SQL interface to Git repositories, written in Go.
Babelfish server, turning code into Universal Abstract Syntax Trees (UASTs).
a highly extensible Git implementation in pure Go.If you are interested in understanding how we do code reviews, please take a look at the PRs on any of these projects.
You can also learn more about our methodology . Culture source d is a company for developers by developers. We firmly believe in always doing what's best for developers in the community.
Our team consists of members who are passionate about programming. To understand our culture better, read more about it .
Of course if you’re applying for one of our non-developer roles, we’re happy to have you on board and give you support and training to get into the mindset and up to speed in a few skills you through our .
At the moment, we are 35+ people from 10+ different countries working remotely or closely together from our offices in Madrid and San Francisco.
Our remote employees are all based between San Francisco and Moscow Timezones.
We are more than happy to sponsor you a visa and guide you and your family through the whole process if you decide to come to work from our Madrid office.
At source d all of the projects we work on are public on GitHub and the vast majority are open-source under licenses such as Apache 2.0 or GPL3.
We don't just believe in open-source, we also believe in radical transparency as an organization, there we publish everything about the company at . Perks
We often go to conferences and other developer events!
Open Source Days : you are encouraged to work on any OSS project you choose 10% of your time, every second Monday.
Generous vacation allowance and parental leave.
Flexible hours, set your own schedule that fits you.
Fully remote company with flexibility to work between San Francisco and Moscow time zones.
Free books. We will buy any books that help you learn & grow.
If you choose to work from one of our offices, you will enjoy a comfortable and spacious environment, with foods, drinks & hardware.
Monthly get-togethers, annual summer and winter Christmas parties and a hackathon retreat are held in Madrid and all team members are flown over for it.