Software Engineer - Infrastructure Team

About source{d}

source{d} builds the open-source components that enable large-scale code analysis and machine learning on source code.

Our powerful tools can ingest all of the world’s public git repositories turning code into ASTs ready for machine learning and other analyses, all exposed through a flexible and friendly API.

We are paving the way for the future of the software development life cycle, where code becomes analyzable data powering the next generation of developer tools.

Official website

Position

The Infrastructure team focuses on managing and growing our bare metal computation cluster. This cluster allows us to run large scale computational algorithms and store the required information for those computations.

• Our cluster, with close to 2000 threads, more than 11TB of RAM and 1PB of storage, is backed by CoreOS and Kubernetes. It has two main goals: on the one hand, it stores all the available public code in a HDFS cluster and on the other hand, it runs intensive computation jobs over the stored data on top of Spark
• Besides the main points above, the infrastructure team is also in charge of several other important services, such as databases, queues, CI, monitorization, loging, etc.
• At source{d}, we really care about Open Source, which is why we as the infrastructure team we contribute to projects such as Terraform & CoreOS and create our own
• We are looking for someone with a strong Linux background, good networking knowledge, passion for automation and experience working at scale. Finally, knowledge of at least one backend/scripting language who cares about best development practices

Your qualification

Infrastructure team (Go and Python): Manages a cluster of on-prem bare metal servers with Kubernetes and CoreOS, and GCP for user facing applications.

What we offer

• We go to conferences and other developer events!
• Open Source Days, every second Monday, you are encouraged to work on any OSS project you choose
• Flexible hours, set your own schedule that fits you
• Free books. We will buy any books that help you learn & grow
• If you choose to work from one of our offices, you will enjoy a comfortable and spacious environment
• Annual summer and winter Christmas parties and a hackathon retreat are held in Madrid and all team members are flown over for it
• We also have our own, Open Source craft beers
• We offer visa and relocation support for those wanting to work in the Madrid office.

Additional details

Culture

• source{d} is a company for developers by developers. We firmly believe in always doing what's best for the individual developer in the community. Our team consists of members who are passionate about programming
• At the moment, we are 25+ people from 10 different countries working as a distributed organization. Some of our team members are based in the Madrid or San Francisco office, others work remotely from around the world (Portugal, Estonia, Russia, and others)
• For those wanting to work from one of our offices, we fully support the visa and moving process for you and your family
• At source{d}, we have a transparent salary policy which we feel strongly about it. Your seniority level will be determined during the last round of on-site interviews
• At source{d} all of the projects we work on are public on GitHub and the vast majority are open-source under licenses such as Apache 2.0 or GPL3
• We don't just believe in open-source, we also believe in radical transparency as an organization