Data Engineer

About DefinedCrowd

At DefinedCrowd, our vision is to create a natural interaction between people and machines, towards a smarter future.

Position

• Ensure data reliability, efficiency and quality provided to end users
• Be responsible for developing reliable and easy to modify data processing pipelines
• Awareness of other departments needs in terms of data
• Adapt and scale our data infrastructure as our operational services grow
• Build and improve infrastructure for data science, business intelligence, analytics and other stakeholders
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability

Your qualification

• Background in the Computer Science or Engineering field or related
• Software development experience in one or more of the following languages: Java, Python, C#
• Understanding of distributed systems
• Capable of designing scalable and data-intensive architectures
• Knowledgeable of the most common trade-offs in data storage and retrieval
• Experience with large-scale computation frameworks (e.g., Spark)
• Experience with Kafka and/or RabbitMQ
• Experience with Azure Data Warehouse or other Data Warehouse tools
• Experience with SQL and/or NoSQL databases
• DevOps skills: CI/CD pipelines, Bash Scripting, Docker, Kubernetes

What we offer

You spend a lot of your time at work, so it should be challenging, fun and interesting. At DefinedCrowd, it will be all of those things and more. Here’s what we offer:

• A unique culture, healthy working environment, and a flexible working schedule
• Excellent career development opportunities in a high growth company
• Access to an excellent compensation and benefits package
• An international and diverse team, representing more than 30 nationalities at our 4 locations
• Global mobility and relocation support with the help of our specialized team
• Continuous training opportunities leveraging hand-on workshops and formal development opportunities
• The possibility to join our offices either in Lisbon or in Porto