Data Engineer
Porto, Portugal
About DefinedCrowd
At DefinedCrowd, our vision is to create a natural interaction between people and machines, towards a smarter future.
Position
- Ensure data reliability, efficiency and quality provided to end users
- Be responsible for developing reliable and easy to modify data processing pipelines
- Awareness of other departments needs in terms of data
- Adapt and scale our data infrastructure as our operational services grow
- Build and improve infrastructure for data science, business intelligence, analytics and other stakeholders
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability
Your qualification
- Background in the Computer Science or Engineering field or related
- Software development experience in one or more of the following languages: Java, Python, C#
- Understanding of distributed systems
- Capable of designing scalable and data-intensive architectures
- Knowledgeable of the most common trade-offs in data storage and retrieval
- Experience with large-scale computation frameworks (e.g., Spark)
- Experience with Kafka and/or RabbitMQ
- Experience with Azure Data Warehouse or other Data Warehouse tools
- Experience with SQL and/or NoSQL databases
- DevOps skills: CI/CD pipelines, Bash Scripting, Docker, Kubernetes
What we offer
You spend a lot of your time at work, so it should be challenging, fun and interesting. At DefinedCrowd, it will be all of those things and more. Here’s what we offer:
- A unique culture, healthy working environment, and a flexible working schedule
- Excellent career development opportunities in a high growth company
- Access to an excellent compensation and benefits package
- An international and diverse team, representing more than 30 nationalities at our 4 locations
- Global mobility and relocation support with the help of our specialized team
- Continuous training opportunities leveraging hand-on workshops and formal development opportunities
- The possibility to join our offices either in Lisbon or in Porto
Portugal
Catawiki
How we work As the biggest marketplace for special items, Catawiki operates in a domain that brings plenty of unusual ch...
Portugal
Catawiki
What you will do Winning an object at Catawiki is an exciting moment, but the real excitement comes once the object has ...
Portugal
Catawiki
Key Responsibilities Design, Develop, and Maintain Automated Test Suites: Build and execute aut...