Data Engineer
Porto, Portugal
About DefinedCrowd
At DefinedCrowd, our vision is to create a natural interaction between people and machines, towards a smarter future.
Position
- Ensure data reliability, efficiency and quality provided to end users
- Be responsible for developing reliable and easy to modify data processing pipelines
- Awareness of other departments needs in terms of data
- Adapt and scale our data infrastructure as our operational services grow
- Build and improve infrastructure for data science, business intelligence, analytics and other stakeholders
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability
Your qualification
- Background in the Computer Science or Engineering field or related
- Software development experience in one or more of the following languages: Java, Python, C#
- Understanding of distributed systems
- Capable of designing scalable and data-intensive architectures
- Knowledgeable of the most common trade-offs in data storage and retrieval
- Experience with large-scale computation frameworks (e.g., Spark)
- Experience with Kafka and/or RabbitMQ
- Experience with Azure Data Warehouse or other Data Warehouse tools
- Experience with SQL and/or NoSQL databases
- DevOps skills: CI/CD pipelines, Bash Scripting, Docker, Kubernetes
What we offer
You spend a lot of your time at work, so it should be challenging, fun and interesting. At DefinedCrowd, it will be all of those things and more. Here’s what we offer:
- A unique culture, healthy working environment, and a flexible working schedule
- Excellent career development opportunities in a high growth company
- Access to an excellent compensation and benefits package
- An international and diverse team, representing more than 30 nationalities at our 4 locations
- Global mobility and relocation support with the help of our specialized team
- Continuous training opportunities leveraging hand-on workshops and formal development opportunities
- The possibility to join our offices either in Lisbon or in Porto
Portugal
Catawiki
How we work As the biggest marketplace for special items, Catawiki operates in a domain that brings plenty of unusual ch...
Portugal
Catawiki
Key Responsibilities Design, Develop, and Maintain Automated Test Suites: Build and execute aut...
Portugal
Catawiki
What you will do Winning an object at Catawiki is an exciting moment, but the real excitement comes once the object has ...