Data Platform Engineer DWH

About Exness

Exness is a multi-asset broker with an international team of approximately 1,800 people, a third of whom work in the Technology, Data and Security offices. Our goal in Exness is to develop exceptional products that will help experienced traders to trade various assets with better-than-market conditions.

Since our founding in 2008, we work with the firm belief that trading can - and should - be ethical. And so we developed proprietary algorithms and services to give our clients the most effective trading tools and conditions in the industry. Ambitious business goals balanced by genuine care for our customers and a healthy level of technical perfectionism define our model. And thanks to this approach, in 2022, our monthly trading volume reached $2.7 trillion, and the number of active users exceeded 320,000 people worldwide.

Our chosen path encourages employees to deepen their technical expertise, rely on scientific methods, and seek innovative solutions. We work on a modern stack without having to deal with excess legacy, and our architecture stands on k8s, PostgreSQL, Redis, Kafka, REST or gRPC as an alternative. We use the GitOps through Gitlab CI approach and cover everything with automated integration testing. Some of our teams' favorites are ClickHouse, MongoDB, React, and Flink.

Our clusters are automatically managed through the code and can handle thousands of events per second. We use Kafka to decentralize our service, and the main languages our tech team uses are Python and Go while in the Trading Core, we also use C++ and C#.

For the front-end, we use React, and most of the projects are TypeScript SPAs using technologies such as Web-sockets, Service Worker, PWA, Web-push, AB-testing, and Webpack Federation.

The people we’ve brought together come from many different countries with vast experience from leading IT companies. Although some of them work remotely, our main development office is located in Limassol, Cyprus. Any colleague who wants to relocate to Cyprus, whether alone or with family, will be provided with exceptional support, including a corporate MINI Countryman and financial allowance for private schools and kindergartens.

Our teams are constantly expanding and we’re always seeking the best talent to join us in providing the best possible trading experience to our clients. So check out the many exciting vacancies we have on our career website.

Position

We are looking for an experienced data engineer who will join our Technology department to be part of a team of more than 400 engineers that creates cutting-edge solutions and constantly raises the bar.

This department focuses on developing products in the trading market and creating solutions from the moment of registration of clients to the moment of withdrawal of funds. Our technologies include resolutions that support customer journeys (identity management, billing management), trading interfaces (FIX, REST, WS, Algo), back-office interfaces (Personal Area, Payment Solutions, Back Office), centers of expertise (QA, DevOps, security), technology platforms (Orchestration, internal PaaS/SaaS), and much more.

You will:

• Develop data platform services for data-driven decision-making, such as:
  • Developing and maintaining the data warehouse (Vertica) frameworks 
  • Implementing and operating a data lake (S3 MinIO + Spark)
  • Deploying and maintaining Spark on k8s
  • Maintaining and enriching an environment for the creation of the data assets such as (ETL/ELT pipelines, DDL, etc.) via the development of the data transformation tool (DBT)
  • Implementing and maintaining a data catalog, data lineage, and business glossary
• Participate actively in the development of the data platform environment, including:
  • Creating and monitoring compliance with data security policies, code policies, and naming conventions
  • Participating in data platform architecture development 
  • Recommending ways to improve data reliability, efficiency, and quality

Your qualification

• Strong knowledge of Spark architecture, deployment and maintaining Spark on Hadoop, k8s, or standalone experience
• Experience with Big Data processing and data lake building
• Experience with relational databases like Vertica, PostgreSQL, ClickHouse, and similar
• Experience building ETLs/ELTs to take data from various data sources
• Python skills associated with data engineering activities
• Expert structured query language (SQL) knowledge
• Understanding of the base principles CI/CD in the data processing area
• Other preferred skills:
  • Experience with data catalog frameworks implementation
  • Practical knowledge of Apache Spark on batch and real-time data processing
  • Awareness of building stream-processing systems using solutions such as Flink
  • Data warehouse modeling knowledge
  • MPP database experience

What we offer

• Competitive and attractive compensation
• Health and life insurance for employees, spouses, and children, including vaccinations, tests, and vision and dental coverage
• 21 days annual leave and paid sick leave plus paid Christmas to New Year’s break
• Extensive learning opportunities, including professional training and certifications, soft skills development, free English courses, and trading workshops
• Flight tickets, hotel or apartment accommodation for your first month, migration support, and legal help for you and your family (if relocating)
• Education allowance for your children’s school and kindergarten fees
• Access to our very own sports club with dedicated coaches, free Sanctum Club memberships for you and your spouse, corporate SUPs, jet skis, etc.
• A company car with a parking space near the office
• Fun and effective team-building experiences and Exness community gatherings