Senior MLOps

About ZEALS

Are you looking

• To make meaningful changes at the fastest-growing tech company in Japan?
• For a fair, highly flexible, inclusive working environment where anyone, regardless of their background, can make an impact?
• To build the next bold idea in customer acquisition and revenue growth through conversational commerce technology
• For a place where things are not just fast - but they happen now? 

We Are Zeals - “Designing conversations. Driving conversions.”

Zeals is not another chatbot. Our automated chat solution and conversational technology change how consumers purchase or act online. Zeals converts customers who appear "unengaged" to become "valuable" through designed chat on Messaging Apps. Using AI-powered, human-designed conversation flows across chat platforms, Zeals enables brands to build personalized, automated conversations with their consumers and develop a deeper understanding of their preferences while creating a delightful, seamless shopping experience. Our last 3 years have been phenomenal. We have captured the heart of many businesses in Japan, with over 480 enterprises relying on our chat commerce offering to boost their mobile business.

The goal is simple: to “revolutionize hospitality on the Internet” by unlocking digital customer service experiences that were limited to physical stores previously. 

Just Getting Started…

With more than 480 enterprise companies worldwide already utilizing our product, we are perfectly poised to seize market share and fuel exponential growth in the US market, with an eye on global expansion. Investors have taken note of our potential, leading us to recently secure nearly $40 million in funding, backed by Salesforce Ventures.

Position

Your Typical Day With Us

As a Senior MLOps Engineer, you will be at the forefront of deploying, optimizing, and monitoring LLMs in production environments. Your role will involve building and maintaining scalable pipelines, ensuring low-latency inference, and implementing best practices in monitoring and observability. You will also work with state-of-the-art tools like Hugging Face and MLFlow to fine-tune models and integrate them into robust AI solutions.

Key Responsibilities

Model Deployment & Management

• Develop and maintain scalable pipelines for deploying LLMs, focusing on efficient, low-latency inference.
• Utilize tools like Hugging Face and MLFlow for seamless model integration and version control.
• Automate deployment processes, including model validation and continuous integration.

Monitoring & Observability:

• Implement comprehensive monitoring frameworks to track performance and reliability of models in production.
• Use advanced observability tools to proactively detect and address performance issues.
• Deploy alerting systems to ensure rapid response to anomalies in model behavior.

Infrastructure Optimization:

• Architect and optimize cloud and on-premise infrastructure to support large-scale LLM operations.
• Collaborate with cloud providers like AWS, Azure, and GCP to optimize costs and performance.
• Work with backend engineers to ensure smooth integration of AI models into conversational platforms.

Collaboration & Documentation:

• Partner with AI engineers and data scientists to align on project objectives and deployment strategies.
• Document MLOps processes, best practices, and tools to maintain operational excellence.
• Provide training and support to team members on MLOps methodologies and tools.

Our Tech Stack

• Backend Languages: Go, Python, Elixir
• Frontend Languages: HTML, CSS, JavaScript (TypeScript, React.js, Recoil, Zod, Tanstack, etc)
• Mobile Languages: None
• Infrastructure: Google Cloud Platform, GCP Pub/Sub, Kubernetes, MongoDB, MySQL, Postgres, BigQuery, Elasticsearch, Qdrant
• Configuration management tool: Terraform
• CI/CD: Github Actions, ArgoCD, CircleCI
• Monitoring: Grafana, GCP Cloud Monitoring, GCP Logging, GCP Cloud Trace, Opsgenie
• Data: BigQuery, Parquet, Spark, Scala, Python, dbt
• Knowledge Tools: Confluence
• Other: GitHub / Slack / Jira
• Process: Scrum

Your qualification

Experience

• 5+ years of experience in MLOps, DevOps, or related fields, with a focus on deploying and managing LLMs or other large-scale machine learning models.
• Proven experience with tools like Hugging Face, MLFlow, and containerization technologies (Docker, Kubernetes).
• Strong experience with cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform).
• Hands-on experience in reducing inference latency and optimizing AI infrastructure.

Technical Skills:

• Proficiency in Python, with experience in ML libraries such as TensorFlow, PyTorch, and related frameworks.
• Expertise in CI/CD pipelines, version control (Git), and orchestration tools.
• Familiarity with Generative AI, prompt engineering, and deploying models at scale.

Soft Skills:

• Excellent problem-solving skills with the ability to tackle complex challenges independently.
• Strong communication skills, with the ability to translate technical concepts for non-technical stakeholders.
• A proactive mindset with a focus on continuous learning and staying updated with industry trends.

What we offer

• Salary Range : competitive
• Performance review: twice a year
• Holidays: 10 days paid holidays during the first year, weekends off, national holidays, summer and winter break and refreshment leaves.
• Visa support: We sponsor visas for the right candidates.
• Flexible working: Highly flexible, remote-first organization (in Japan), Interim work from overseas
• Housing allowance (within 1.5KM away from office)
• Club activity allowance
• Team building allowance and Lunch allowance
• Zeals Bar (bi-monthly free flow beer party)

Additional details

Don’t just take our word for it 

Zeals has received the LinkedIn Top Startups award twice in a row. We believe this is a testament to our growth and our ability to attract great talents–who could potentially be your colleague! 

Ready to roll up our sleeves

We're obsessed with bringing hospitality to everyone – whether it's our customers or you! You’re an individual with unique needs, and while we may not have ping-pong tables or all-you-can-drink espresso bars to offer, we promise you a once-in-a-lifetime experience and co-workers you’ll be proud to brag about to your friends, family, or anyone you meet the next time you go out! As an employer, we're ready to roll up our sleeves and change the status quo if it means making your experience better.