Data Engineer

About RiskIQ

With 75 percent of attacks originating outside the firewall, RiskIQ helps organizations protect businesses, customers, and brands across digital channels.

Today’s diverse cyber threats, from ransomware, phishing, and malware to rogue mobile apps, malvertising, and social impersonation, circumvent traditional security tools and place an enormous burden on information security organizations. RiskIQ addresses the questions: (1) how compliant and susceptible are my internet-facing assets and digital brand, (2) how do external exploits, attackers, and adversary infrastructure relate to internally discovered suspicious activity, security events, and incidents, (3) what and how are cyber threats attacking my business, (4) can I manage the risk and take down the threat, and (5) are entities abusing my brand and customers?

RiskIQ is the leader in digital threat management, providing the most comprehensive discovery, intelligence, and mitigation of threats associated with an organization’s digital presence. RiskIQ allows enterprises to gain unified insight and control over web, social, and mobile exposures. Our platform combines advanced internet data reconnaissance and analytics to expedite investigations, understand attack surfaces, assess risk, and take action against digital threats. With RiskIQ Community Edition, all security analysts gain FREE access to our solutions within a collaborate online environment to enable organized cyber defense.

Position

• Participate in architecting and building scalable applications using elements of Hadoop ecosystem
• Determining feasibility and rapidly developing proof of concept code based on ideas that are produced from the Data Science team
• Partnering with our Engineering team to implement successful products into the RiskIQ platform
• Work with our DevOps team to scale our data infrastructure
• Creating new ways to extract interesting insights from existing research analysis
• Analyzing, designing, developing, and testing of your projects to meet deadlines and exacting standards

Your qualification

• BS or higher in Applied Math, Statistics, Computer Science, Physics, or related field
• Senior Developer with 6 years overall experience in Java technologies and Big Data
• Proven ability to build large, reliable, scalable infrastructure
• 4+ years of advanced, hands-on experience with the Hadoop eco-system:

1. ​​​MapReduce
2. Hive
3. MapR
4. HDFS
5. HBase
6. Spark

• Strong SQL experience to analyze, transform, and integrate high volume, complex data sources
• Extensive knowledge of Data Infrastructure at both the physical and the logical level
• Excellent communication skills with the ability to identify and communicate data driven insights and technical approach through conversation, documentation, and presentation
• Proficiency with the following:

1. Job orchestration systems (e.g. Oozie, Luigi, Airflow)
2. Advanced file formats (e.g. Parquet, Avro, ORC)
3. Stream processing systems (e.g. Spark, Storm, Flink)
4. Search engines (e.g. ElasticSearch, Solr, Lucene)

Will be a plus

• Kafka
• Cassandra
• Redis
• Machine learning experience
• Amazon Web Services or other cloud-based providers/solutions

What we offer

• Fascinating work - Welcome to the dark underbelly of the Internet. We detect, expose, and investigate malware, exploit kits, botnets, affiliate fraud, advertising fraud, and illicit mobile apps, and much more. It is the golden age of internet crime, and we are at the forefront of defensive efforts to stem the tide. Internet security is a global growth industry, and the knowledge you acquire here will be a marketable skill for decades to come
• We’re a company on the forefront of a burgeoning industry - We've recently celebrated several new milestones headlined by 80% year-over-year growth revenue growth, the closing of $30.5 million in Series C funding, and recognition by Forrester in its Forrester Wave™: Digital Risk Monitoring, Q3 2016 report, which named RiskIQ a leader
• Top Leadership - Our CEO is a renown cybersecurity veteran known for his expertise. Our leadership group is poised and experienced with a track record in technology and cyber security
• Unbounded opportunity - We are small, but we’re growing. At RiskIQ, you’ll be provided with as much responsibility as you can handle—new career development opportunities constantly arise given our rate of growth Want to design a new data center from the ground up? Architect a big data backend to increase our storage and analysis capabilities? These challenges are yours for the taking if you prove you're capable
• Flexibility - You’ll have a large workload, but also the freedom to accomplish it on your own terms. RiskIQ has unlimited PTO and flexible hours

Additional details

Our Data Science team is at the core of advancing our technologies that will compose our next generation of internet and mobile security products. A successful candidate will be a highly motivated team member with a passion for solving the challenging problems our business faces. As a Hadoop Engineer, you will design, build, and scale our Hadoop ecosystem, which empowers our Data Science team to deliver game-changing intelligence from both existing and new/novel data sources. Relocation is available for the right candidate.