View Our Website View All Jobs

Senior Big Data Engineer

Product Madness, part of Aristocrat Leisure, is a leading social and mobile gaming company with a focus on social casino games. We have published hit titles on Facebook, iOS and Android platforms and have grown considerably in size over the past year. With offices in London, Austin, Las Vegas and San Francisco

Job Description
We are looking for a Big Data Engineer with minimum 2 years of work experience that will work on collecting, storing, processing, and analysing of huge sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. 

The team are currently using AWS ecosystem; RedShift, EC2, S3 and Elasticbeanstalk, PySpark, SQL, Python, Airflow and are looking start incorporating more including Spark. This is a great opportunity to join a team whilst learning in a collaborative environment.

Responsibilities
Selecting and integrating any Big Data tools and frameworks required to provide requested
capabilities.
Implementing ETL process.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention policies.
Enhancing & improving the quality of the companies Data Lake. 

Skills and Qualifications

Proficient understanding of distributed computing principles.
Management of RedShift cluster, with all included services.
Knowledge of AWS Ecosystem EC2, S3 and Elasticbeanstalk.
Ability to solve any ongoing issues with operating the cluster.
Proficiency with Spark, SQL, Python.
Experience with building stream-processing systems, using solutions such as Spark-Streaming.
Experience with Spark {{if you are including or planning to include it.
Experience with integration of data from multiple data sources (replicating MySQL tools; xplenty,
Aloma, Stitch)
Knowledge of various ETL techniques and frameworks (Airflow)

 

Benefits

Up to 5% employer pension contribution with Aviva
Private Health insurance with Vitality
Full dental insurance
Life Insurance
Long term disability insurance
25 days holiday
Bonus scheme
Childcare vouchers
Eyecare vouchers
Events throughout the year
Free coffee shop/free food throughout the week
Inter office travel

Read More

Apply for this position

Required*
Apply with Indeed
Attach resume as .pdf, .doc, or .docx (limit 2MB) or Paste resume

Paste your resume here or Attach resume file

150