As the successful incumbent you will be responsible for developing, testing, and deploying information extraction, analysis, and management solutions. You will also be required to manage the day-to-day operations of a Spark environment from provisioning, maintenance, and monitoring
Requirements
- Relevant Tertiary Qualification
- 9 years experience in a technical role with an emphasis on data and algorithm development and implementation, server-side programming, database administration, web development and design
- Software development experience with a strong background in databases and data modelling.
- Experience designing and implementing high performance applications for cloud platforms such as AWS
- Knowledge of Databricks, MySQL and Python
- Knowledge of Spark, Apache Spark, Erlang, and Spark cluster
