software engineer

bigspark, a boutique consultancy with a focus on exciting technologies including Apache Spark, Apache Kafka and working on projects within Machine Learning, Data Engineering and Streaming are looking for software engineers to join the team with skills in either Java, Scala, Python.

We provide the backbone for modern analytics to our clients through our expertise in DevOps, distributed computing, machine learning and adoption of proven open source projects. bigspark specialise in backend development, infrastructure automation and performance engineering for data workloads at scale.

Typical duties:

• Interacting with senior stakeholders and program management to understand client requirements
• Solution Design - Using predefined architectural components to agree an acceptable design
• Lead the delivery of software development on client site, often managing team members across the globe with varying skill levels
• Warranty support post-delivery (normally 1-2 months)

Skills, experience and qualifications:

• Educated to at least BSc (Hons) level - preferably in Computer Science, Mathematics or Physics
• At least 2 years in a commercial software environment
• Big data stack experience - Hadoop, Spark, Hive/Impala, Kafka
• Proficiency in object-oriented programming languages (C#, Java, Python, Scala).
• Experience with database integrations (SQL/NoSQL) and processing data at scale
• Understanding of source control management e.g. GitHub
• Experience in use of CI tools (Jenkins) or an understanding of their role
• Flexible in learning and working with new technologies

For Streaming Engineers we would also expect:

• Deep knowledge of Apache Kafka
• Knowledge of Streamsets Data Collector, Transformer and Control Hub or equivalent tooling (e.g. Apache NiFi)

For Machine Learning Engineers we would also expect:

• Proficiency in Machine Learning Frameworks
• Spark ML including both batch and structured streaming
• Python ML e.g. scikitlearn, shap, lightGBM/XGBoost and underlying mathematical theories
• In return you will receive:
• Top end equipment - MacBook pro, 21 inch LED screen
• Certified training: 1) 2 mandatory certifications in the first 6 months and 2) Elective tracks of training thereafter in preferred topics
• Competitive salary and benefits
• Exposure to cutting edge technologies and open source projects

COVID-19 considerations:

Fully remote, anticipate time on client site when offices reopen

Sounds interesting? Click APPLY to send your CV for immediate consideration.

Candidates with previous experience and job titles including; .NET Developer, SQL Engineer, SQL Developer, Junior Software Engineer, Junior Developer, Senior Software Developer, Senior Software Engineer, C#, VB, ASP, Software Development, Software Engineering, sql, python, java, scala, kafka, hadoop, apache, Python Applications Developer, Python Developer, Software Engineering, Python Software Developer, Javascript, Applications Developer, Django Engineer, Python Engineer, Software Engineer, Senior Developer, Lead Developer may also be considered for this role.