We are looking for an experienced Big Data Lead to start immediately. We provide consulting and IT services to clients globally. We deliver technology-driven business solutions that meet the strategic objectives of our clients. We develop, implement, maintain and support the IT applications by providing smart and intelligent solutions, high quality and low-cost service.
Collaborate with Data Analysts and Data Scientists, to ensure the quality, accuracy and availability of data meets their needs.
Strong focus on accuracy, validation, quality and timeliness of data
Building and managing data ingestions, integrations, calculations, pipelines, feeds that drive the company
Continually advance and improve their system of change management, peer-reviewed code and automated numbers testing capabilities
Big data lead in Pyspark.
Solution Architect level knowledge in Data Management
Ability to setup data pipelines to handle data in a wide variety of formats
Data Warehousing design and Datamodelling, ETL development and testing experience in Big Data technologies
Senior Big Data Analyst/Lead Big Data Analyst/Big Data Analyst
Extensive knowledge of SQL, Python, Pyspark
Strong background within data warehousing, ETL technologies and data quality
Commercial experience with PySpark experience building batch and streaming data pipelines