We are seeking a Director of Data Engineering to design, develop and scale our big data platform that is vital to the core of our business. You will be a part of the team responsible for developing and refining tools that enable us to leverage data effectively for both internal and external reporting, advanced analysis and applications, enabling a data driven decision making culture. The ideal candidate has a passion for big data and quality to join us as we revolutionize the way consumers and enterprises store data in the cloud. What You'll Do: · Responsible for design, develop and implement our big data platform including big data infrastructure, data warehouse, data processing pipelines and system integrations· Data modeling and metadata management· Streaming data processing and analysis· Pay meticulous attention to end-to-end data quality, validation and consistency· Ensure scalable, highly available and robust big data platform architecture to meet service level agreements· End-to-end data processing trouble shooting and problem diagnosis· Performance benchmark, load testing and code reviews· Across team collaborations and effective communications What You'll Need:· 10+ years of software development experience on large scale distributed systems· Expertise with SQL scripting, data warehousing, business intelligence and ETL development· Familiarity with Hadoop open source stack including YARN, Kafka, Hive, Pig, Sqoop and RDBMS such as MySQL· Hands on experience with AWS EMR, Dynamo, RDS, Redshift, cloud storage such as S3, Glacier, EBS, etc.· Expert level proficiency in Programming languages like Python, Perl, Ruby, Scala, etc.· Experience building large-scale distributed applications and services· Experience with other cloud storage provider platform such as Google Cloud Engine, Azure bonus points.· Excellent written/oral communication skills· Proficiency in statistical analysis and data mining techniques a plus· BS/MS - Computer or relevant engineering discipline strongly desired
Important Safety Tips: You should find out as much as you can about the company. Meet your prospective employers/employees face to face. You should NOT have to provide your bank account details. Stay safe - read our safety tips.