Senior Data Engineer

Cox Automotive is currently looking for an expert programmer who loves data and wants to build big data solutions on our Media Analytics team in Atlanta, GA. Do you have experience transforming and moving data in an enterprise environment in AWS or another cloud environment? Do you want challenging work that that gives you the ability to design solutions and own what you build? If so, we want to talk to you. 

Description:
The Senior Data Engineer is responsible for processing structured and unstructured data, validating data quality, and developing and supporting data products. We are looking for someone with strong hands on experience in all layers of the full stack involving data! We especially need your experience with AWS Cloud technologies. The Data Engineer plays a significant role in Agile planning, providing advice and guidance, and monitoring emerging technologies. This is NOT a junior programmer position and requires extensive hands on coding and design experience. 

Technology We Use:

• AWS
• Jenkins, Terraform, and CloudFormation
• Hadoop
• Python, Java, Scala

Your Role:

• Design, code, test, correct and document programs and scripts using agreed standards and tools to achieve a well-engineered result 
• Derive an overall strategy of data management, within an established information architecture (including both structured and unstructured data), that supports the development and secure operation of existing and new information and digital services 
• Plan effective data storage, security, sharing and publishing within the organization 
• Gathers and processes raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks
• Ensures data quality and implements tools and frameworks for automating the identification of data quality issues
• Collaborate with internal and external data providers on data validation providing feedback and making customized changes to data feeds and data mappings
• Mentor and lead data engineers providing technical guidance and oversight
• Provides ongoing support, monitoring, and maintenance of deployed products 

Experience:

• 5 – 8 years of working experience working experience in AWS (or similar cloud environment) including storage, transformation, functions, architecture, frameworks, and security
• Enterprise level with at least one of these languages: Python, Java, or Scala 
• Experience with design, development, and implementation of highly scalable, high-volume software systems and components, client-facing web applications, and major Internet-oriented applications and systems in an agile environment
• Experience in a Dev Ops environment including: Jenkins, Terraform, and CloudFormation or similar technologies
• Working experience working with high volume heterogeneous data, preferably with distributed systems such as Hadoop
• BI tools, data quality tools, and experience with batch and real-time data processing frameworks
• Strong background with data modelling, data access, and data storage techniques 
• Experience with relational and NoSQL databases
• Experience with Red Shift, Athena, and MySQL especially desired
• Bachelor’s degree in Computer Science or related field or equivalent combination of industry related professional experience and education

What we Look For: 

• Strong hands on experience in all layers of the full stack involving data, Front end experience 
• AWS Cloud Technologies, Unix, SQL
• Cloud components including: EMR, Lambda, Glue, VPC Security groups, EC2, SNS, and S3
• Experience streaming datasets, Visualizations with Tableau, Informatica (moving and transforming data)
• Active participation in the engineering community, up to date knowledge on new data technologies and best practices