Sr. Data Engineer

Description:

The Sr Engineer role plans, designs, develops and tests high-quality, innovative and fully performing software systems or applications for software enhancements and new products. Key responsibilities include:

• Contribute to full software development life cycle

• Write maintainable, extensible, tested code, while complying with coding standards

• Produce specifications and determine operational feasibility

• Continuously Integrate and deliver software components into a fully functional software system

• Facilitate end to end user testing with customers

• Troubleshoot, debug and upgrade existing systems

CAREER LEVEL SUMMARY

• Proficiency: Fully mastered in immediate function/domain and has developed competent skills in complimentary functions or domains. Is able to train junior members in mastered domain knowledge.

• Direction: Is largely autonomous, working on a day to day basis without supervision or support. Occasionally checks in with manager for questions, direction. Provides support or direction to more junior members.

Skills:

• end to end testing
• troubleshoot
• data pipelines
• aws
• SQL
• NOSQL
• big data
• data architecture
• spark, emr, red shift, aws glue, athena, kinesis, firehose, lambda

Additional Skills & Qualifications:

• 8+ years of total development experience

• 5+ years of experience as a Data Engineer with large, complex data sources

• Experience designing, building and operationalizing large scale enterprise data solutions and applications using AWS data and analytics services in combination with other services/platforms - Spark, EMR, RedShift, Kinesis, Kinesis Firehose, Athena, Lambda & AWS Glue

• Experience with data pipeline and workflow management tools: Airflow, Step Functions etc

• Ability to implement both batch and streaming data pipelines in the AWS and change data capture (CDC) experience

• Advanced working SQL knowledge and experience working with relational databases and NOSQL databases.

• Experience designing and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Scala.

• Experience with infrastructure-as-code tools such as Terraform (preferably) or CloudFormation

• Kubernetes experience for developing, deploying, and orchestrating

• micro-services is plus

• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations

• Understanding of concepts regarding security, privacy, performance, etc

About Actalent

Actalent is a global leader in engineering and sciences services and talent solutions. We help visionary companies advance their engineering and science initiatives through access to specialized experts who drive scale, innovation and speed to market. With a network of almost 30,000 consultants and more than 4,500 clients across the U.S., Canada, Asia and Europe, Actalent serves many of the Fortune 500.

Diversity, Equity & Inclusion

At Actalent, diversity and inclusion are a bridge towards the equity and success of our people. DE&I are embedded into our culture through:

• Hiring diverse talent

• Maintaining an inclusive environment through persistent self-reflection

• Building a culture of care, engagement, and recognition with clear outcomes

• Ensuring growth opportunities for our people

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please email actalentaccommodation@actalentservices.com for other accommodation options.