Senior Data Engineer

Risk Management Solutions Hayes Valley, CA , San Francisco, CA

Posted Yesterday

At Moodys, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are—with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways.

If you are excited about this opportunity but do not meet every single requirement, please apply You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship, lead with curiosity, champion diverse perspectives, turn inputs into actions, and uphold trust through integrity. In Digital Insights, we leverage rich content and workflow capabilities to comprehensively evaluate risk and support better decisions.

Our flagship platform CreditView incorporates credit ratings, research and Moody’s data. It is an essential tool that helps our clients in the professional services, commercial and financial industries to conduct fundamental credit analysis. Our diverse team is made up of marketing, technology, product strategy and customer experience experts.

Were in search of an exceptionally skilled and highly effective Senior Software Engineer to join our Digital Insights Data Engineering team. As a key member of a collaborative engineering unit, youll contribute to the architecture, development, and maintenance of our next-generation content delivery platform for moodys.com. Your role within the Digital Insights team involves supporting and working with multiple engineering teams, leading technology transformation, and propelling our journey towards highly available, scalable Cloud-native solutions.

This position plays a crucial role in the entire data engineering practice, encompassing analysis, requirement specification, design, development, testing, and implementation. The person for this role will be focused on delivering assigned tasks and/or specific tracks of the solution on time, escalating issues when appropriate, educating and leading others in the form of code reviews, workshops, and documentation. If youre ready to make an impact, join us The Work: • Design, develop, and maintain scalable data pipelines with Snowflake, Apache Airflow, dbt (SQL), and Python with AWS services. • Support and contribute to the continuous improvement, tuning, applications, infrastructure developments, process controls, and upgrades of the data platform • Provide guidance, hands-on development, and operational support for the deployment of database scripts and changes across multiple environments • Collaborate with Moodys technical teams and business owners as needed during the design and implementation • Manage individual time and tasks effectively. • Collaborate with cross-functional teams to understand data requirements and implement effective solutions.

The Requirements: • Bachelors degree or equivalent, Masters is a plus - or equivalent experience • 3 year of experience contributing to and providing technical leadership in a data engineering or software development team • Hands on experience in design and development of data integration/ETL data pipelines from various data sources and data formats • Knowledge of best practices for Airflow DAG management, scheduling, and monitoring. • Experience with implementing data quality checks, error handling, and retries in Airflow workflows. • Hands-on experience designing, developing, and maintaining data pipelines using Apache Airflow, including creating custom operators, sensors, and plugins. • Familiarity with Airflow Executors for task parallelism and resource management. • Experience within all phases of software development working across Agile teams, product owners and external stakeholders • Experience driving technical ideas and communicating clearly to both technical and non-technical audiences at all levels of the organization • Strong development, testing, debugging skills at all levels (unit, system, integration, and performance testing) along with detail-oriented documentation skills • Effective communication and problem-solving skills. • Strong database engineering skills with emphasis Postgres SQL, DynamoDB, Snowflake The Bonus Points: • Hands on experience implementing, managing, supporting, and developing with AWS database technologies, AWS RDS (Microsoft SQL Server, PostgreSQL) and AWS DynamoDB • Strong understanding of data quality best practices and data governance principles. • Strong understanding of object-oriented programming, design, and architectural patterns • Experience with development technologies: Git (Bitbucket or GitHub), Jira, Rally, Asana, Jenkins, Cypress, Postman • Experience with AWS cloud technologies: ECS/Fargate, ECR (EC2 Container Registry), Lambda, DynamoDB, Aurora PostgreSQL, API (Application Programming Interface) Gateway, VPC (Virtual Private Cloud), ALB, NLB, Neptune • Experience working with big data technologies:

Apache Airflow, Apache Spark, Apache Kafka, AWS Kinesis, AWS Redshift • Experience with development languages: Java (Spring Boot), Scala, PySpark


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer
New!

The Shipyard

Posted Today

VIEW JOBS 7/4/2024 12:00:00 AM 2024-10-02T00:00 The Shipyard is a leading, independent agency that builds performance-driven brands audiences can’t help but love. By applying modern mindsets to establishe The Shipyard San Diego CA

Senior Data Engineer

Risk Management Solutions