Technology Engineer II - Information Research

Company Description

AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas - immunology, oncology, neuroscience, and eye care - and products and services in our Allergan Aesthetics portfolio. For more information about AbbVie, please visit us at www.abbvie.com. Follow @abbvie on Twitter, Facebook, Instagram, YouTube and LinkedIn.

Job Description

AbbVie Information Research is seeking a Data Engineer who would contribute to the architecture, design, and development of the Data & Analytics Platform supporting world-class research and development at AbbVie. As a Data Engineer, you will be a core member of a high-performance team of data engineers and architects focusing on driving technology innovation and continuous improvement. This role collaborates with solution architects, product owners, program managers, business analysts, infrastructure teams, and service providers to deliver the solutions.

In this role you will be responsible for:

• Design and deliver various data engineering activities to enhance the data platform, including data warehousing, master data management, data cataloging, system integration, data streaming, data visualization, data analysis, and data ops.

• Building required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS, Cloudera, Spark, python, Modak Nabu, and SQL technologies

• Work with R&D/life science-centric datasets and utilize this knowledge to develop TL(Standard Datasets) and ATL (asset-specific datasets).

• Maintain CI/CD Azure pipeline for production code deployment for Madak Nabu and Cloudera Public Cloud

• Monitor, maintain, and debug Datahub Clusters, Virtual Warehouses, and ML Workspaces.

• Develop the data processing engine framework using scala, Iceberg and Cloudera

• Ensure compliance with applicable AbbVie software development lifecycle policies and procedures.

Qualifications

Tools and skills you will use in this role:

• Cloudera Data Platform - Datahub Clusters, Virtual Warehouses, ML Workspaces

• Spark with scala and pyspark

• Airflow and Modak Nabu

• Oracle, Postgres, Hive, and Iceberg

Experiences that make you a strong fit for this role:

• Bachelors degree in relevant field and at least 5 years relevant experience OR Masters degree in relevant field and at least 4 years experience.

• Must have experience with metrics and logging analytics using Dynatrace and Splunk

• Must have experience with SQL, Pyspark, JavaScript,

• Must have experience with Postgres, Hive, and Iceberg

• Must have experience with Airflow and Modak Nabu

• Must have experience with Cloudera Public Cloud architecture and API-based design architecture.

• Experience working with Pharmaceutical R&D industry-centric datasets is preferred.

If you believe you're a great fit for this job but don't have all of the experiences listed above, we encourage you to