Sr. Big Data Engineer (Python)

Tiger Analytics Chicago , IL 60290

Posted 1 week ago

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

You will be delivering data engineering solutions for multiple complex analytics or data science projects. You will create and stitch together structured and unstructured data from multiple sources and create data pipelines.

Job Duties

  • Ensure data quality, create new data pipelines, optimization and management of existing data pipelines,
  • Ingestion and curation of data sources for analytical purposes,
  • Transformations of structured and unstructured data into formats suitable for machine learning and advanced analytics
  • Work on deployment and making sure products are production-ready and function smoothly.

Requirements

  • 5+ years of experience in data engineering and data analytics
  • Strong data pipelining and ETL skills
  • Strong Python engineering skills and SQL skills
  • Ability to Clean, easy to maintain, modify and support code
  • Proficient in Python best practices, logging and strong debugging skills
  • Understanding of Python environments, package management
  • Strong basic SQL knowledge, able to read and understand SQL handed off
  • Able to do standard SQL joins, filtering, etc
  • Experience in distributed computing frameworks such as Spark
  • Able to work independently and ask for guidance when needed
  • Strong communication skills and delivery focused
  • Familiar with git source control
  • Understanding the pre-processing analytical methods is a plus
  • Bachelors degree in Computer Science or closely related field

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Engineer / Big Data

Management Decisions, Inc.

Posted 4 days ago

VIEW JOBS 4/18/2021 12:00:00 AM 2021-07-17T00:00 Innovative health-tech company is looking for a passionate engineer experienced in building data applications, API's, ETL's, etc. In this role you will build data centric applications and pipelines that ingest and transform their data in a form that can be utilized by their Data Science and Platform team. The ideal candidate will have strong experience with databases such as Hive, Presto, PostgreSQL, Redshift, or MySQL and with Big Data tools such as Spark, Kafka, Streaming, or Flink. Required Skills & Experience * Java, Scala, or Python programming * Able to build RESTful APIs and Microservices * AWS cloud * Big Data tools such as Spark, Kafka, Flink * ETL, Airflow preferred * Redshift, S3, PostgreSQL, MySQL, Hive * Real-time streaming * Ability to build pipelines Desired Skills & Experience * CI / CD pipelines with Jenkins * Terraform or CloudFormation * Docker, Kubernetes * Data Governance, Master Data, & Data Security * Experience in the healthcare industry What You Will Be Doing Tech Breakdown * 50% Backend * 50% Data The Offer * Competitive Salary: Up to $175K/year, DOE You will receive the following benefits: * Competitive Medical, Dental, and Vision insurance * 401(k) with match * Unlimited and encouraged PTO * Life & Disability insurance * Stocked Kitchen and Meals * Casual working environment Applicants must be currently authorized to work in the United States on a full-time basis now and in the future. This position does not offer sponsorship or C2C. Innovative health-tech company is looking for a passionate engineer experienced in building data applications, API's, ETL's, etc. In this role you will build data centric applications and pipelines that ingest and transform their data in a form that can be utilized by their Data Science and Platform team. The ideal candidate will have strong experience with databases such as Hive, Presto, PostgreSQL, Redshift, or MySQL and with Big Data tools such as Spark, Kafka, Streaming, or Flink. Required Skills & Experience * Java, Scala, or Python programming * Able to build RESTful APIs and Microservices * AWS cloud * Big Data tools such as Spark, Kafka, Flink * ETL, Airflow preferred * Redshift, S3, PostgreSQL, MySQL, Hive * Real-time streaming * Ability to build pipelines Desired Skills & Experience * CI / CD pipelines with Jenkins * Terraform or CloudFormation * Docker, Kubernetes * Data Governance, Master Data, & Data Security * Experience in the healthcare industry What You Will Be Doing Tech Breakdown * 50% Backend * 50% Data The Offer * Competitive Salary: Up to $175K/year, DOE You will receive the following benefits: * Competitive Medical, Dental, and Vision insurance * 401(k) with match * Unlimited and encouraged PTO * Life & Disability insurance * Stocked Kitchen and Meals * Casual working environment Applicants must be currently authorized to work in the United States on a full-time basis now and in the future. This position does not offer sponsorship or C2C. Management Decisions, Inc. Chicago IL

Sr. Big Data Engineer (Python)

Tiger Analytics