Senior Data Engineer

Chariot Solutions Fort Washington , PA 19034

Posted 5 days ago

If youre interested in working with different technologies and passionate about solving a wide variety of problems and challenges, youll feel right at home at Chariot. Our customers bring us in to solve their most complex problems, guide their teams on new initiatives, and provide expert technology advice.

We are proud to be a 4 time winner of Philadelphia Top Workplaces!

Requirements

We are looking for data engineers who can:

  • Design, develop, debug, and optimize data pipelines that perform ELT (extract, load, transform) of various data sources (as well as ETL where appropriate)
  • Develop and deploy the required infrastructure for reliable pipeline execution, especially on cloud platforms, using IaC (infrastructure as code) tools
  • Design and develop data warehouses for large data sets to support business intelligence, understanding end-to-end data needs and modeling accordingly
  • Understand where data lakes fit, and how to take advantage of them
  • Investigate data quality issues and perform root cause analysis
  • Develop supporting utilities and tools

The ability to pick up and run with new technologies is vital. Here are ones we use (deep knowledge of some but not all required):

  • Python (or other high level languages)
  • SQL: Postgres, MySQL, Microsoft SQL Server, etc.
  • Data warehouses: AWS Redshift, Google BigQuery, Snowflake
  • NoSQL: Cassandra, AWS DynamoDB, ElasticSearch, etc
  • Experience with various file formats, like Parquet and Avro
  • Messaging and streaming: Kafka, AWS Kinesis, Apache Flink
  • ETL job orchestration, such as Airflow, Dagster, or Luigi
  • Big data parallel processing such as Spark and Hadoop
  • Terraform, AWS CloudFormation
  • Docker and Container Orchestration
  • Logging / monitoring (such as ELK, Splunk, CloudWatch, Prometheus, DataDog)

The ability to quickly understand business domains and manage changing priorities is critical. You like getting your hands dirty with data, and are passionate about turning raw, changing production data into something useful for business. You enjoy working directly with business teams and stakeholders, and are eager to be part of an area of growth for Chariot Solutions.

About Chariot Solutions

Chariot Solutions is a consulting firm specializing in software development, systems integration, mobile application development and training. The Chariot team includes many of the top software architects in the Philadelphia area, with deep technical expertise, industry knowledge and a genuine passion for software development.

Here are examples of the types of projects we work on.

Our consultants also love learning, writing, and speaking.

  • Chariots blog has a wide array of articles across languages, technologies, frameworks, etc.
  • We host conferences such as the Emerging Technologies for the Enterprise Conference (Philly ETE). See 2021 talks here.
  • We host the Chariot TechCast podcast where we interview tech luminaries and even host our own weekly DevChat shows.

Benefits

We are committed to the well-being of our employees. Here are some of our benefits

  • We take care of health, dental, and vision insurance, 100% paid for you and your family
  • Paid maternity, paternity and family leave
  • Attend 3 tech conferences annually: an all expenses paid tech conference of your choice, Philly ETE and Chariot Day (internal tech conference)
  • Opportunities to present at meetups, conferences and run workshops
  • A top of the line MacBook Pro or equivalent
  • Free lunch Fridays when youre in the office (post COVID)
  • Flexible Spending Account (FSA)
  • 401K retirement plan
  • Short and Long Term Disability
  • Subsidized gym membership
  • Company stock

Learn about our interview process.

Must be authorized to work in the U.S.

Chariot Solutions provides equal employment opportunities to all employees and applicants without regard to religion, creed, color, national origin, sex, pregnancy, sexual orientation, gender identity, age, ancestry, physical or mental disability, genetic information, marital status or any other classification protected by applicable local, state or federal laws.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

Chariot Solutions

Posted 3 months ago

VIEW JOBS 8/23/2021 12:00:00 AM 2021-11-21T00:00 <p>If you’re interested in working with different technologies and passionate about solving a wide variety of problems and challenges, you’ll feel right at home at Chariot. Our customers bring us in to solve their most complex problems, guide their teams on new initiatives, and provide expert technology advice.</p><p>We are proud to be a 4 time winner of Philadelphia Top Workplaces!</p><p><strong>Requirements</strong></p><p><strong>We are looking for data engineers who can:</strong></p> <ul> <li>Design, develop, debug, and optimize data pipelines that perform ELT (extract, load, transform) of various data sources (as well as ETL where appropriate)</li> <li>Develop and deploy the required infrastructure for reliable pipeline execution, especially on cloud platforms, using IaC (infrastructure as code) tools</li> <li>Design and develop data warehouses for large data sets to support business intelligence, understanding end-to-end data needs and modeling accordingly</li> <li>Understand where data lakes fit, and how to take advantage of them</li> <li>Investigate data quality issues and perform root cause analysis</li> <li>Develop supporting utilities and tools</li> </ul> <p>The ability to pick up and run with new technologies is vital. Here are ones we use (deep knowledge of some but not all required):</p> <ul> <li>Python (or other high level languages)</li> <li>SQL: Postgres, MySQL, Microsoft SQL Server, etc.</li> <li>Data warehouses: AWS Redshift, Google BigQuery, Snowflake</li> <li>NoSQL: Cassandra, AWS DynamoDB, ElasticSearch, etc</li> <li>Experience with various file formats, like Parquet and Avro</li> <li>Messaging and streaming: Kafka, AWS Kinesis, Apache Flink</li> <li>ETL job orchestration, such as Airflow, Dagster, or Luigi</li> <li>Big data parallel processing such as Spark and Hadoop</li> <li>Terraform, AWS CloudFormation</li> <li>Docker and Container Orchestration</li> <li>Logging / monitoring (such as ELK, Splunk, CloudWatch, Prometheus, DataDog)</li> </ul> <p>The ability to quickly understand business domains and manage changing priorities is critical. You like getting your hands dirty with data, and are passionate about turning raw, changing production data into something useful for business. You enjoy working directly with business teams and stakeholders, and are eager to be part of an area of growth for Chariot Solutions.</p> <p><strong>About Chariot Solutions</strong></p><p>Chariot Solutions is a consulting firm specializing in software development, systems integration, mobile application development and training. The Chariot team includes many of the top software architects in the Philadelphia area, with deep technical expertise, industry knowledge and a genuine passion for software development.</p><p>Here are <a href="https://chariotsolutions.com/case-studies/" rel="nofollow noreferrer noopener" class="external">examples</a> of the types of projects we work on. </p> <p>Our consultants also love learning, writing, and speaking.</p> <ul> <li> <a href="https://chariotsolutions.com/blog/" rel="nofollow noreferrer noopener" class="external">Chariot’s blog</a> has a wide array of articles across languages, technologies, frameworks, etc. </li> <li>We host conferences such as the Emerging Technologies for the Enterprise Conference (Philly ETE). See 2021 talks <a href="https://www.youtube.com/playlist?list=PL9oQ7yETvN10ATSn_Fh4yR-u7VbL340Rk" rel="nofollow noreferrer noopener" class="external">here</a>. </li> <li>We host the <a href="https://chariotsolutions.com/podcasts/show/techcast/" rel="nofollow noreferrer noopener" class="external">Chariot TechCast</a> podcast where we interview tech luminaries and even host our own weekly DevChat shows.</li> </ul><p><strong>Benefits</strong></p><p>We are committed to the well-being of our employees. Here are some of our <a href="https://chariotsolutions.com/careers/#benefits" target="_blank" rel="nofollow noreferrer noopener" class="external">benefits</a> </p><ul> <li>We take care of health, dental, and vision insurance, 100% paid for you and your family</li> <li>Paid maternity, paternity and family leave</li> <li>Attend 3 tech conferences annually: an all expenses paid tech conference of your choice, Philly ETE and Chariot Day (internal tech conference)</li> <li>Opportunities to present at meetups, conferences and run workshops</li> <li>A top of the line MacBook Pro or equivalent</li> <li>Free lunch Fridays when you’re in the office (post COVID)</li> <li>Flexible Spending Account (FSA)</li> <li>401K retirement plan</li> <li>Short and Long Term Disability</li> <li>Subsidized gym membership</li> <li>Company stock</li> </ul><p>Learn about our <a href="https://chariotsolutions.com/careers/interview-process/" rel="nofollow noreferrer noopener" class="external">interview process</a>.<br></p><p>Must be authorized to work in the U.S. </p><p>Chariot Solutions provides equal employment opportunities to all employees and applicants without regard to religion, creed, color, national origin, sex, pregnancy, sexual orientation, gender identity, age, ancestry, physical or mental disability, genetic information, marital status or any other classification protected by applicable local, state or federal laws. <br></p> Chariot Solutions Fort Washington PA

Senior Data Engineer

Chariot Solutions