Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Sr Big Data Engineer Developer

Expired Job

Smart Caliber Technology Minneapolis , MN 55401

Posted 2 months ago

Senior Software Engineer (Big Data)

Generalist Big Data Engineer + Strong software engineer skills (multiple roles)

Knowledge of big data technologies
Traditional software development background Strong software engineer skills, must be able to write code, c#, java, scala.


Our tech stack is modern, in public cloud (AWS), microservices based large distributed system and is quality driven. We believe in the importance of continuously evaluating our tech stack, have an easy process of suggesting and adopting new technologies.
Our engineers enjoy being empowered and accountable. Set of technologies consist of:
Scala, Play, Akka,
MongoDB, PostgreSQL, ElasticSearch
AWS, Docker, Mesos, Marathon, Jenkins
Kafka, Spark, HDFS, Avro, Airflow and Redshift
Responsibilities
Architect, develop, and deploy infrastructure on which data gets collected, aggregated moved, cleansed, transformed and analyzed
Operationalize data insights from research into fault-tolerant, production-scale deployments
Apply grit and inventiveness, both in writing new software and also deploying existing tools like Airflow, Hadoop, Spark, Jenkins, Docker and Mesos
Partner with data scientists and product team to understand their needs and create a platform that empowers them
Work closely with Product and Project Managers to understand the features, do technical assessment, design, code test and deliver

Qualifications:
5+ years of prior experience for the Senior Software Engineer role, or
8+ years of prior experience for a Principal Software Engineer role
Bachelors or Masters degree in Computer Science or related fields
Strong coding skills and experience in shipping complex software to production
Command of Scala or Java, or interest in learning Scala
Experience with Hadoop, Kafka, Spark, Hive, PySpark, HDFS, AirFlow, Impala
Command of data structures, algorithms, performance and scalability
Understanding of fault-tolerant systems, network programming, multithreaded programming and security
Experience with distributed systems and application design in a SOA environment
Being analytical with an attention to detail
You are a motivated, self-driven engineer who owns your features

Preferred Qualifications:
Knowledge of high-scale performance and optimization tools and techniques
Experience with AWS (configuring, deploying, managing, monitoring) services and distributed applications

Skills:
C#, Java, Scala, AWS, MongoDB, PostgreSQL, ElasticSearch,Hadoop, Kafka, Spark, Hive, PySpark, HDFS, AirFlow, Impala
Contract
6-12 Months


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Sr Big Data Engineer

Target

Posted 4 weeks ago

VIEW JOBS 10/20/2018 12:00:00 AM 2019-01-18T00:00 Description: JOIN US AS A SENIOR BIG DATA ENGINEER Target's Data Science and Engineering team is a hyper-growing, dynamic and collaborative team building enterprise data products while utilizing the latest big data development tools/technologies. Data Engineers work closely with our Data Scientists to create valuable insights using voluminous data collected from internal and external systems. Business operations and initiatives are empowered with these insights to achieve Target's strategic goals while providing world-class shopping experiences! About this Opportunity As a Sr. Data Engineer, you will take the lead as you: Designing and Implementation * Ownership of all technical aspects of software development for assigned application * Utilize the data structure and algorithms to make the system more efficient * Support ongoing refactoring of code, utilize visualization and other techniques to fast-track concepts and deliver continuous improvement * Analyze, monitor and optimize for performance * Write code and unit tests, work on API specs, automation and testing * Produce and maintain high-quality technical documentation Scope of Work * Will gain new knowledge from upcoming research and applying it to design and development * Develop deep understanding of tie-ins with other systems/platforms within the supported domains * Share the gained knowledge with other team members through interactive sessions * Identify opportunities to adopt innovative technologies * Works with Technical Product Owners and Principal Data Engineers to prioritize features for ongoing sprints and managing the list of technical requirements based on new known issues * Provide continuous support for design, development and application availability Requirements: * 2+ years of experience in developing software applications including: analysis, design, coding, testing, deploying and supporting of applications * BS degree in Computer Science, Applied Mathematics, Physics, Statistics or area of study related to data sciences and data mining * Understand application/software development and design in an Agile environment * Inquisitive on Big Data technology; current on new ideas and tools * Good understanding of Data structures and Designing of Algorithms * Good understanding of basic mathematical concepts and ability to grasp complex mathematics * Proficient in at least one programming language - Java, Scala, Python, C/C++ * Collaborative personality, able to engage in interactive discussions with the rest of the team Preferred Qualifications: * Experience with Hadoop stack (Map Reduce, Kafka, Pig, Hive, HBase, Cassandra, YARN) and/or BDAS (Scala/Spark) * Experience working on projects facilitating true CI/CD (Jenkins, Drone, etc.) * Exposure to DevOps tools and culture (i.e. Kubernetes, Docker, Jenkins, Git, etc.) * Awareness of new and emerging Big Data technologies and trends Target Minneapolis MN

Sr Big Data Engineer Developer

Expired Job

Smart Caliber Technology