Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Sr Big Data Engineer Developer

Expired Job

Smart Caliber Technology Minneapolis , MN 55401

Posted 4 months ago

Senior Software Engineer (Big Data)

Generalist Big Data Engineer + Strong software engineer skills (multiple roles)

Knowledge of big data technologies
Traditional software development background Strong software engineer skills, must be able to write code, c#, java, scala.


Our tech stack is modern, in public cloud (AWS), microservices based large distributed system and is quality driven. We believe in the importance of continuously evaluating our tech stack, have an easy process of suggesting and adopting new technologies.
Our engineers enjoy being empowered and accountable. Set of technologies consist of:
Scala, Play, Akka,
MongoDB, PostgreSQL, ElasticSearch
AWS, Docker, Mesos, Marathon, Jenkins
Kafka, Spark, HDFS, Avro, Airflow and Redshift
Responsibilities
Architect, develop, and deploy infrastructure on which data gets collected, aggregated moved, cleansed, transformed and analyzed
Operationalize data insights from research into fault-tolerant, production-scale deployments
Apply grit and inventiveness, both in writing new software and also deploying existing tools like Airflow, Hadoop, Spark, Jenkins, Docker and Mesos
Partner with data scientists and product team to understand their needs and create a platform that empowers them
Work closely with Product and Project Managers to understand the features, do technical assessment, design, code test and deliver

Qualifications:
5+ years of prior experience for the Senior Software Engineer role, or
8+ years of prior experience for a Principal Software Engineer role
Bachelors or Masters degree in Computer Science or related fields
Strong coding skills and experience in shipping complex software to production
Command of Scala or Java, or interest in learning Scala
Experience with Hadoop, Kafka, Spark, Hive, PySpark, HDFS, AirFlow, Impala
Command of data structures, algorithms, performance and scalability
Understanding of fault-tolerant systems, network programming, multithreaded programming and security
Experience with distributed systems and application design in a SOA environment
Being analytical with an attention to detail
You are a motivated, self-driven engineer who owns your features

Preferred Qualifications:
Knowledge of high-scale performance and optimization tools and techniques
Experience with AWS (configuring, deploying, managing, monitoring) services and distributed applications

Skills:
C#, Java, Scala, AWS, MongoDB, PostgreSQL, ElasticSearch,Hadoop, Kafka, Spark, Hive, PySpark, HDFS, AirFlow, Impala
Contract
6-12 Months


upload resume icon
See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Lead Platform Engineer Big Data Engineering

Target

Posted 1 week ago

VIEW JOBS 1/8/2019 12:00:00 AM 2019-04-08T00:00 Description: JOIN US AS A LEAD DATA ENGINEER – BIG DATAPLATFORM About This Opportunity Target'sBig Data Platform team is looking for experienced, passionate and talented LeadData Engineer to innovate in the rapidly growing area and integrate the latestin Big Data open source technology into a massively scaled distributedenvironment. TheLead Data Engineer is responsible for the development of high performance,distributed computing tasks using open source Big Data technologies like Spark,Kafka, Storm and other distributed environment technologies based on the needsof the challenge.You'll also be responsiblefor architecting, designing, programing, debugging and modifying softwareenhancements as well as building new products used in large-scale analyticssolutions. Useyour skills, experience and talents to be a part of groundbreaking thinking andvisionary goals. As a Lead Data Engineer, you'll take the lead as you: * Manage in the definition of software architecture to ensure that the online organization's software solutions are built within a consistent framework * Lead the decision-making process related to the selection of software architecture solutions * Design and develop architectures to handle web-scale data and its organization * Provide consultation and lead implementation of ideas on complex programs * Review approves specifications to ensure consistency in approach and use * Serve as a technical and business-savvy resource to software engineering personnel on a range of software design challenges Requirements * MS degree in Computer Science, Math, Stats or relevant work experience in this space * 5+ years of experience in developing software applications at scale including architecture, design, coding/programming, testing, deploying and supporting of applications * Experience building large-scale analytics solutions using Big Data ecosystem (Spark, Storm, ELK, Kafka, Storm, etc.) * Extensive experience with DevOps and Automation technology (Git, Chef, Jenkins, Drone, Vagrant, Docker, Kubernetes, Artifactory, etc.) * Proficiency in Linux/network administration (network, storage, file system questions) * Collaborative personality and constant learner who stays current on leading edge Big Data engineering and Hadoop admin/engineer practices Target Minneapolis MN

Sr Big Data Engineer Developer

Expired Job

Smart Caliber Technology