Data Applications Engineer

Luxoft Newark , NJ 07101

Posted 6 months ago

Project Description

Data Applications Engineer

Engineer will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. We are looking for an experienced data analyst, data pipeline builder and data wrangler who enjoys analyzing data, building and optimizing data systems from the ground up.

Engineer will implement data initiatives and ensure optimal data acquisition, management and delivery architecture which is consistent throughout ongoing projects. Engineer should be self-directed and comfortable supporting data needs of multiple teams, systems and products.

Data Analysis, Hadoop ETL

Responsibilities

Data Applications Engineer

Engineer will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. We are looking for an experienced data analyst, data pipeline builder and data wrangler who enjoys analyzing data, building and optimizing data systems from the ground up.

Engineer will implement data initiatives and ensure optimal data acquisition, management and delivery architecture which is consistent throughout ongoing projects. Engineer should be self-directed and comfortable supporting data needs of multiple teams, systems and products.

Data Analysis, Hadoop ETL

Skills

Must Building and maintaining data-intensive applications utilizing modern front-end and back-end technologies to deliver value to our businesses

Creating and maintaining optimal data pipeline architecture assembling large, complex data sets that meet functional / non-functional business requirements.

Identifying, designing and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.

Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Relational, NoSQL and Hadoop technologies.

Building and maintain data services and data consumption tools that utilize the data pipeline to deliver actionable insights into key business performance metrics.

Creating data visualizations for analytics and assisting other team members with using our data products.

Working with partners including the Architecture, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Preparing and maintaining physical models and implementation-level details that affect the continuum of disciplines involved in the architecture, design, implementation and management of enterprise information.

Collaborating with other teams to design, develop data tools that support both operations and data application use cases.

Analyzing large data sets using components from the Hadoop ecosystem.

Evaluating big data technologies and prototype solutions to improve our data processing architecture.

Background:

Bachelor's degree in computer science, engineering, math, etc. or equivalent experience

Strong analytic skills related to working with structured and unstructured datasets

Experience building processes supporting data transformation, data structures, metadata, dependency and workload management.

Experience with big data technologies: Hadoop, Hive, Impala, Hbase, Spark, PIG, SQOOP, HDFS, Solr

Expert-level query language skills including SQL, HiveQL and experience working with Relational, NoSQL & Hadoop systems

Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

Experience with Denodo Data Virtualization Platform (nice to Have)

Working skills with back-end technologies: Node.js, Python, Java; front end technologies:

HTML, CSS, JavaScript; data visualization tools: Tableau, Power BI

Hands-on experience implementing MDM, BI or data warehouse solutions preferred

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and find opportunities for improvement.

Languages

  • English: Advanced/Fluent

WHERE



icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Sr Field Engineer Cloud Native Applications

Dell Inc

Posted 1 week ago

VIEW JOBS 10/5/2019 12:00:00 AM 2020-01-03T00:00 Job ID R1912298-3 Date posted Oct. 03, 2019 Senior Field Engineer - Cloud Native Applications Our Company VMware is the leader in cloud infrastructure, business mobility and virtualization software. A pioneer in the use of virtualization and automation technologies, VMware simplifies IT complexity across the entire data center to the virtual workplace, empowering customers with solutions in the software-defined data center to hybrid cloud computing and the mobile workspace. With 2018 revenues of $8.97 billion, VMware has more than 500,000 customers, 75,000 partners, and 23,000 employees in 120+ locations around the world. At the core of what we do are our employees who deeply value execution, passion, integrity, customers, and community. Want to be part of a compassionate community that thrives on architecting what's next in IT? Learn more at vmware.com/careers. Job Description: Senior Field Engineer – Cloud Native Applications At VMware we believe that Kubernetes, and by extension Cloud Native, will transform the next generation of enterprise infrastructure and applications the way Virtualization and Java have in the past. Customers will look to containers to avoid lock in with public clouds and the industry has aligned around Kubernetes as the orchestration engine for these containers. VMware is investing in building a modern stack that focuses on this next generation of enterprise computing incorporating both traditional workloads and cloud applications with our core platform. For these reasons, we believe no one is better positioned than VMware to win in the multi-cloud era. To that end, VMware is investing in a new strategic function to activate recent investments in container orchestration, cloud workload mobility and cloud native application development. This team will be responsible for realizing our strategic direction and accelerating customer adoption of emerging technologies and our cloud native platforms. This function will be the link between engineering and professional services and will serve as a center of gravity for an ecosystem of customers, developers and partners focused on driving the VMware technology agenda. Senior Field Engineers are responsible for: * Delighting our customers by ensuring successful outcomes to their projects. * Hands on deployment and optimization of complex architectures, and advancing customer thinking and awareness within the Cloud Native space * The ideal candidate is action-oriented, collaborative, a continuous learner, has strong customer presence and must have a desire to contribute to VMware's intent to capture modern application workloads. Principal Duties and Responsibilities: * Execute on customer engagements both as a member of a team for complex engagements and solo for simpler engagements * Install and optimizing Kubernetes clusters and dependencies * Write reference programs, perform research on new technologies and architectures * Supports a written culture and contributes to our technical content library * Gives and takes guidance to/from customers, teammates and leadership where needed For more information on this search please contact: VMware Position Profile * Drives high quality output of both self and team for customers and internal initiatives * Helps with pre-sales, conferences and general Kubernetes evangelism as time permits * Fosters a sense of collaboration through activity and presence * Reports and manages time with minimal oversight * Works effectively with a remote and distributed team * Can help set and execute on technical vision * Assists all team members when they are stuck, and helps others level up their skills by providing kind and direct feedback Desired Skills: * Domain expertise in infrastructure or programming concepts * Robust proficiency in Linux & CLI, several years of experience in infrastructure * Ideal candidates will have familiarity with programming concepts and general SDLC practices * Knowledge of tools required to drive solution relevance and scale. * Familiarity with application developer challenges, interests and deployment patterns for Cloud Native * Hands on experience with distributed systems and concepts in a real-world environment * Some specific technical competencies desired: o Kubernetes, OpenShift, Docker & Cloud Native Application development platforms. o Linux - As the de facto base operating system for all public cloud providers and Cloud Native technologies effective skills working with Linux on the CLI are required. o Networking & Security - Some of the more complex scenarios which occur with Cloud Native projects and technologies involve both east / west and ingress /egress networking and security considerations. As such we highly value expertise and experience in these areas. o Reliability Engineering - A drive towards constant iteration and improvement of technologies and processes is a fundamental part of being successful with Cloud Native projects and technologies. o Go & Programming - Some of our projects require building and extending tooling and projects. GO is preferred, but any modern language is acceptable as a starting point. * Hands on experience with open source and commercial container tooling including Docker, Mesosphere, Red Hat OpenShift Container Platform and Rancher Other Requirements * Bachelor's degree in relevant field or alternative education such as bootcamp graduate or relevant professional experience * 7+ years of experience in a technical presales, support, or consulting role * Knowledge of and operational experience with methodologies related to agile and DevOps * Ability to travel up to 50% of the time * Locations: Remote, Seattle, Atlanta, San Francisco, Austin, New York City, Chicago, Washington DC, Los Angeles This job opportunity is not eligible for employment-based immigration sponsorship by VMware. Apply now Apply now Dell Inc Newark NJ

Data Applications Engineer

Luxoft