Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Data Engineer Lead/Architect

Expired Job

Kaizen Technologies Merrimack , NH 03054

Posted 1 month ago

Data Engineer Lead/Architect ( Hadoop )
Merrimack, NH
Long Term Contract

Role and Responsibilities

Design, build, and implement scalable streaming data pipelines and ETL frameworks to increase data access and decrease analysis and decision times across the organization

Own software throughout the entire development life-cycle design, code, test, automate & deploy

Share ideas to improve our product and processes, and provide feedback

Mandatory Skills
7+ years of experience in defining data architecture solutions and establishing common data capabilities for enterprises

Proven experience in creating actionable Data and Analytics strategies for Compliance, Risk, Financial Intelligence business functions

Experience in defining technology blueprints, roadmaps and collaboratively defining solutions and enabling architecture capabilities

Experience in tool selection, conducting rapid PoCs and recommending use case appropriate technologies
3+ years experience building distributed solutions in Spark, Map Reduce and other MPP system with associated data models and datastores (e.g., Redshift, Cassandra, HBase, Parquet)
2+ years of experience working with AWS Cloud data engineering stack including EC2, S3, EMR, Kinesis, Glue and other AWS Services

Hands-on experience with Apache Ni-Fi, Kafka, Python, Spark preferably on AWS

Experience with structured/unstructured/semi-structured data ingestion and processing

Experience with automation and deployment (Jenkins, Cloud Formation, Chef etc.)

Experience writing high quality code in Python and one another OOP language (Java, Scala, C++, Go, etc)

Experience working with RDBM systems, particularly familiarity with SQL

Solid Experience in optimizing the Hive queries using Partitioning and Bucketing techniques, which controls the data distribution, to enhance performance.

Experience in working with UNIX shell scripts.

Production development of event-based applications using frameworks such as Kinesis, Kafka, Spark Streaming, or similar

Familiarity with machine learning techniques, continuous deployment pipelines and tools.

Desire to work across internal teams to identify requirements and iterate on solutions

Debug complex production issues across various levels of the tech stack

Thanks & Regards,

James Smith Sr. Technical Recruiter
Kaizen Technologies Inc.
Direct: Ext : 1215
Email :

Skills:
Spark, MapReduce, AWS Cloud, Apache, Kafka, Python, Jenkins, RDBMS, UNIX
Permanent
Long Term Contract


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Lead OptoMechanical Engineer

Elbit Systems Of America

Posted 3 days ago

VIEW JOBS 11/16/2018 12:00:00 AM 2019-02-14T00:00 Overview Exciting opportunity for a Staff Opto-Mechanical Engineer to provide opto-mechanical technical leadership over diverse Electro-Optical (EO) product development projects to include various defense systems, airborne systems, and commercial avionics systems. This is an advanced level and/or lead position in which work assignments require the regular application of generally acknowledged expertise in electro-optics, opto-mechanics, electro-mechanical system integration and the use of considerable initiative and creativity. You will analyze and develop highly innovative solutions to unusually complex problems, and independently performs strategic tasks critical to the long term success of the engineering department. You will also lead substantial proposal and marketing initiatives, and perform research and development work to support long-term strategic objectives of ESA. Responsibilities Responsibilities include opto-mechanical system concept development, opto-mechanical system architecture, opto-mechanical system trade-off analysis, requirements definition and flow down, detailed opto-mechanical design, test and evaluation of opto-mechanical and EO performance parameters at both the component and system level. Successful candidate is expected to present a track record of the following essential functions: * Skilled in the use of solid modeling CAD tools specifically SolidWorks * Understanding of design dimensioning and tolerancing methods and conventions (e.g. true-position dimensioning, geometric tolerancing, etc.), assembly constraints, and kinematics * Fundamental modeling and analytical understanding of static and dynamic mechanical properties (e.g. stress, torque, natural frequency, damping, thermal expansion, etc.) * Thermal/ structural (static/ dynamic): use of analytical tools including FEA specifically ANSYS and CFDesign * Specification and design of electro-mechanical mechanisms and components * Knowledge of advanced electro-mechanical systems: servos, positioning systems, piezoelectric devices, position feedback devices * Line-of-sight analysis * Mechanisms for multi-field of view and zoom lenses * System light-weighting techniques/ materials/ trade off analyses * Passive athermalization techniques/ designs * Hermetic and Environmental Seal design * Electro-Optics System packaging & Integration * Knowledge of advanced materials: alloys, composites, ceramics, thermoplastics, epoxies * Knowledge of advanced manufacturing methods: EDM, rapid prototyping, casting and molding, laser cutting, brazing, etc * Skilled in the use of advanced metrology tools including CMM's, ESS chambers, LabView, shake tables, etc * Ability to generate required documentation including design reports, assembly procedures, bills-of-material, test procedures, etc. * Optical design tools desirable (Zemax preffered), but not essential * MS Office, including MS Project & Visio Qualifications Bachelor Degree in Mechanical Engineering (Master's preferred) or an equivalent scientific discipline with at least, and 12 or more years applicable progressively complex opto-mechanical engineering experience, to be proficient in the above areas. Incumbents should possess knowledge of advanced theories, concepts, principles, and processes for one or more areas of technical expertise, and possess creativity and originality sufficient to contribute new inventions, designs or techniques which are of material significance in the solution of important problems. Requires hands-on opto-mechanical design skills and broad capabilities in the area of mechanical engineering with specific theoretical and experienced-based knowledge of opto-mechanical system design for Electro Optics assemblies in addition to a firm foundation in mechanical engineering. Outstanding communication skills are also required to convey technical ideas to both the customer community and to engineering peers. Cost Account Management (CAM) and technical leadership skills are essential. Elbit Systems Of America Merrimack NH

Data Engineer Lead/Architect

Expired Job

Kaizen Technologies