Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Big Data - Hadoop Consultant

Expired Job

Avance Consulting Hoboken , NJ 07030

Posted 3 months ago

Hello,
This is Jannu Rodda from Avance Consulting . We have requirement for below position. If you are available in the job Market Please Forward you're Updated Resume.
Role : Big Data Developer
Location : Hoboken, NJ,
Duration: 6+ Months

Description:
Candidate must possess 6-8 years experience working in Data Integration projects.
Should have core experience working in projects using Big Data technologies like Spark, Hive, Pig, HBASE
Should have experience building end-to-end data pipelines: from raw, unstructured data, to well curated data, to how to server data, and finally data consumption
Should have experience developing code in Python or Java
Should be familiar with data tools, such as Apache NiFi
Having knowledge on advanced analytics, including ML, with Python or R, PySpark or SparkR is a plus
Willing to learn new tools and technologies

Title : Hadoop / Bigdata Developer
Location: Hoboken, NJ, USA
Hire : Full-time

Hadoop Engineer(8-10 Years):

Candidate must possess 6-8 years experience working in Big Data/Data Integration projects.

Should have experience preferably in Hortonworks distribution of Hadoop.

Strong experience in Hadoop Administration and Unix/Linux shell scripting skills.

Should have core experience working in real time using Hadoop ecosystems like Sqoop, MapReduce, YARN, Hive, HBASE and related stack.

Should have experience in installation, configuration, Support and Management of Hadoop Clusters using Apache Hadoop and Hortonworks distribution.

Should have experience in scalable/distributed monitoring tools like Ganglia, Nagios etc.

Should have experience in Hadoop Security (Ranger and Knox gateway).


Should have knowledge in Installing and configuring Kerberos for the authentication of users, LDAP & AD integration and


Best Regards,
Jannu Rodda
Talent Acquisition Lead
Ext : 452

Skills:
Big Data/Data Integration,qoop, MapReduce, YARN, Hive, HBASE,Apache Hadoop,Installing and configuring Kerberos,,Apache Hadoop,Installing and configuring Kerberos,
Permanent
6+ Months


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data Engineer

Wal-Mart

Posted 2 days ago

VIEW JOBS 12/13/2018 12:00:00 AM 2019-03-13T00:00 The Data Platforms team at JET is looking for an exceptionally talented Data engineer with an outstanding track record reflecting achievements and skills in modernizing and improving the data infrastructure from the ground up. So, if you are passionate about working with very Large Data sets (structured/unstructured), building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges and building robust ETL pipelines then we would love to talk to you.Our engineers combine creativity, curiosity, and drive to continuously perfect and revolutionize Jet from the inside out. Our engineers combine creativity, curiosity, and drive to continuously perfect and revolutionize Jet from the inside out. The Environment The Data Platforms team at JET is looking for an exceptionally talented Data engineer with an outstanding track record reflecting achievements and skills in modernizing and improving the data infrastructure from the ground up. So, if you are passionate about working with very Large Data sets (structured/unstructured), building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges and building robust ETL pipelines then we would love to talk to you. What you will do: * Play a pivotal design and hands on implementation role in improving the Data infrastructure in a project-oriented work environment. * Influence cross functional architecture in sprint planning * Gather and process raw data at scale - collect data across all business domains (our functional-first, event sourced, micro services backend) and expose mechanisms for large scale parallel processing * Design, implement and manage a near real-time ingestion pipeline into a data warehouse and Hadoop data lake. * Process unstructured data into a form suitable for analysis and then empower state-of-the-art analysis for analysts, scientists, and APIs * Build efficient new Data Models and refactor existing ones. Partner with business to build right data models and analytics capabilities. * Solve complex SQL and Big Data Performance challenges. * Mitigate Risks in our data infrastructure by developing the best in class tools and processes. * Implement controls, policies, processes and best practices in the Data Engineering space. * Evangelize an extremely high standard of code quality, system reliability, and performance. * Help us improve our database deployment and change management process. * Provide reliable and efficient Data services as part of the database team. * Work closely with the devs on development best practices and standards. * Be a mentor. What you will have: * Degree in Computer Science, Information Technology, Math or related technical field. * Natural inclination for designing well thought out data solutions as well as solid hands-on implementation capability * 5+ years' experience in engineering data solutions using technologies including Spark (batch/streaming), Scala/Java (building data pipelines vs frameworks), Hadoop, Hive, HBase, Kafka, Spark, Oozie, Yarn. * Solid hands-on experience in building data pipelines, deploying and managing Big Data infrastructure, establishing deployment and operational excellence of Big Data clusters. * Experience in Relational databases, Data Warehousing, SQL, ETL and/or NOSQL databases will be sweet. * Proven experience in Building or improving large scale data infrastructure from the ground up. This could include building Data warehousing stores, Data Architecture, Data Integration, building highly performant data movement pipelines, building tools and automation to facilitate Data and operational governance, Data Lineage, Automation and Monitoring. * Proven Performance Tuning Accomplishments and Advanced tuning and trouble shooting skills in Large data environments on the Hadoop or RDBMS stack. * Advanced knowledge of internals of at least one RDBMS (MSSQL preferred) and best practices. * Data Ops experience including hands on skills in scripting language such as Python, Perl or Bash * Proven experience in trouble shooting, problem determination and rapid problem resolution * Experience and ability to work under high pressure in a complex technical environment. * About Jet Jet is reshaping ecommerce as we know it. Based in Hoboken NJ (just 10 min from Manhattan), we are a shopping site on the relentless pursuit to build the greatest shopping experience in the world. At Jet, we believe in bold. That means taking risks, asking "why not", looking where no ones looked before and bringing it! Our engineers are utilizing world class technologies, to optimize the supply chain, remove unnecessary costs, sprinkle in some surprise and delight all while saving customers every penny possible and we're just getting started. At Jet, we have worked hard to build a culture that stresses the importance of learning and sharing knowledge. If you want to be part of the team that is changing the shopping norm and learning a lot along the way, we have a hunch you'd look good in purple. See what we've been up to "A New & Improved Saving Experience" // by Jessica Anerella, Product Design at Jet.com All the benefits you need for you and your family * Multiple health plan options * Vision & dental plans for you & dependents * Associate discounts in-store and online * Financial benefits including 401(k), stock purchase plans and more * Education assistance for Associate and dependents Frequently asked questions * On average, how long does it take to fill out an application? On average, it takes 45-60 minutes to complete your application for the first time. Subsequent applications will take less time to apply as our system saves some of your application information. Please note that some positions require the completion of assessments in order to receive consideration for that role. Those would take additional time. * Can I change my application after submitting? No, you cannot change your application after submitting, so please make sure that everything is finalized before you hit the submit button. * How do you protect my personal information? Processing of information on paper is minimal, and Walmart processes application information using an applicant tracking system (ATS). Access to the data within the ATS is restricted to authorized personnel, and the system itself is held to high security standards by Walmart. * What are the recommended Internet Browsers for applying for open roles? * Internet Explorer 8.0+ * Firefox 4.0+ * Safari 4.0+ * Chrome 12+ See All FAQs Wal-Mart Hoboken NJ

Big Data - Hadoop Consultant

Expired Job

Avance Consulting