Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Fulltime Big Data/Hadoop Developer NC / TX / NJ

Expired Job

Nityo Infotech Corporation Charlotte , NC 28202

Posted 3 months ago

Please share me your resume @ OR EXT:: 2321

Position:: Technology Lead US Big Data
Location:: Charlotte, NC Pennington. NJ Plano, TX
Duration:: Fulltime
Qualification / Basic
Bachelors degree or foreign equivalent required. Will also consider one year of relevant work experience in lieu of every year of education.
Minimum of 5+ years of work experience in the Information Technology Field.
Minimum of 4+ years of hands on experience Big Data technologies.
Expertise in Hadoop ecosystem products such as HDFS, MapReduce, Hive, AVRO, Zookeeper
Expertise with Hadoop ecosystem and experience with Hive, Oozie, Flume, Impala and Sqoop.
Expertise in building distributed systems, query processing, database internals or analytic systems Expertise with data schema - logical and physical data modeling
Experience with Spark, Scala, HBase, Java (MapReduce), Python development
Experience in full software development lifecycle of the Data Warehousing Project.
Experience in loading data into HDFS from heterogeneous databases DB2, Oracle, and SQL server using Apache Sqoop.
Experience in analysis of data using Hive and Impala and managing, navigating data and tables using Hue.
Work with Oozie, Flume, Sqoop, Spark, and Solr for data loading and analytics
Experience in exploring the data lake using big data tools for fraud & risk detection, sentiment analysis, etc. using Spark libraries
Experience with data mining techniques and analytics functions Predictive analytics experience is a PLUS
Efficient in Writing SQLs with complex joins,aggregations, UNIX Scripts
Good understanding of Data Warehouse modeling concepts.
Must be able to provide Solutions or Enhancements to fix the issues quickly when reported by the clients or users.
Flexibility to Self learn and understand the system, further assist with query tuning and application performance

("Big data" OR "Big-Data" OR "Bigdata" OR Hadoop) AND Spark AND Scala AND Hive AND Develop

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data Engineer For Unstructured Data


Posted 5 days ago

VIEW JOBS 12/13/2018 12:00:00 AM 2019-03-13T00:00 Where good people build rewarding careers. Think that working in the insurance field can't be exciting, rewarding and challenging? Think again. You'll help us reinvent protection and retirement to improve customers' lives. We'll help you make an impact with our training and mentoring offerings. Here, you'll have the opportunity to expand and apply your skills in ways you never thought possible. And you'll have fun doing it. Join a company of individuals with hopes, plans and passions, all using and developing our talents for good, at work and in life. Description The data and analytics strategy at Allstate continues to rapidly evolve, with an increasing focus on unstructured data. As we move to create a deeper connection with the "connected consumer," unstructured data derived from devices, vehicles, wearables and systems will be essential to enabling an integrated digital enterprise. We welcome you to join our Unstructured Data Strategy team to capitalize on the opportunities of new and nontraditional forms of data. The Big Data Engineer job family is accountable for DevOps engineering of data solutions which includes designing and building systems for Unstructured data storage and analytics that enable better decisions to achieve Allstate's goals. The Individual must demonstrate sufficient adaptability to quickly develop new skills across these disciplines as those disciplines evolve as well as assist in the selection and development of other team members. Job Summary This role is responsible for a DevOps approach to development of new systems for analyzing/processing/enriching Unstructured content; the coding & development of advanced analytics solutions to make/optimize business decisions and processes; integrating new tools to improve analytics; and address new technical challenges using existing and emerging technology solutions. Responsibilities Key Responsibilities * Design and implement a centralized Unstructured data management ecosystem to collect, analyze, store, protect and govern Unstructured data for the enterprise. * Identify and utilize new and emerging technologies to define comprehensive, sustainable, extensible architecture to meet defined business needs, including cloud or on-premises solutions * Design and establish governance and data management frameworks for Unstructured data. * Provide recommendations on implementation of organization wide processes and procedures for the management of data risk especially if the solution is based on a public cloud services. * Coordinate with Network and Infrastructure teams to design systems that can scale to the operational needs of handling large volumes of Unstructured data * Define strategies to Investigate, evaluate, interpret and classify Unstructured data in order to define and clarify information structures which describe the relationships between the Unstructured content and its associated metadata. * Evaluate technologies & implement solutions that enable the capture, publication and governance of business and system metadata, including lineage and traceability * Partners with other internal teams and peers in the department to ensure holistic Big Data solutions meet the needs of various stakeholders. * Executes on initiatives to improve the accuracy, security, quality, completeness, speed of data, and decisions made from Big Data analysis. * Leverages and uses Big Data best practices to develop technical solutions used for handling of Unstructured data. * Supports Innovation; regularly provides new ideas to help people, process, and technology that interact with data ecosystem. * Develop and builds frameworks/prototypes that integrate Unstructured data and advanced analytics to make better business decisions. * Supports a clear communication strategy that keeps all relevant stakeholders informed and provides an opportunity to influence the direction of the work * Trains and develops other engineers Knowledge/Skills/Abilities/Experience * 3 - 5 Years of experience as a Big Data Engineer. * Bachelor's Degree in Computer Science, MIS, or related area, or equivalent work experience. Master's Degree in a quantitative or scientific field would be a plus. * Experience in using software development to drive data & analytic efforts using Java/Scala as the programming language. * Experience with database technologies, metadata management & ETL frameworks * Experience with various data types (e.g. Unstructured, Hierarchical, Relational, Linked "Graph" Data) * Experience in developing, managing, and manipulating large, complex datasets * Understanding of security risks and vulnerabilities, leveraging tools and techniques to minimize risk. * Experience and solid understanding of Bigdata ecosystems such as Spark, Streaming, Kafka, Object stores Desirable: * Experience managing Unstructured data * Experience/Knowledge of NoSQL technologies * Experience/Knowledge of building applications using Public/Private cloud infrastructure * Ability to communicate and present advanced technical topics to general audiences. * Leading project teams of various skills levels from a Technical perspective * Automation, Configuration Management (e.g. Ansible, Puppet), Dev-ops practices, CI/CD frameworks (e.g. Jenkins). * Elementary networking skills, switching, routing, firewalls, load balancing. * Linux Containers / Docker / Kubernetes. NOTE: this position can be based out of Irving TX or Charlotte NC The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen. Good Work. Good Life. Good Hands®. As a Fortune 100 company and industry leader, we provide a competitive salary – but that's just the beginning. Our Total Rewards package also offers benefits like tuition assistance, medical and dental insurance, as well as a robust pension and 401(k). Plus, you'll have access to a wide variety of programs to help you balance your work and personal life -- including a generous paid time off policy. Learn more about life at Allstate. Connect with us on Twitter, Facebook, Instagram and LinkedIn or watch a video. Allstate Charlotte NC

Fulltime Big Data/Hadoop Developer NC / TX / NJ

Expired Job

Nityo Infotech Corporation