Senior Big Data Engineer

Absolute Software San Jose , CA 95111

Posted 2 months ago

Absolute Software is looking for a Senior Big Data Engineer who will be responsible for designing, developing and building a robust data pipeline infrastructure required for optimal extraction, transformation, loading data from different data sources for our security analytics platform.

Also, you will have the opportunity to learn and apply cutting-edge AI technologies to solve real-world security issues in live enterprise environments. You will take ownership of large software components, help in the design of the architecture, apply your knowledge to functional design, utilize your programming skills for efficient and robust implementation, and guarantee the quality assurance in the whole software development cycle.

Responsibilities

  • Design, construct, test and maintain robust, reliable, and scalable data pipeline infrastructure

  • Ensure all systems meet the project requirements as well as industry practices

  • Investigate and integrate up-and-coming big data technologies into existing requirements

  • Recommend different ways to constantly improve data reliability and quality

  • Install/update system and component fault-tolerant procedures

  • Employ an array of technological tools to integrate with 3rd-party data systems

  • Research new uses for existing data

  • Develop set processes for data mining, data modeling, and data production

  • Collaborate with members of your team (e.g., data architects, data scientists, security researchers) on the project's goals

Qualifications

  • 5+ years of experience in design and implementation of robust and reliable big data infrastructure at scale, especially in supporting inline data ingestion, correlation, and aggregation of data from different data sources

  • Experience with designing real time and batch log analytics and search solutions using ELK stack

  • Experience with design, implementation, deployment and management of large Elasticsearch clusters and ELK solutions

  • Experience with performance tuning and optimization of Elasticsearch clusters

  • Experience with integration of Elasticsearch with Hadoop, RDBMS, Streaming technologies such as Kafka, Redis as well as and Data Science/Machine Learning frameworks at scale

  • Current hands-on experience with at least two coding and scripting languages e.g. Python, Java, Scala, Shell Scripting

Why Work For Us:

Absolute is the new standard for endpoint visibility and control, delivering self-healing endpoint security, always-connected IT asset management, and continuous data visibility-both on and off the network. Unlike other endpoint security agent solutions that can be corrupted, compromised or deleted, Absolute can self-heal itself and other critical applications through our patented Persistence technology that is embedded in the firmware of over 1 billion endpoints. No other security company can make this claim.

Headquartered in Vancouver, Canada with international offices in Austin, Texas, Reading, UK and Ho Chi Minh City, Vietnam, we are a collaborative and innovative place to make your mark in the world of security. Our agile, high energy culture rewards top performance and the contributions of those passionate about our collective growth and success. We celebrate our wins in our large common areas where we hold engineering hackathons, end of quarter celebrations, and monthly socials. We believe in a good work / life balance which is reflected in our annual employee retreat where it's all about friends and family. To learn more about Absolute, visit our website at www.absolute.com or visit our YouTube channel.

Absolute is an equal opportunity employer.


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data Engineer

Zoom

Posted 5 days ago

VIEW JOBS 5/20/2020 12:00:00 AM 2020-08-18T00:00 Zoom is an award-winning workplace. We have been recognized by Comparably as #1 CEO, Company Happiness, Benefits, Compensation, Diversity, and more! Not to mention we've been awarded by Glassdoor as the 2nd Best US workplace & Best Large Company US CEO in 2018, Wealthfront, and Business Insider. Our culture focuses on delivering happiness, our commitment to transparency, and the tangible benefits we provide our employees and our customers. Big Data Engineer Job Summary: We're looking for a Big Data Engineer who can find out the solution to support the requirement on service operation and product development. As a Big Data Engineer, you'll understand and manage our data, work with the engineering team and operation team to figure out the tough problem about service operation and product design. Job Responsibilities: * Gather and process raw data at scale. * Process unstructured data into structured data, manage schema of new data. * Manage data access to protect data in a safe way. * Read, extract, transform, stage and load data to selected tools and frameworks as required and requested. * Perform tasks such as writing scripts, write SQL queries, etc. * Work closely with the operation team to advise the solution about service scalability, healthy monitoring and refining optimization by data analysis. * Work closely with the engineering team to monitor product performance and track product quality trends. * Analyze processed data. * Monitoring data performance and modifying infrastructure as needed. * Define data retention policies. Job Requirements: * 3 + years of recent experience in data engineering. * Bachelor's Degree or more in Computer Science or a related field. * Experiences on Cloudear CDH platform,Spark programing,Impala SQL Lauguage, Analyze data via Hive, etc. * A solid track record of data management showing your flawless execution and attention to detail. * Strong knowledge of and experience with statistics. * Programming experience, ideally in Python, Java or Scala, and a willingness to learn new programming languages to meet goals and objectives. * Experience in C, Linux Shell, JavaScript or other programming languages is a plus. * Knowledge of ETL, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks. * Deep knowledge of data features engineering, data mining, machine learning, or information retrieval. * Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources. * Experience in production support and troubleshooting. * You find satisfaction in a job well done and thrive on solving head-scratching problems. * Language requirement: English, Mandarin is plus Work location: San Jose Zoom San Jose CA

Senior Big Data Engineer

Absolute Software