Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Sr Big Data Engineer

Expired Job

Bayone Solutions San Francisco , CA 94107

Posted 2 months ago

As developer within the Big Data team you will contribute to high quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications. The ability to communicate effectively is required as you will work closely with other groups, including development and testing efforts of your assigned application components to ensure the successful delivery of the project.

Experience with middle-tier/backend systems development in Java/Linux
Minimum 3-5 years working experience with Hadoop in an enterprise setting
Experience with Java enterprise development, Python and Scalar
Hands-on expertise with Sql & NoSql data platforms
Hands-on expertise with Big data technologies (HBase, Hive, Sqoop)
Experience with Pub/Sub messaging (JMS, Kafka, etc.), stream processing (Storm, Spark Streaming, etc.)
Understanding and application of security best practices as they relate to big data technologies
Experience with horizontally scalable and highly available system design and implementation, with focus on performance and resiliency
Experience profiling, debugging, and performance tuning complex distributed systems
Experience with UNIX shell scripts and commands
Experience with data modeling
Ability to clearly document solution designs
Agile/Scrum methodology experience
Experience with ETL/ELT tools
Experience with BI solutions (Tableau, Microstrategy, D3 etc) Complexity Works on complex issues where analysis of situations and data requires an in-depth evaluation of variable factors.
Exercises judgment in selecting methods, techniques and evaluation criteria for obtaining results.
Supervision Acts independently to determine methods and procedures on new assignments, and may provide work direction to others.
Works under minimal supervision.
Minimum Education/Training/Certification Bachelor's degree in an information technology area of study.
Master's degree preferred specializing in Computer Science, Information Management, Data Science or equivalent combination of education and experience.


  • Hands on development role focused on creating big data and analytics solutions

  • Coding of mission critical components

  • Analyze business and functional requirements and contribute to overall solution

  • Participate in design reviews, provide input to the design recommendations

  • Participate in project planning sessions with project managers, business analysts and team members

  • Hands-on expertise with Graph databases.

Thanks & Regards,
Himanshu Purohit BayOne Solutions Inc.
4637 Chabot Dr. Suite 250 Pleasanton CA 94588
Direct :
Email: Web:

Hadoop, Hive, Spark, elasticsearch, Kibana

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Big Data Engineer

Williams-Sonoma, Inc.

Posted 1 week ago

VIEW JOBS 11/8/2018 12:00:00 AM 2019-02-06T00:00 Requisition Number: SS-14559 Area of Interest: Information Technology Organization: Corporate Brand/Division: Shared Services Position Type: Full-time JOB DESCRIPTION Location: San Francisco, CA The Williams-Sonoma Architecture and Platform organization is looking for you, an engaged and experienced Senior Big Data Engineer to build analytics and ML platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services. The platform will also enable machine/deep learning infrastructure that operationalizes data science models for broad consumption. As a Senior Software Engineer in the Big data Analytics organization, you'll join a small team focused on the delivery of the platform and actionable insights which moves the needle. KEY JOB FUNCTIONS * Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice * Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production * We develop real products. You need to be an expert in design, coding, and scripting * Facilitate problem diagnosis and resolution in technical and functional areas * Encourage change, especially in support of data engineering best practices and developer satisfaction * Write high-quality code that is consistent with our standards, creating new standards as necessary * Demonstrate correctness with pragmatic automated tests * Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices * Develop strong working relationships with others across levels and functions * Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest * Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain * Serve as a member of an agile engineering team and participate in the team's workflow REQUIREMENTS AND QUALIFICATIONS REQUIREMENTS AND QUALIFICATIONS * 5- 8 years of experience as a professional software engineer * 3-5 years of experience with big data technologies * Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time * Strong knowledge of programming languages/tools including Java, Scala, Python, Akka, Spark, SQL, Hive, and Elasticsearch * Experience with streaming technologies such as Spark streaming, Flink, or Apache Beam * Experience with various messaging systems, such as Kafka * Experience in implementing Lambda Architecture * Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, and/or Couchbase * Working experience with various time-series databases such as OpenTSDB and Apache Druid * Familiarity with ML and Deep Learning * Working knowledge of various columnar storage such as Parquet Kudu, and ORC * An understanding of software development best practice * Enthusiasm for constant improvement as a Data Engineer * Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion * Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood * Ability to work independently on complex problems of varying complexity and scope * Bachelor's degree in Computer Science, Engineering or equivalent demonstrable experience PERKS: Williams-Sonoma is a company of lifestyle brands that emphasize good living and good eating. We are a People First organization that values our customers, quality craftsmanship, corporate responsibility and a healthy work/life balance. We are continually working to achieve our business goals while improving our social and environmental performance. As a framework to guide our efforts, we've committed to a positive impact in 3 key areas: Operations, Products and Materials, and People and Communities. Our responsibility extends to every part of our business-- from our home to your home, to the world's home. * Work with emerging technologies * Team First culture * Full-time Associate Discount at all WS brands (40% off) * Competitive salary and 401k plan * Bonus plans and/or LTI plans for some positions * Shuttle to/from SF BART and Caltrain * Pre-tax health and commuter benefits * Bike share program * Pet Insurance (Starting July 2018) * Quarterly sample sales * Wellness program and quality health insurance options * Mothers' rooms and onsite showers * Discounts at nearby gyms and restaurants #LI-JQ1 Williams-Sonoma, Inc. is an Equal Opportunity Employer. Williams-Sonoma, Inc. will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance, or other applicable state or local laws and ordinances. Nearest Major Market: San Francisco Nearest Secondary Market: Oakland Job Segment: Database, Engineer, Developer, Java, SQL, Technology, Engineering Williams-Sonoma, Inc. San Francisco CA

Sr Big Data Engineer

Expired Job

Bayone Solutions