Principal Data Engineer - Ai/Big Data

Workbridge Associates San Francisco , CA 94102

Posted 2 months ago

Data Science and AI is the core of this 50-person start-up that uses Machine Learning for their Voice products that provide scalable voice solutions with Big Data.
This company is hiring for a Principal Data Engineer to help build out a data platform for the existing Data Science team - which is using Machine Learning to automatically train predictive models from real-world custom call data. This solution can detect complex events and predict future behavior with precision and accuracy.
Required Skills & Experience

Experience building data platforms at scale
Strong understanding of Spark, Elastic, Kafka, and ETL
Comfortable reading and improving Java code
Relational, Data Warehouse, and noSQL schema design
What You Will Be Doing

Building ETL pipelines
Ensuring scalable, interactive search capabilities
Representing data in Elastic, Spark, and Data Warehouses for fast performance and high throughput on high-complexity queries
Writing clean, concise, readable code
Working with peers who provide direct and open design feedback
The Offer

Market Competitive Salary
Full Health Benefits
Unlimited PTO
Applicants must be currently authorized to work in United States on a full-time basis now and in the future.
This position does not offer sponsorship.

Job type: Direct Hire

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data Architect/Engineer

Matchpoint Solutions

Posted Today

VIEW JOBS 11/20/2018 12:00:00 AM 2019-02-18T00:00 <div><u>Big Data Architect/Engineer</u></div> <div><u>Locations: San Francisco, CA (Prefer local candidates)</u></div> <div><u>Duration: 6 months</u></div> <div>Position requirements:</div> <div>• Design, lead, and implement Data Lake in AWS, with potential to grow across different cloud providers</div> <div>• Design, lead, and implement the ingestion of data for the proposed Data Lake</div> <div>• Provide the right level of security and performance for each component and as an aggregate</div> <div>• Deep experience with large data sets and managing deltas</div> <div>• Experience across multiple big data platforms (Hadoop, Hortonworks, MapR, Cloudera, AWS, GCP, etc.)</div> <div>• 5+ years of experience</div> <div>Additional Notes:</div> <div>Big data is collected from several data sources – when the data comes in there is no structured format… All data is dumped and collecting in one place and that is a Data Lake. This person builds these pipelines.. creating API’s or one to one connections. Gigabytes and terabytes and data coming in… do they want real time data or batch processes at night.. Separating items on how they are is a data mark – making sense of data lake. When all data is here, they make sense of the data. MapR- manageable units that can be processed – reducing chunks of data.<br /> <br /> <br /> <strong>Regards,</strong><br /> <strong>Megha Ananthakrishna</strong><br />  <br /> <em>Technical Resource  Manager</em><strong> |</strong> <em>MatchPoint Solutions </em><strong>|</strong> Office <strong>925-829-7755</strong> <strong>|</strong>  Cell <strong>408-718-6170| </strong>Email <strong><a href=""></a></strong><br />  </div> Matchpoint Solutions San Francisco CA

Principal Data Engineer - Ai/Big Data

Workbridge Associates