Senior Data Engineer

Change.Org San Francisco , CA 94118

Posted 2 months ago

At Change we are a unique blend of engineers, activists, marketers, designers and scientists with a common goal: to give the voiceless a voice and a chance to be heard in today's digital jungle; to allow everyone to connect with likeminded community and help people change the world for the better. People, the members, the activists, and our employees, are at the center of our mission and everything we do. Actually, employees at Change are a lot like the service itself: bright, brave, and innovative. Collaboration is the foundation of our workforce, and we're looking for smart individuals who are self-motivated and passionate to join us. Be a part of the team that creates a brighter future for everyone. Discover your future at Change!

Change has a great opportunity for a senior data engineer with several years of diverse experience who will help deliver Change to millions of people around the world. We are looking for someone who will own, lead, and execute projects. You should have outstanding analytical and programming skills with a deep understanding and proven track record of building robust, scalable, data processing pipelines. As a member of our highly motivated team, you should be dedicated to excellence and have a strong sense of personal responsibility. We hold ourselves to high standards and take pride in our work. We are looking for someone who is not afraid to get their hands dirty in data and be an integral part of the machine learning team's expansion.

What you'll do:

  • Work with data scientists and other data engineers to productize analytics and data models, developing and maintaining new ETL flows for new applications driven by model-based statistics and signals.

  • Push the envelope with scalable data processing and model deployment solutions leveraging technologies such as Spark, Kafka, Kinesis, Airflow, DynamoDB, TensorFlow, TensorBoard etc.

  • Build and support internal A/B testing and model evaluation platforms.

  • Tool our systems for observability, including logging, metrics monitoring, and dashboarding.

  • Have fun and make friends.

Requirements:

  • 5 years development experience of which 2-3 years are focused on data or analytics engineering working with big data technologies (Hadoop: i.e. MapReduce, HDFS/Hive, Spark)

  • Team player with excellent communication and interpersonal skills

  • Significant experience developing high quality software in Python, Scala or Java

  • Proficient with data preprocessing, data transformation, and integration of data from multiple data sources (ETL processes)

  • Experience with one of the following distributed relational databases: PostgreSQL, MySQL

  • Experience developing for Linux-based deployment platforms, developing scalable, multithreaded server side software for deployment

  • Experience designing and configuring hosted and cloud-based data and machine learning infrastructure

  • Experience unit testing with frameworks and a dedication to thorough testing to create high quality software, i.e. JUnit

  • Experience with productionizing feature engineering for machine/deep learning algorithms and exposure to machine learning algorithms and/or statistical modeling methods.

  • Experience with API design/development (i.e. RPC, REST, JSON, XML, SOAP)

  • Experience with NoSQL databases and key-value stores, such as Cassandra, Redis

Bonus skills:

  • Experience with recommender, or search/ranking systems

  • Experience with Kafka and Yarn or Mesos

  • Experience with AWS services (Athena, Glue, Redshift, Kinesis) or Google cloud services (BigQuery, BigTable)

  • BA/BS or above in Computer Science or a related field

This is a full-time opportunity. The position is located in San Francisco, CA, U.S.A.

Change.org is committed to being a diverse and inclusive workplace. We encourage applicants of different backgrounds, cultures, genders, experiences, abilities and perspectives to apply.

All qualified applicants will receive consideration for employment without regard to race, color, national origin, religion, sexual orientation, gender, gender identity, age, physical disability, or length of time spent unemployed.


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

Elevano

Posted Yesterday

VIEW JOBS 11/13/2018 12:00:00 AM 2019-02-11T00:00 <div>Our Client is looking for a superstar Data Engineer to join their Fintech startup. You will be a part of a fast paced company with a great social cause!<br /> <br /> Requirements:</div> <ul> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">3+ years Scala and Java experience</font></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;">Hadoop, Machine learning & Spark</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">AWS & SQL</font></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">SQL design and architecture</font></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">Node, Redis, ElasticSearch are pluses</font></li> </ul> <div><font face="arial, helvetica, sans-serif">Why work here?</font></div> <ul> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">Generous Equity Package</font></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;">Impact communities</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">Telecommute options</font></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">Unlimited Vacation Policy</font></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><font face="arial, helvetica, sans-serif">Medical, Dental, Vision</font></li> </ul> Elevano San Francisco CA

Senior Data Engineer

Change.Org