Senior Data Engineer

Button Inc New York , NY 10007

Posted 1 week ago

Button's mission is to build a better way to do business in mobile. Today, we work with some of the largest and most interesting businesses in the world, to connect consumers with what they want at the tap of a button.

We build with the consumer experience in mind, and we have a reputation for paving the future of mobile and enjoying the road to get there. Data is at the very core of proving we're on the right track and building our next generation of productsand that's where you come in.

As a Senior Data Engineer, you will build and evolve the systems responsible for ingesting, processing, and analyzing the data streams that drive key decisions we and our customers make. You will work on integrating machine learning and ETL systems that process billions of events, built on Kinesis, Redshift, SQS, and Airflow, and written in Python and Go.

You will create the tools and frameworks that empower Button's Data team and ultimately anyone at Button who needs to work with data at scale. As we grow, a significant part of your role will be to 'make the case' for new approaches and technologies when you see opportunity.

AS A SENIOR DATA ENGINEER ON THE DATA TEAM YOU WILL:

  • Build and evolve our core data processing pipelines. Some of our current challenges include: making it easier for others to add new measures and sources of data, ensuring data quality, and providing guarantees for data consumers.

  • Support new product and system development as the data partner. When we develop new products, you'll be involved end-to-end, helping small, cross-disciplinary product engineering teams define and execute on the product's goals including measurement and embedding ML frameworks.

  • Empower data-driven experimentation and decision-making. In a fast-moving environment where new opportunities are dreamed up daily, you'll work closely with other engineers and data scientists to validate the best ones. You'll build out the platform to support more sophisticated and efficient experiment procedures.

  • Define best practices and design for the management of our unique and evolving data assets.

WE LOOK FOR TEAMMATES WHO HAVE:

  • Experience with and opinions about data infrastructure and frameworks, with a bias towards pragmatism over perfection. Right now, we make heavy use of ECS, Redshift, Airflow, and BigQuery but we are eager to learn more.

  • Strong fundamentals including SQL, databases, schema design and ETL best practices.

  • Foundational DevOps knowledge including networking, monitoring, infrastructure as code. Bonus points if you've built and deployed a production machine learning service.

  • Programming experience in Python or Go. Experience writing production code that others can understand. Bonus points for experience with the Python scientific stack.

  • Open and active in sharing knowledge as well as excellent communication skills.

WHO YOU WILL WORK WITH:

  • Brad Groff, Director of Data: Brad is the head of the Data team at Button.

    Before joining us, he ran data science and data engineering at Ordergroove, and managed data science teams at Capital One and Booz Allen Hamilton. In his free time, he can be found engaging in lengthy discussions with his toddler on topics such as which colors are his favorite colors and why, how some monsters can be nice and others can be mean (but sometimes just because they're hungry), and which things are the silliest things.

  • Mike Wakerly, CTO: Mikey is Button's Hawaiian shirt enthusiast and Chief Technology Officer. A former Googler and a San Francisco transplant, he loves mountain biking, tinkering on electronics, and any excuse to take a road trip.

  • James (or Jimmy) McGill, VP of Engineering: Hailing formerly from both Australia and Google, he spends his weekends hiking, surfing and designing and building furniture. See James for all of your Vegemite needs.

  • Wilson Tsao, Analytics Manager: is a member of the Data Science team at Button. Previously he was in similar roles at Eventbrite, Yingli Solar, and Goldman Sachs. He enjoys playing and watching basketball in his spare time.

  • Mijail Gomez, Data Science Engineer: has worked on event ingestion, data processing frameworks, data standardization, and experimentation frameworks. He loves having discussions on data architecture, systems and tech.

    Before Button he was in SF working in early stage startups. Outside of work he enjoys soccer, hiking, and exploring new burger places in NYC.

Button is committed to being a welcoming and inclusive workplace for everyone, and we are intentional about making sure people feel respected, supported and connected at workregardless of who you are or where you come from. We value and celebrate our differences and we believe being open about who we are allows us to do the best work of our lives.

Button is an Equal Opportunity Employer. We do not discriminate against qualified applicants or employees on the basis of race, color, religion, gender identity, sex, sexual preference, sexual identity, pregnancy, national origin, ancestry, citizenship, age, marital status, physical disability, mental disability, medical condition, military status, or any other characteristic protected by federal, state, or local law, rule, or regulation.



icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

Andiamo

Posted 1 week ago

VIEW JOBS 3/15/2019 12:00:00 AM 2019-06-13T00:00 The Center for Data Science and Analytics is the innovative corporate Analytics group. We are a rapidly growing entrepreneurial department, which aims to design, create and offer innovative data-driven solutions for many parts of the enterprise. We are aided by existing business with a large market share in individual life insurance. We have the freedom to explore external data sources and new statistical techniques, and are excited about delivering a whole new generation of Analytical solutions. In fact, we are designing and will build one of the first multivariate model-based continuous risk differentiations in the industry. This model will incorporate current underwriting best practices (including medical rules) as features and add other data sources, patterns/ideas and variables to essentially create a rating plan to support the next generation underwriting process. This is just one of several projects with large business value. Geographic analytics on agents and customers, application fraud detection, agent success prediction and client prospecting analytics (off-line and on-line) are other exciting examples of enormous incremental value from analytics. Our products will be implemented into real-time core business processes and decisions that drive the company (e.g. underwriting, pricing, agent recruiting, prospecting, new product development). We work with data ranging from demographics, credit and geo data to detailed medical data (medical test results, diagnosis, prescriptions) and social media information. We have a modern computing environment with a solid suite of data science/modeling tools and packages, and a large (but manageable) group of well-trained professionals at various levels to support you. Life insurance is on the verge of huge change. This is a chance to be part of, actually to drive, the transformation of an industry. You will be part of Data & Platform sub-function team under Center for Data Science and Analytics. The Data & Platform team services internally to Data Scientists who focus on Statistical analysis. You will be part of a fast paced, high-impact team who will work with an entrepreneurial mindset using some of the best of breed tools as part of our Enterprise Data Lake (Hadoop) using R, Spark and Python. You will apply your data engineering skills to design, develop and enhance data strategy across and within the data science domain. This role provides strategic support to internal teams and leads the design, build and implementation of model ready data pipelines. Experience in a fast paced data engineering role with multiple and complex data sets. Responsibilities * Provide strategy and guidance for the architecture and build of data ingestion jobs to process disparate and unique data sources to form a high integrity model ready data set. * Action oriented and comfortable working with complex data. * Thinks strategically and works to define overall direction for solving complex business issues. * Monitor and track data quality metrics * Proactively address and resolve technical issues to support key business initiatives. * Utilize emerging technologies to address business issues through technical innovation. * Functions as data expert, contributes to analytics/solutions design and productizing decisions * Can work independently with some supervision and be part of a collaborative team * Work with Project Managers and Scrum Masters to provide milestones and stories * Proactively and effectively communicates in various verbal and written formats with senior level member of the team and partners Required qualifications * Graduate-level degree in computer science, engineering, or relevant experience in the field of Business Intelligence, Data Mining, Database Engineering, Programming * 8-10 years of overall experience working in the field of data wrangling and programming with a minimum of 2 years experience with ingesting, cleaning, merging and applying necessary data wrangling logic in Hadoop * Excellent command of SQL – best practices, optimization, troubleshooting and debugging * Strong Knowledge of Enterprise Platforms, Cloud Technology and high performance computing. * Proficiency using Python for all data related work such as Numpy, Pandas, PySpark * Experience working with Linux Operating System * Experience working with data visualization tools or packages * Experience building Exploratory Data Analysis reports such as Histograms, Box plots, Pareto, Scatter Plot using R, Python or a Data Visualization tool such as Tableau, Spotfire Preferred: * Understanding of statistical modeling concepts, designs and analytics-based products * Any experience in using ETL tools such as Ab Initio, Talend, Informatica, Pentaho * Any experience working with Data Warehouses and/or Data Marts * Any experience in Life Insurance business Andiamo is an Equal Opportunity Employer Andiamo provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Andiamo complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience. Andiamo New York NY

Senior Data Engineer

Button Inc