Data Engineer

Shutterstock New York , NY 10007

Posted 4 weeks ago

The Opportunity:

As a Data Engineer on our Business Intelligence team, you will play a key role in designing and driving our data integration pipelines, ETL/ELT, and analytic strategies across our enterprise. In this role you will be bringing modern data technologies and practices to enable our talented team of researchers, data scientists and analysts to enhance the business with better insights and relevant data products. You will partner with all data teams at Shutterstock to understand requirements and collaborate on providing solutions at scale.

Responsibilities:

  • Determine optimal solutions for integrating data from a variety of sources into a common data warehouse

  • Implement, maintain and monitor batch & stream data pipelines with best practice quality controls

  • Evaluate relevant new and mature technologies as needs, gaps, and opportunities arise

  • Work closely and collaboratively in an Agile environment with our analysts, engineers and product teams to analyze issues and find new insights covering our business and operations

  • Collaborate with data infrastructure team to deploy necessary infra capabilities

  • Day to day operational support of data infrastructure, and services

Requirements:

  • 5+ Years of related work experience

  • Solid command of Python, Java, and/or Scala

  • Experience in stream processing technology (Kafka, Spark, Storm, Samza, Flink, etc)

  • In-depth knowledge of SQL, data modeling and data warehousing concepts

  • Distributed and low latency (streaming) application architecture

  • Familiarity with API design

  • CI/CD systems experience (Jenkins, Github, etc)

  • Experience adhering to robust audit standards

  • BS or MS degree in Computer Science or Engineering related experience

Preferred Qualifications:

  • Knowledge of emerging data integration technologies

  • Spark Streaming, Kafka Streams, Kafka Connect, etc

  • Data Science and Modeling pipeline experience

  • Familiarity with machine learning frameworks such as H2O, scikit-learn or similar tools

  • Strong expertise/background with Linux

  • Familiarity with MS Sql Server, SSIS, SSAS

About Shutterstock:

Shutterstock, Inc. (NYSE: SSTK), directly and through its group subsidiaries, is a leading global provider of high-quality licensed photographs, vectors, illustrations, videos and music to businesses, marketing agencies and media organizations around the world. Working with its growing community of over 350,000 contributors, Shutterstock adds hundreds of thousands of images each week, and currently has more than 180 million images and more than 9 million video clips available.

Headquartered in New York City, Shutterstock has offices around the world and customers in more than 150 countries. The company also owns Bigstock, a value-oriented stock media agency; Shutterstock Custom, a custom content creation platform, Offset, a high-end image collection; PremiumBeat a curated royalty-free music library; and Rex Features, a premier source of editorial images for the world's media.

For more information, please visit www.shutterstock.com and follow Shutterstock on Twitter, Facebook and Instagram.

Equal Opportunity Employer, M/F/D/V


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

Atlantic Media Company

Posted 5 days ago

VIEW JOBS 4/19/2019 12:00:00 AM 2019-07-18T00:00 Quartz is looking for a data engineer to help accelerate the development of our data foundation that lives at the heart of our analytics team and the entire organization. We are looking for a savvy individual who has strong aptitude across all of these areas: * Data ingestion and integration * Data warehousing * Data and metadata management This individual will join our product team, working closely with analytics and engineering. He or she will play a critical role in both managing and shaping our data architecture vision, while enabling the promulgation of data and insights throughout the organization, including our business, product, and editorial teams. About you: Two to four years of data engineering chops. You have a focus on consistency and alignment and have a deep understanding of how the data warehouse reflects the business and product requirements. The data warehouse is your library, and you govern it with well defined rules for cataloging and organizing metadata. You have a deep respect for the ongoing mission that is ETL — an evolving journey that is misunderstood by most, but often at the heart of unlocking value to the organization. You enjoy partnering with data scientists, recognizing that their success is wholly dependent on your legwork. Required skills: * Experience building custom, scalable, and distributed data platforms leveraging both open source and managed services within a cloud hosted environment AWS) * Demonstrated ETL design focused on efficient, resilient, and evolvable code * Mastery of SQL and deep knowledge of SQL database landscape * Comfortable crafting NoSQL solutions for semi-structured data requirements, and strong familiarity with the landscape of open source database providers (e.g. DynamoDB, MongoDB, Redis) * Expert in a programming/scripting language (Python preferable) and a shell scripting language (e.g. Bash) * Competence in AWS services: API Gateway, Lambda, Redshift, Kinesis, SQS, DynamoDB * Bonus points for Graph Database knowledge Enterprise Values Quartz recruits talent for two salient attributes or qualities: * Force of Ideas: At the center of Quartz work are the ideas within our writing. We believe that ideas – to the good and not – have consequence. Our highest work is bringing rigor, insight, intellectual honesty, to that ultimate purpose of separating the bad from the good, and giving voice to the latter. * Spirit of Generosity - Quartz seeks in its ranks a spirit of generosity – a natural disposition in each colleague toward service and selfless conduct. Quartz writing should be cut from the same cloth – critical on the merits but informed by charity and forbearance in measuring motive and personal character. Quartz Media LLC is an EOE of Minorities/Women/Vets/Disability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Atlantic Media Company New York NY

Data Engineer

Shutterstock