Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Data Ops Engineer

Expired Job

Infostretch San Francisco , CA 94118

Posted 4 months ago

Job Description:

As a senior member of the DataOps team, your primary goals are to respond to production issues affecting data pipelines. You will need to work directly with Suppliers and Consumers as well as the internal Engineering teams to triage and remediate issue and restore service. You should have a solid understanding of how to access and extract data through various means, have worked on cloud hosted platforms such as GCP or AWS and have the soft skills to work with technical teams at different levels.


  • Provide Level 2 production support for data pipelines, working with the platform team as well as data suppliers and consumers to understand use cases respond to any issue raised

  • Working in shifts you will be responsible for live monitoring of production systems and incident management of reported issues during business hours and a rotating on call coverage

  • Continual Service Improvement (CSI) for the support processes through performance reporting and metrics that can help forecast and proactively address issues


Must Have

  • 10+ years of experience in a support or operations role, preferable in a technology or financial services company supporting production environments with enterprise users

  • ITSM literate with strong documentation instincts

  • Experience working in a cloud-based environment, such as GCP or the AWS

  • Working knowledge of OO Python, RDBMS

  • Experience working as part of a cross function matrixed support team

  • Strong problem solving and troubleshooting skills

  • Ability to exercise judgment to make sound decisions

  • Strong communications skills, interpersonal skills, and a sense of humor

Even Better

  • Data skills: RDBMS SQL and NOSQL, structured and unstructured data, BigQuery

  • Experience in Airflow, GitHub and working with ETL tools

  • Big data and cloud processing experience, e.g. HDFS, Spark

  • Experience working with Market Data

Person should be

  • Naturally helpful and enjoy supporting business users and resolving technical issues

  • Bring experience of cloud application architecture and data life cycle

  • Enjoy analyzing networks, system services, operating systems and backend production systems, specifically in Python, and skilled at quickly identifying issues and remediating them

  • Love working on high-performing teams, collaborating with team members, and improving ability to deliver delightful experiences to clients

  • Excited by the opportunity to solve challenging technical problems, and find learning about data fascinating

  • Understand Server, Network, and Hosting Environments, RESTful and other common APIs, common data distribution, and hosted storage solutions

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Software Engineer Derivatives Data

Q Systems

Posted Yesterday

VIEW JOBS 11/20/2018 12:00:00 AM 2019-02-18T00:00 <strong>Senior Software Engineer - Derivatives Data</strong><br /> San Francisco, CA - USA<br />  <br /> From the biggest banks to the most elite hedge funds, financial institutions need timely, accurate data to capture opportunities and evaluate risk in fast-moving markets. For over 30 years, our clients have relied on our core product, the Terminal, to access the data and analytics they need to make informed investment decisions.<br />  <br /> The Derivatives Data Team is building an all-inclusive solution to bring transparency, efficiency, and excellence to this complex market. To produce real time and accurate data analytics for our clients, we are building a data pipeline using Kafka Streaming, Spark, and Cassandra with data quality evaluations utilizing machine learning. We are looking for engineers to help explore low latency scoring of streaming data, online machine learning, and real time missing data point prediction.<br />  <br /> As part of this innovative team, you will be building a groundbreaking market data platform which will revolutionize the data generation for derivatives market. Our system has to be ultralow latency to handle the traffic of millions of market movements per second. We also have complex analytics like source confidence evaluation (scoring), and the need of real-time online learning for prediction. And of course, like any large scale system, it needs to be scalable enough to handle millions of topic subscriptions. You will have the opportunity to work with a multitude of technologies: Spark, Kafka, Flink.<br />  <br /> <strong>We have:</strong> <ul> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Constantly ticking financial data that needs to be processed in real-time</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Terabytes of static and historical data as your playground</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Direct and tremendous impact on top external decision-makers and products with high visibilities</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Knowledgeable/helpful team members to help you build good understanding of financial data and models</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> An open mind to new ideas and technologies</li> </ul>  <br /> <strong>You’ll need to have:</strong> <ul> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> 2+ years of industry programming experience</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Strong programming proficiency in Scala and/or Java</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Hands on experience in data streaming technologies like Kafka and/or Spark</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Deep understanding of data structures, algorithms</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> The motivation to build scalable, efficient platforms</li> </ul>  <br /> <strong>We’d love to see:</strong> <ul> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Experience in architecting and implementing large scale systems</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Exposure to machine learning</li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"> Experience working in a test driven development and Agile environment</li> </ul> You will work at the intersection of technology, data science, finance, and mathematics. The goal of this platform is to analyze, predict, clean, and generate the best quality derivatives data.<br />  <br />   Q Systems San Francisco CA

Data Ops Engineer

Expired Job