Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Data Engineer

Expired Job

Thoughtwave Software And Solutions San Francisco , CA 94102

Posted 4 months ago

Title: Data Engineer
Location: San Francisco, CA
Duration: Long Term

Experience: 10+ Years

Job Overview
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

Responsibilities for Data Engineer
Create and maintain optimal data pipeline architecture,
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Create data tools for analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications for Data Engineer
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing 'big data' data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
Experience supporting and working with cross-functional teams in a dynamic environment.
We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases.
Experience with data pipeline and workflow management tools: AWS Pipeline, Azkaban, Luigi, Airflow, etc.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

Regards,

Siddu Account Executive
Thoughtwave Software & Solutions, Inc.
Phone: 630-448-6681x 118, Direct:
Email: Web:

Skills:
Data Modeler,data analyst,Data Engineer
Contract
Long Term


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

CBS Corporation

Posted 2 weeks ago

VIEW JOBS 11/28/2018 12:00:00 AM 2019-02-26T00:00 Data Engineer REF#: 32321 CBS BUSINESS UNIT: CBS Interactive JOB TYPE: Full-Time Staff JOB SCHEDULE: JOB LOCATION: San Francisco, CA ABOUT US: CBS Interactive is the premier online content network for information and online operations of CBS Corporation as well as some of the top native digital brands in the entertainment industry. Our brands dive deep into the things people care about across entertainment, technology, news, games, business and sports. With over 1 billion users visiting our properties every quarter, we are a global top 10 web property and one of the largest premium content networks online. Check us out on [1] The Muse, [2] Instagram and [3] YouTube for an inside look into 'Life At CBSi' through employee testimonials, office photos and company updates. References Visible links * https://www.themuse.com/companies/cbsinteractive * https://www.instagram.com/cbsinteractive/?hl=en * https://www.youtube.com/channel/UCAvGapyifCtUlmNTagAl_sQ DESCRIPTION: Role Details: The Data Product Engineer should possess a deep sense of curiosity and a passion for building smarter products based on data, and the ability to communicate data structures and tools throughout the CBS Digital Media organization. The perfect candidate for this role will use their skills in reverse engineering, analytics, and creative experimental solutions to devise data and BI solutions. This engineer supports data product development using disparate data sources. The ideal candidate will also work with BI, Research, Engineering and Product teams to implement data-driven plans that drive the business. Your Day-to-Day: * Works with large volumes of traffic data and user behaviors to build products and tools that enhance raw data. * Able to break down and communicate highly complex data problems into simple, feasible solutions. * Find answers to business questions via hands-on exploration of data sets via Jupyter, SQL, dashboards, statistical analysis, and data visualizations. * Partnering with the internal product and business intelligence teams to determine best approach around data ingestion, structure and storage then, working with team to ensure these are implemented correctly. * Contributing ideas on how to make our data more effective and working with other members of the engineering, BI teams and business units to implement changes. * Ongoing development of technical solutions while developing and maintaining documentation, at times training impacted teams. * Early on collaboration with the team on internal initiatives to create strategies that improve company processes. #LI-SC1 QUALIFICATIONS: What you bring to the team: You have - * Bachelor's degree and 2-4 years work experience in Analytics/Measurement/Data Operations fields or consulting roles with focus on digital analytics implementations. * Experience with full stack application development. * Proficient in Python. Including experience with a Python web framework such as Django or Flask as well as exploratory data analysis using tools like iPython Notebook, Pandas & matplotlib. * Experience with data management systems, both relational and NoSQL (e.g., HBase, Cassandra, MongoDB) * Familiarity with SQL skills for MySQL, Postgres and BigQuery to perform common types of analysis * Strong problem solving and creative-thinking skills. * Ability to break down and communicate highly complex data problems as simple, feasible solutions * Demonstrated development of ongoing technical solutions while developing and maintaining documentation, at times training impacted teams. * Experience developing solutions to business requirements via hands-on discovery and exploration of data. * Exceptional written and verbal communication skills, including the ability to communicate technical concepts to non-technical audiences, as well as translating business requirements into Data Solutions You might also have - * Experience with Workflow systems such as Airflow or UC4. * Experience building and deploying application on a cloud platform (Google Cloud Platform preferred) * Familiarity with Data Modeling. * Familiarity in Hadoop pipelines using Spark, Kafka. * Familiar with version control systems. * Can perform statistical analyses using tools such as R, Numpy/SciPy with Python * Experience with Adobe Analytics (Omniture) or Google Analytics. * Digital marketing strategy including site, video, social media, SEM, SEO, and display advertising. * Familiarity with Informatica and ETL concepts. EEO STATEMENT: Equal Opportunity Employer Minorities/Women/Veterans/Disabled CBS Corporation San Francisco CA

Data Engineer

Expired Job

Thoughtwave Software And Solutions