Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Senior Data Engineer

Expired Job

Infobahn Softworld Inc Sunnyvale , CA 94085

Posted 2 months ago

Title:Senior Data Engineer
Duration:Long-Term Project
Position Summary
Very Strong engineering skills. Should have an analytical approach and have good programming skills.
Provide business insights, while leveraging internal tools and systems, databases and industry data
Minimum of 5+ years experience. Experience in retail business will be a plus.
Excellent written and verbal communication skills for varied audiences on engineering subject matter
Ability to document requirements, data lineage, subject matter in both business and technical terminology.
Guide and learn from other team members.
Demonstrated ability to transform business requirements to code, specific analytical reports and tools
This role will involve coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers other engineering team.

Must Have
Strong analytical background
Must be able to reach out to others and thrive in a fast-paced environment.
Strong background in transforming big data into business insights
Must haves -Luker, Hyve, Teradata, Data engineering, Tableau.

Technical Requirements
Knowledge/experience on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization
Experience with Teradata Tools and Utilities (FastLoad, MultiLoad, BTEQ, FastExport)
Advanced SQL (preferably Teradata)
Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.).
Strong Hadoop scripting skills to process petabytes of data
Experience in Unix/Linux shell scripting or similar programming/scripting knowledge
Experience in ETL/ processes
Real time data ingestion (Kafka)

Nice to Have
Development experience with Java, Scala, Flume, Python
Automic scheduler
R/R studio, SAS experience a plus
Tableau or similar reporting/dash boarding tool
Modeling and Data Science background
Retail industry background

BS degree in specific technical fields like computer science, math, statistics preferred

09/26/2018 TO 01/31/2019

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

Castlight Health

Posted 2 weeks ago

VIEW JOBS 11/4/2018 12:00:00 AM 2019-02-02T00:00 At Castlight, our mission is to empower people to make the best choices for their health and to help companies make the most of their health benefits. We offer a health benefits platform that engages employees to make better healthcare decisions and can guide them to the right program, care, and provider. The platform also enables benefit leaders to communicate and measure their programs while driving employee engagement with targeted, relevant communications. To date, Castlight has partnered with more than 240 large enterprise customers, spanning millions of lives, to improve healthcare outcomes, lower costs, and increase benefits satisfaction. What you will be doing: Castlight's Data Management (DM) – Engineering team is responsible for the end to end management of data lifecycle – from data acquisition (inbound), ingestion and validation, warehousing (reporting and analytics) and data distribution (outbound). We are looking for seasoned data engineers who have a penchant for problem-solving with a passion for innovation and data quality to join our DM Reporting Team. The candidate must be comfortable dealing with large sets of data, disparate data sources, imperfect data sets and can impact data automation that will remove frictions in data processing. As data volume increases, the candidate must apply deep knowledge in query performance tuning, scalability and optimization to make the appropriate recommendation and help implement solutions. To succeed in this role, you'll need to be a versatile engineer. You must have an innate desire to build things the right way. You should be pain-averse -- if some process or system isn't as streamlined as it could be, you want to fix it! You will have a lot of interaction with the Customer Success team and other externally facing groups hence verbal and writing communications skills are required. You must be a champion of standardizing and maturing the business process in order to support scalability. You will be working with cross-functional teams within and outside of the engineering department and with team members in SF and India. This is a full-time position at our San Francisco headquarters. Essential Duties and Responsibilities: * Business Intelligence or Reporting – developing back-end data sources required to support Castlight's custom-built reporting platform. Must be well-versed in dealing with standard EDW star schema database, aggregate data marts, and other data sources. Familiarity with other OTS (off the shelf) reporting tools is a plus. * Data Discovery - analyzing data values and data patterns to identify the relationships that link disparate data elements into logical units of information, or "business objects" (such as customer, patient or claim). Identify the transformation rules that have been applied to a source system to populate a target such as transactional entities, operational data store or data warehouse * Data Architecture and Modeling - Create logical and physical data models, including conceptual models. Define data attributes, including domain constraints and privacy attributes. Discover, explore, and visualize the structure of data sources. Discover or identify relationships between disparate data sources. Compare and synchronize the structure of two data sources * Data Governance/Stewardship – Record the business use for defined data. Identify opportunities to share and re-use data. Monitors the progress towards, and tuning of, data quality and data security target metrics. Ensures the quality, completeness and accuracy of data definitions. Identifies and manages the resolution of data quality and data security issues, such as uniqueness, integrity, accuracy, consistency, privacy and completeness in a cost-effective and timely fashion. Identify procedures for disaster recovery and data archiving to ensure effective protection and integrity of data assets. * Data quality - Ensure the stability, integrity and efficiency of data access and data quality across the organization via ongoing database support and maintenance. * Database architecture, administration and development - Work with application development staff to develop database architectures, coding standards, and quality assurance policies and procedures. Participate in testing and implementing database design and functionality, and tuning for performance. * Metadata - support information governance by providing reporting and traceability on data movement, modeling and business intelligence applications, as required by regulatory requirements. Analyze and view the impact of changes to the current information model, avoiding potentially disruptive modifications to existing processes. * Customer Implementation and Production Support – Assist Customer Implementation and Production support teams as DM SME during troubleshooting issues. * Data warehouse (Optional) – Knowledge in developing queries against Enterprise Data Warehouse star scheme is a nice to have. Participate in research and development of recommendations regarding database components, including hardware, database systems, ETL software, metadata management tools and database design solutions. General Qualifications: * Bachelor's Degree in Computer Science, related field or equivalent experience (including completed courses in relevant areas such as computer science, computer languages, etc. * Strong understanding of database structures, theories, principles and practices, and hands-on experience with business requirements gathering, analysis, and data modeling * Strong experience to manage/maintain the database schema in source code control * Create and maintain technical documentation * Perform peer code review when assigned * Ability to work independently while working on multiple projects * Strong problem-solving and communication skills * Strong analytical, prioritizing, interpersonal, problem-solving, presentation, project management (from conception to completion) & planning skills * Demonstrated collaborative skills and ability to work well within a team * Ability to work in a fast-paced and deadline-oriented environment * Self-motivated with critical attention to detail, deadlines and reporting Works on problems of limited to diverse scope involving task specific or cross-functional teams * Ability to analyze business processes, best practices, data lifecycles, and standard operating procedures * Applied experience in secure file transfer protocol (sFTP), web services integrations, Salesforce, and JIRA is preferred Technical Qualifications for a Data Engineer * 2+ years of experience related work experience within the Healthcare Technology Industry or Insurance Industry; experience working with healthcare payers/carriers in managing provider, claims, medical or patients data strongly desired. * 2+ years of experience in analyzing and developing data requirements and data specifications; hands-on experience in documenting understanding and analysis of databases and data models. * 2+ years of experience in developing backend data sources for the reporting and analytics platform. * 2+years of hands-on experience in writing SQL for querying databases. Ability to extract information from databases using complex query statements and advanced database tools. * 2+ years of hands-on experience in logical data modeling * 2+ years of hands-on technical experience with designing, building, installing, configuring and supporting database servers including database tuning and troubleshooting experience * 2+ years of Informatica or other comparative ETL technology technical skills. Data integration using big-data technologies are ideal (such as Spark/Scala) * Knowledge of off-the-shelf reporting tool is a plus * Knowledge of Python or other object-oriented programming language is a big plus * Knowledge of Greenplum, PostgreSQL or other big data environment is a plus * Experience with version control tools & release management Senior Data Engineer * 5 years of experience meeting all the requirements of a Data Engineer * 2+ years of project coordination/management background is required * 1+ years of team leadership and mentoring experience are required Lead Data Engineer * 7 years of experience meeting all the requirements of a Data Engineer * 5+ years of project planning/management background is required * 5+ years of team leadership/management and mentoring experience are required Our Values One team. On a mission. Making things happen. Diversity and Inclusion The Castlight culture values and celebrates different backgrounds, perspectives, and points of view. We believe our diversity helps drive creativity and innovation. We strive to make everyone feel included, valued, and engaged; enable them to do their best work; and build their careers here at Castlight. That is why diversity and inclusion are more than just words to us. Rather, they are a commitment to a culture where employees feel respected and empowered to share their ideas and deliver the best results. Castlight Health Sunnyvale CA

Senior Data Engineer

Expired Job

Infobahn Softworld Inc