Tata Consulting Services (Usa) Phoenix , AZ 85002
Posted 1 week ago
Skill: Data Engineer
Experience with Snowflake and Snowpark.
Data pipeline development using Python and SQL.
5 years of Data-related experience or equivalent combination of education and relevant experience.
5+ years' experience in data engineering.
Responsibilities:
Design, develop, and maintain end-to-end data pipelines for collecting, processing, and storing large volumes of data.
Utilize Python and SQL for efficient and scalable data pipeline development.
Implement best practices for data pipeline orchestration and scheduling.
Manage and optimize Snowflake data warehouse, including schema design, performance tuning, and security configurations.
Leverage Snowflake features such as virtual warehouses, clustering, and materialized views for optimal data storage and retrieval.
Implement data quality checks and testing processes to ensure the accuracy and reliability of data pipelines.
Collaborate with cross-functional teams to validate data transformations and ensure consistency in reporting.
Create and maintain comprehensive documentation for data pipelines, data models, and system architecture.
Provide documentation for data recipes, ensuring knowledge transfer and ease of maintenance.
Identify and address performance bottlenecks in data pipelines and Snowflake queries.
Work closely with data analysts and data scientists to optimize queries for efficient data retrieval.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions to meet business needs.
Implement and adhere to data security and compliance standards.
Work with the security team to ensure that data handling practices align with organizational policies.
#LI-NR3
Tmeic Corporation Americas
Posted Today
VIEW JOBSTata Consulting Services (Usa)