Databricks Engineer

Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture.

Key Responsibilities:

• Designing, building, and maintaining medallion architecture-based data pipelines in Databricks platforms.

• Handling raw data ingestion through Delta Live Tables while ensuring data quality and access latency.

• Manage enterprise-level complex data and metadata changes in Databricks environment using delta live tables.

• Utilizing knowledge of Snowflake to offer insight into data warehousing and management.

• Collaborate with data architects to provide Databricks solutions that align with company objectives.

• Work in conjunction with data science teams to implement complex statistical models.

• Ensuring data security and compliance in Databricks and Snowflake environments.

• Developing and deploying ETL job workflows with an emphasis on automation and scalability.

• Keeping up-to-date with industry best practices and emerging trends in Databricks technology.