ZP Group Washington , DC 20319
Posted 6 days ago
Piper Companies is looking for a Data Engineer to join an elite environmental industrial engineering firm in Washington, DC, to cluster large datasets across various container and data platforms.
Responsibilities of the Data Engineer include:
Achieve and maintain proficiency with cluster and framework sizing, installation, debugging, performance optimization, migration, security and automation
Collaborate with data scientists, analysts, business users, and IT teams to design, implement, and deploy data services and analytics.
Use Continuous Integration/Continuous Delivery (CI/CD) concepts to engineer a standardized data environment
Recommend and advise on optimal data models for data ingestion, integration, and visualization
Integrate data from a variety of data source types
Qualifications for the Data Engineer include:
6 years of experience in data engineering
3+ years cloud experience: Azure, AWS, or GCP
Experience with Snowflake, Databricks, Spark SQL, PySpark
Expertise with Python
Bachelors or Masters Degree in relevant field of study preferred
Compensation for the Data Engineer include:
Keywords; Python, Azure, Data Factory, SSRS, SSIS, SQL Server, SQL, Scala, CICD, CI-CD, DevOps, Mapping, Scientist
#LI-JD4 #LI-HYBRID
#pando
#LI-DNP
ZP Group