Data Engineer - Location US East Coast

CGI Group Inc. Pittsburgh , PA 15201

Posted 4 months ago

Meet our professionals

CGI: A place to build an IT career

Position Description:

CGI is looking for a junior Big Data Engineer who can join in our emerging technology group in the digital insight practice. The Big Data Engineer will be responsible for designing & developing data ingestion and data transformation framework for modern data lake solutions.

The Big Data Engineer will also be providing statistical trend analysis on large structured and unstructured data sets and analysis of advanced algorithms including artificial intelligence concepts. The candidate will be responsible for adapting and modifying machine-learning algorithms to address user requirements and case studies, establishing new proof of concepts for our clients.

Responsibilities:

  • Data Ingestion using Kafka, CDC or similar technologies.

  • Implement and support streaming technologies such as Kafka, K-SQL and Spark.

  • Implement and support big data tools and frameworks such as HDFS, Hive, and Hbase or Cassandra.

  • ETL Design and Development in the big data platform in Hadoop using technologies such as Scala, Spark, Python, Oozie, and more to support a variety of requirements and applications.

  • Warehouse Design and Development Set the standards for warehouse and schema design in massively parallel processing engines such as Hadoop and Columnar Databases while collaborating with analysts and data scientist in the creation of efficient data models.

  • Implement a CICD DevOps strategy

  • Implement end to end Data Lake solution in on premise as well as on a cloud environment preferably Azure and AWS.

  • Deliver a ML/AI framework to support user Analysts and data scientists to support advance analytics.

Required Skills:

  • 5+ years of work experience with ETL, and business intelligence big data architectures.

  • 3+ years of experience with the Hadoop ecosystem (Map Reduce, Hive, Oozie, Yarn, HBase, etc.) and big data ecosystems (Kafka, Cassandra, etc.).

  • 2+ years of hands-on Spark/Scala/Python development experience.

  • Experience developing and managing data warehouses on a terabyte or petabyte scale.

  • Experience with core competencies in Data Structures, Rest/SOAP APIs, JSON, etc.

  • Strong experience in massively parallel processing & columnar databases.

  • Expert in writing SQL.

  • Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.

  • Experience with common software engineering tools (e.g., Git, JIRA, Confluence, or similar)

  • Ability to manage numerous requests concurrently and strategically, prioritizing when necessary.

  • Good communication and presentation skills.

  • Dynamic team player.

Your future duties and responsibilities:

  • Data Ingestion using Kafka, CDC or similar technologies.

  • Implement and support streaming technologies such as Kafka, K-SQL and Spark.

  • Implement and support big data tools and frameworks such as HDFS, Hive, and Hbase or Cassandra.

  • ETL Design and Development in the big data platform in Hadoop using technologies such as Scala, Spark, Python, Oozie, and more to support a variety of requirements and applications.

  • Warehouse Design and Development Set the standards for warehouse and schema design in massively parallel processing engines such as Hadoop and Columnar Databases while collaborating with analysts and data scientist in the creation of efficient data models.

  • Implement a CICD DevOps strategy

  • Implement end to end Data Lake solution in on premise as well as on a cloud environment preferably Azure and AWS.

  • Deliver a ML/AI framework to support user Analysts and data scientists to support advance analytics.

Required qualifications to be successful in this role:

  • 5+ years of work experience with ETL, and business intelligence big data architectures.

  • 3+ years of experience with the Hadoop ecosystem (Map Reduce, Hive, Oozie, Yarn, HBase, etc.) and big data ecosystems (Kafka, Cassandra, etc.).

  • 2+ years of hands-on Spark/Scala/Python development experience.

  • Experience developing and managing data warehouses on a terabyte or petabyte scale.

  • Experience with core competencies in Data Structures, Rest/SOAP APIs, JSON, etc.

  • Strong experience in massively parallel processing & columnar databases.

  • Expert in writing SQL.

  • Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.

  • Experience with common software engineering tools (e.g., Git, JIRA, Confluence, or similar)

  • Ability to manage numerous requests concurrently and strategically, prioritizing when necessary.

  • Good communication and presentation skills.

  • Dynamic team player.

#L1-AC2

Skills:

  • Big Data
  • ETL
  • SQL

What you can expect from us:

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this changesupporting our clients' digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI at www.cgi.com.

No unsolicited agency referrals please.

CGI is an equal opportunity employer.

Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status, political affiliation, genetic information, or any other legally protected status or characteristics.

CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_Compliance@cgi.com. You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned.

We make it easy to translate military experience and skills! Click here to be directed to our site that is dedicated to veterans and transitioning service members.

All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held.

CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Scientist/Machine Learning Engineer Cleanrobotics

Innovation Works, Inc.

Posted 2 days ago

VIEW JOBS 10/15/2019 12:00:00 AM 2020-01-13T00:00 Background: Our first and flagship product, TrashBot, is a "smart" trash can that combines next-generation robotics and sensor technology capable of differentiating recyclables from non-recyclable material. Simply place your garbage in a Trashbot and walk away. TrashBot automatically sorts recyclables such as metals, plastics, and glass from landfill waste, while simultaneously gathering information about the type of waste generated. A single TrashBot has the potential to replace all of the conventional, spaceconsuming trash and recycling bins we currently use. From corporate workplaces, to stadiums and ball parks, to universities, schools, and airports, the practical applications for TrashBot are endless. We're looking for an outstanding Software Engineer with a machine learning background who combines excellent technical skills and a demonstrated ability to get things done quickly and effectively. Applications from all skill levels and backgrounds are appreciated. Preferred Skills and Qualifications: * 3+ years of experience in a Software Engineering related field * Strong CS fundamentals * Experience with Computer Vision and Machine Learning * Willingness to learn aspects of other Engineering fields including robotics and hardware development * Proficiency in using query languages such as SQL, Hive, Pig * Excellent understanding of machine learning techniques and algorithms, such as k-NN, Naive Bayes, SVM, Decision Forests, etc. * Ability to clearly communicate across a variety of platforms * Experience working in a fast paced startup environment * A keen interest in robotics and sensors * Ability to speak confidently in front of large crowds Those interested should apply via this link https://angel.co/cleanrobotics/jobs/204016-data-scientist-machine-learning Innovation Works, Inc. Pittsburgh PA

Data Engineer - Location US East Coast

CGI Group Inc.