Big Data Engineer

Cirruslabs Hartford , CT 06101

Posted 6 days ago

We are CirrusLabs. Our vision is to become the worlds most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a dependable partner organization that delivers on commitments. We strive to maintain integrity with our employees and customers. Every action we take is driven by value. The core of who we are is through our well knit teams and employees.
You are the core of a values driven organization. You have an entrepreneurial spirit. You enjoy working as a part of well-knit teams. You value the team over the individual. You welcome diversity at work and within the greater community. You arent afraid to take risks. You appreciate a growth path with your leadership team that journeys how you can grow inside and outside of the organization. You thrive upon continuing education programs that your company sponsors to strengthen your skills and for you to become a thought leader ahead of the industry curve. You are excited about creating change because your skills can help the greater good of every customer, industry and community.

Requirements

  • 5-7 years of experience.
  • Hadoop
  • Hive
  • Data migration and extraction
icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

The Hartford

Posted 1 week ago

VIEW JOBS 10/17/2020 12:00:00 AM 2021-01-15T00:00 You are a driven and motivated problem solver ready to pursue meaningful work. You strive to make an impact every day & not only at work, but in your personal life and community too. If that sounds like you, then you've landed in the right place. Senior Data Engineer The Hartford is looking for a driven and motivated Sr. Data Engineer to join our Global Specialty Data Science team. The candidate will be part of our growing Data Science community providing analytical solutions to The Hartford's portfolio of data assets. Our challenging business problems require our team members to be excellent problem solvers and have a robust skill set beyond technical requirements. We're looking for someone energized to be a part of our purpose by providing clever ideas, delivering thoughtful solutions, and harnessing new-age technology. Overview of the Position The Global Specialty (GS) Data Science team is committed to exploring new ways to use data and analytics to solve business problems. The team utilizes a wealth of data, both internal and external, and predictive analytics in order to enhance claim outcomes, processes and the customer experience. As a Sr. Data Engineer, you will be an established thought leader through close partnerships with expert resources to design, develop, and implement data assets for a wide range of new initiatives in GS. The role involves heavy data exploration, proficiency with various tools, including SQL and Python, knowledge of service-based deployments and APIs, and the ability to discover and learn quickly through collaboration. There is a need to think analytically and outside of the box while questioning current processes and continuing to build on the individual's business acumen. There will be a combination of team collaboration and independent work efforts. This role involves interaction with data science partners as well as a wide range of business areas which include GS and IT. The successful candidate will own the data ETL process for analytics in the segment. We seek candidates with strong quantitative background and excellent analytical and problem solving skills. This position combines business and technical skills involving interaction with business customers, data science partners, internal and external data suppliers and information technology partners. Responsibilities * Identify and validate internal and external data sources for availability and quality. Work with SME's to describe and understand data lineage and suitability for a use case. * Create data assets and build data pipelines that align to modern software development principles for further analytical consumption. Perform data analysis to ensure quality of data assets. * Create summary statistics/reports from data warehouses, marts, and operational data stores. * Extract data from source systems, and data warehouses, and deliver in a pre-defined format using standard database query and parsing tools. * Understand ways to link or compare information already in our systems with new information. * Perform preliminary exploratory analysis to evaluate nulls, duplicates and other issues with data sources. * Work with data scientists to understand the requirements and propose and identify data sources and alternatives. * Produce code artifacts and documentation using Github for reproducible results and hand-off to other data science teams. * Propose ways to improve and standardize processes to enable new data and capability assessment and to enable pivoting to new projects. * Understand data classification, and adhere to the information protection and privacy restrictions on data. * Collaborate closely with data scientists, business partners, data suppliers, and IT resources. Experience & Skills Candidates must have the technical skills to transform, manipulate and store data, the analytical skills to relate the data to the business processes that generates it, and the communication skills to document & disseminate information regarding the availability, quality, and other characteristics of the data to a diverse audience. These varied skills may be demonstrated through the following: * Bachelor degree or equivalent experience in a related quantitative field * Experience accessing and retrieving data from disparate large data sources, by creating and tuning SQL queries. Understanding of data modeling concepts, data warehousing tools and databases (e.g. Oracle, AWS, Spark/PySpark, ETL, Big Data, and Hive) * Demonstrated ability to create and deliver high quality Python code using software engineering best practices. Experience with object oriented programming and software development a plus. Proficiency with Github and Linux highly desired. * Ability to analyze data sources and provide technical solutions. Strong exploratory and problem solving skills to check for data quality issues. * Determine business recommendations and translate into actionable steps * Self-starter with curiosity and a willingness to become a data expert * Demonstrate a passion to both learn new skills and lead discovery of the data research * Results oriented with the ability to multi-task and adjust priorities when necessary * Ability to work both independently and in a team environment with internal customers * Ability to articulate and train technical concepts regarding data to both data scientists and partners Equal Opportunity Employer/Females/Minorities/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age Sr Data Engineer - GE07BE The Hartford Hartford CT

Big Data Engineer

Cirruslabs