Sr. Data Engineer

John Wiley & Sons, Inc. Hoboken , NJ 07030

Posted 4 weeks ago

Job Title

  • Data Engineer


  • Hobken,NJ

In a rapidly changing world with long-embedded inequalities, education is increasingly important as a means of enabling opportunities, increasing mobility, and unlocking human potential. However, access to education is itself very unequal, with many college students experiencing barriers of time, money, preparatory resources, and access to support.

As a 200-year-old company focused on human knowledge, Wiley is not new to thinking about education in terms of long-term trends and opportunities. Right now, Wiley is building the enabling educational tools of the future, leveraging data and AI to provide students and instructors with affordable, personalized support for their learning journeys.


We are looking for a Senior Data Engineer to join Wiley's Adaptive Learning team. This team manages large amounts of data on learning objects and student learning interactions, performs or enables analyses of these data sets, and develops algorithms to power real-time adaptive learning and educational AI.

As a provider of adaptive learning services both within Wiley and to third-party products for over 8 years, we have a large and well-functioning set of data, pipelines, and applications, and many existing users of data and analytics across the organization. However, there is lots of opportunity to modernize and improve of our data systems, responding to evolving needs, new technologies, and opportunities to empower users across the organization. In this role, you will:

  • Care for and evolve our data pipelines & data representation within our Snowflake data warehouse as our source systems and applications change

  • Model and integrate new data sources as they come online

  • Help integrate existing data sources as needs arise

  • Ensure our data stores are reliable, secure, and current status is easily observable

  • Triage and resolve data incidents responsively based on severity of impact

  • Work with end users to translate needs and specifications into technical requirements and designs

  • Investigate, prioritize, plan, and deliver on modernization and enhancement opportunities, such as:

  • Moving to a new data workflow manager

  • Expanding the use of Spark and PySpark

  • Standing up new open source tools to enable data scientists, analysts, and other end-users to learn from our data

  • Partner with other data professionals to define and implement data management best practices

  • Mentor data engineers and other technical data users to build maturity in data usage

  • Work with great and technically savvy software engineers, systems engineers, data engineers, and data scientists

You'll be joining a team that prioritizes a high level of inclusion and mutual trust, and creates space for creativity and autonomy by building trust with our stakeholders. Whatever your background looks like, we are looking forward to seeing how you approach solving for the team's goals and needs. A good contributor to the team's success will:

  • Be able to work mostly autonomously on a wide range of projects, from data ingestion, through data modeling, out to designing for end user data needs

  • Work collaboratively with a diversity of stakeholders, technical and nontechnical

  • Work towards agility by understanding and prioritizing delivery goals, and responding to changes and new information by updating and communicating plans

  • Stay current on emerging technologies and techniques in cloud computing and data lake / data warehouse management

We believe these qualifications will help you succeed in this role:

  • Training in Computer Science or a related degree, or equivalent professional experience

  • Hands-on experience with managing a data warehouse, ideally Snowflake and/or Redshift

  • 4+ years' experience developing, scheduling, and maintaining ETL and ELT pipelines

  • 6+ years' experience modeling data in databases and data warehouses, including strong knowledge of dimensional modeling concepts

  • 6+ years' experience developing SQL scripts and procedures to process data, ideally Postgres or Snowflake variants

  • 3+ years' experience developing in Python and familiarity with software engineering best practices (test-driven design, object-oriented programming)

  • Experience with batch processing data pipelines

  • Experience with distributed data processing frameworks, especially Spark

  • Attention to detail and organization, planning, and project management skills

  • Strong verbal and written communication skills with both technical and nontechnical colleagues

Wiley is an equal opportunity employer and does not discriminate on the basis on race, color, creed, national origin, sex, sexual orientation, religion, age, disability or other legally protected status. Employment is contingent upon the successful completion of a background check and employment review.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Staff 2 Financial Services Data Science Data And Analytics

Ernst & Young LLP

Posted 6 days ago

VIEW JOBS 5/9/2021 12:00:00 AM 2021-08-07T00:00 EY is the only professional services firm with a separate business unit ("FSO") that is dedicated to the financial services marketplace. Our FSO teams have been at the forefront of every event that has reshaped and redefined the financial services industry. If you have a passion for rallying together to solve the most complex challenges in the financial services industry, come join our dynamic FSO team! The business problems our clients are facing today are not the same problems they have faced in the past. The rapid pace of development in AI and the technology that enables it has created an urgent need to innovate and adapt to the new global business paradigm. Financial institutions are looking to build smarter and more efficient ways to operate their business, create new revenue streams, and better manage risk, through new opportunities uncovered by their data. We believe that to fully unlock the potential of AI and advanced analytics we need to look not only at the application of AI, but also at the strategy level for how best to transform the enterprise into one that is technology and data focused and ready for the new age. Our clients' problems are becoming increasingly complex while at the same time the need to automate and streamline is rising. The opportunity As a member of the Advanced Analytics team, we'll look to you to provide our clients with a unique business perspective on how data science and analytics can transform and improve their entire organization - starting with key business issues they face. This is a high growth, high visibility area with plenty of opportunities to enhance your skillset and build your career. We provide constant room for growth through client engagements and personal development. Our practitioners develop and lead innovative techniques and methods, supporting both business and technology leaders. This role provides the unique opportunity to build a professional network, tackle complex issues, and drive cutting edge approaches across industry leading clients and domains. You will help our clients navigate the complex world of modern data science and analytics. What to expect You'll be working with a newly created team in truly uncharted territory. You will apply your knowledge and experience to support the delivery of key projects, build valuable relationships both within EY and with clients, and develop strong capabilities through both formal training and working with senior mentors and talented colleagues. You'll spend most of your time working with a wide variety of clients to help with designing advanced analytics solutions, undertaking proof-of-concepts, and implementing these solutions to help clients to compete effectively in this dynamic environment. Skills and attributes for success * Fostering an innovative and inclusive team-oriented work environment * Leading and coaching diverse teams of professionals with different backgrounds * Demonstrating in-depth technical capabilities and professional knowledge * Establishing strong relationships with the clients * Working in an entrepreneurial environment to pave your own career path To qualify for the role you must have * A bachelor's or master's degree * Around 1 or more years of related work experience in banking, capital markets, insurance or asset management space * Strong deep learning experience, particularly in applications of Neural Network architectures to Natural Language Processing, Computer Vision, Machine Intelligence and/or Reinforcement Learning * Strong understanding of data management and model evaluation and training techniques for Neural Networks. * Strong understanding of classical ML techniques like KNN, Kmeans, PCA, GBM, SVM and regression * Experience in one or more deep learning frameworks such as Pytorch, Torch, Caffe, Keras, or Tensorflow. * Solid engineering and coding skills. Ability to write high-performance production quality code. * Practical experience using the following tools and technologies: * SAS, R, Python, SPSS, MapR, Flume, Hue, Impala, predictive analytics, machine learning, artificial intelligence * Strong written and oral communication skills and the ability to articulate complex technical issues effectively and appropriately for a wide range of audiences. * Strong analytical and problem-solving skills * Ability to assimilate new knowledge * Ability to understand business challenges and translate them into value add analytics solutions * Excellent leadership and teaming skills * A willingness and ability to travel to meet client needs; travel is estimated at 80%-90% * Valid driver's license in the US * Valid passport Ideally, you'll also have * A degree in computer science, engineering, accounting, finance or a related field; MBA or MS degree preferred * Prior consulting experience What we look for We're interested in self-motivated and passionate leaders with a strong vision and desire to stay on the cutting edge of data technology and science. We are looking for individuals who aspire to build collaborative team environments and possess effective management skills while demonstrating in-depth technical capabilities and industry knowledge. If you have a genuine drive for helping consumers achieve the full potential of their data while working towards your own development, this role is for you! What working at EY offers We offer a competitive compensation package where you'll be rewarded based on your performance and recognized for the value you bring to our business. In addition, our Total Rewards package includes medical and dental coverage, both pension and 401(k) plans, a minimum of 15 days of vacation plus ten observed holidays and three paid personal days, and a range of programs and benefits designed to support your physical, financial and social well-being. Plus, we offer: * Opportunities to develop new skills and progress your career * Support and coaching from most engaging and knowledgeable colleagues in the industry * A collaborative environment where everyone works together to create a better working world * Excellent training and development prospects About EY As a global leader in assurance, tax, transaction and advisory services, we hire and develop the most passionate people in their field to help build a better working world. This starts with a culture that believes in giving you the training, opportunities and creative freedom to make things better. So that whenever you join, however long you stay, the exceptional EY experience lasts a lifetime. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, national origin, protected veteran status, disability status, or any other legally protected basis, in accordance with applicable law. Ernst & Young LLP Hoboken NJ

Sr. Data Engineer

John Wiley & Sons, Inc.