Big Data Technical Lead

Quantexa Boston , MA 02128

Posted 2 weeks ago

Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 6 years, 10 locations and 500+ employees later we still believe that today. We connect the dots within our Customers data using dynamic entity resolution and advanced network analytics to create context, empowering businesses to see the bigger picture and drive real value from their data.

Due to the continuous success and high demand from our customers, we are looking for a Senior Data Engineer with a proven track record to join the Quantexa family.

Typical responsibilities include:

  • Manage, transform, and cleanse high volume data.
  • Write defensive, fault tolerant and efficient code for data processing.
  • Automate data processing to enable on-going alerts on high-risk activity.
  • Present project results to clients both face to face and virtually.
  • Work very closely with data scientists to ensure efficient and effective delivery of solutions.
  • Use leading open source big-data tools, such as Spark, Hadoop, Scala and Elasticsearch. You should be comfortable with working with high profile clients, on their sites.
  • Work with our expert software development team to produce reusable applications.
  • Use emerging and open-source technologies such as Spark, Hadoop, and Scala.
  • Collaborate on scalability issues involving access to massive amounts of data and information.
  • Take on ad-hoc tasks as required for the running of a small, yet rapidly expanding business.
  • Leading a team and mentoring junior engineers.


What do I need to have?

  • Proven big data experience, either from an implementation or a data science prospective.
  • Excellent technical skills including expert knowledge of at least one big data technology such as Spark, Hadoop, or Elasticsearch.
  • Experience of building data processing pipelines for use in production hands off batch systems, including either (or preferably both) traditional ETL pipelines and/or analytics pipelines.
  • Strong coding experience in the likes of Scala, Java, or Python.
  • Strong client facing, communication and presentation skills.
  • Strong academic qualifications, high quality degree (2:1 or above) or equivalent.
  • Enthusiasm to learn and develop emerging technologies and techniques.
  • Exhibit strong technical communication skills with demonstrable experience of working in rapidly changing client environments.
  • Demonstrate strong analytical and problem-solving skills and the ability to debug and solve technical challenges with sometimes unfamiliar technologies.

Ideal candidates will also:

  • Have worked on a variety of complex data orientated projects for financial services clients.
  • Have a good understanding of Computer Science and preferable come from a software engineering background or other scientific degree incorporating IT modules (e.g. Maths/Physics)
  • Have exposure to Agile, especially SCRUM.
  • Arrive with experience at working with a variety of modern development tooling (e.g. Git, Gradle, Jenkins, Nexus) as well as technologies supporting automation and DevOps (e.g. Ansible, Chef, Puppet, Docker and a little bit of good old Bash scripting).
  • Have an excellent appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this.


    Why join Quantexa?

    We know that just having an excellent glass door rating isnt enough, so weve put together a competitive package as a way of saying thank you for all your hard work and dedication.

    We offer:

    • Competitive salary
    • Company bonus
    • Private healthcare, Life Insurance & Income Protection
    • Commuter Benefits
    • Free Calm App Subscription #1 app for meditation, relaxation and sleep
    • 401k with the company matching up to 5%
    • Annual leave + birthday off!
    • Ongoing personal development
    • Great WeWork Office Space & Company wide socials

    Quantexa is proud to be an Equal Opportunity Employer. Were dedicated to creating an inclusive and diverse work environment, where everyone feels welcome, valued, and respected. We want to hear from people who are passionate about their work and align with our values. Regardless of race, beliefs, colour, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness whoever you are, if youre a curious, caring, and an authentic human being who wants to help push the boundaries of whats possible, we want to hear from you.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data/Etl/Business Intelligence Developers/Engineers

Infosys LTD

Posted 7 days ago

VIEW JOBS 9/24/2022 12:00:00 AM 2022-12-23T00:00 <p>Job Description</p><p>Infosys is seeking Developers with skills in any of the following areas to be a part of our high growth path and creating digital solutions for our customers.</p><p>The skills are as follows:</p><p>ETL: Informatica/Datastage/Teradata</p><p>Business Intelligence: MSBI/PowerBI</p><p>Big Data: Hadoop/Python/Spark</p><p>The positions will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to implementation, transition and warranty. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.</p><p>Required Qualifications:</p><ul><li><p>Candidate may be located within commuting distance of the listed locations(Boston, MA, Malvern, PA, Jersey City, NA, New york, NY) or be willing to relocate to the area. This position may require travel in the US and Canada.</p></li><li><p>Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education</p></li><li><p>4 years of experience with Information Technology</p></li><li><p>Experience in any one of the technologies- ETL or Business Intelligence or Big Data</p></li><li><p>Hands on end-to-end implementation and work on DW projects, especially in data warehouse and/or DataMart developments with the skill specialty the candidate possesses.</p></li><li><p>Hands-on experience in SQL, Unix shell scripting</p></li><li><p>Knowledge and experience with full SDLC lifecycle</p></li><li><p>Experience with Lean / Agile development methodologies</p></li><li><p>U.S. citizens and those authorized to work in the U.S. are encouraged to apply.</p></li></ul><p>Preferred Qualifications:</p><ul><li><p>4+ years of experience in Project life cycle activities on development and maintenance projects</p></li><li><p>Previous experience working in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data</p></li><li><p>Able to exhibit an understanding of Data integration, Data Quality and data architecture</p></li><li><p>Experience in impact analysis due to changes or issues</p></li><li><p>Strong understanding and hands-on programming/scripting experience skills - UNIX shell, Perl, and JavaScript</p></li><li><p>ETL: Experience with design and implementation of ETL/ELT framework for complex warehouses/marts.</p></li><li><p>Knowledge of large data sets and experience with performance tuning and troubleshooting</p></li><li><p>Hands-on development, with a willingness to troubleshoot and solve complex problems</p></li><li><p>CI / CD exposure</p></li><li><p>Ability to work in team in diverse/ multiple stakeholder environment</p></li><li><p>Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams</p></li><li><p>Strong verbal and written communication skills</p></li><li><p>Experience and desire to work in a Global delivery environment</p></li></ul><p>The job may entail extensive travel. The job may also entail sitting as well as working at a computer for extended periods of time. Candidates should be able to effectively communicate by telephone, email, and face to face.</p><p>About Us</p><p>Infosys is a global leader in next-generation digital services and consulting. We enable clients in 46 countries to navigate their digital transformation. With over three decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.</p><p>To learn more about Infosys and see our ideas in action please visit us at</p><p>EOE/Minority/Female/Veteran/Disabled/Sexual Orientation/Gender Identity/National Origin</p><br> Infosys LTD Boston MA

Big Data Technical Lead