Solution Architect- Bigdata Engineering

Quantiphi Boston , MA 02114

Posted 5 months ago

Role: Solution Architect- Bigdata Engineering

Experience Level: 10 to 16 Years

Work location: Boston, MA

Employment Mode: Full Time/ Permanent

Responsibilities:

  • Work with and contribute to the Apache Hadoop and related open source communities
  • Design and build a hybrid cloud solution combining on-premise and in-cloud clusters on Google Cloud Platform (GCP)
  • Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact at our massive scale.
  • Build tools to ingest and process more than 1 trillion data units per day.
  • Design and develop next-gen storage and compute platforms used by dozens of engineering teams
  • Communicate with a wide set of teams, including Hardware, Network, Linux kernel, JVM, SiteOps teams, and cloud vendors.
  • Build advanced tooling for testing, monitoring, administration, and operations of multiple clusters across data centres, on-premise and in-cloud clusters
Requirement:
  • Hands-on experience in distributed systems and ingestion/migration.
  • Strong software development skills in at least one of: Java, C/C++, or Scala.
  • Expertise on DBs, DWH, micro services and platform Engineering technologies
  • BS, MS or PhD degree in Computer Science or Engineering, or equivalent experience.
  • Experience building and supporting large-scale systems in a production environment.

Good to have:

  • Running large infrastructure services on cloud- GCP/ AWS
  • Experience with OSS technologies such as HDFS, YARN, Tez, Flume, HBase, Spark, Zookeeper.
  • Solid knowledge of networking and Linux systems management.
  • Experience with operating system internals, file systems, disk/storage technologies and storage protocols.
    *
upload resume icon
See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Digital Solution Architect

Cognizant Technology Solutions

Posted 2 days ago

VIEW JOBS 1/15/2019 12:00:00 AM 2019-04-15T00:00 At Cognizant Digital Engineering, we ideateand develop innovative software solutions with our clients. Our softwaredevelopment approach follows a Lean-Agile process with DevOps culture. Workingin Cognizant Digital Engineering is fast paced and exhilarating. AtCognizant Digital Engineering, we believe that a small cross functional teammade up of a Product Manager, an Architect, pairs of Developers, and thenecessary domain experts like UI/UX designers or Big Data Analysts, can buildsoftware faster and with higher quality than having independently working silosof skills. A small team can also buildempathy for each other, increasing their ability to react to change coming fromeither the client, external market realities, or from the end user as weconsistently execute through build-measure-learn cycles. We arelooking for Product Managers (PM's) who will help bring our vision to life;someone who is flexible, curious, detailed and human-centered in theirapproach. The PM role is part leadership, project oversight, client management,and a thought-leader within a creative, fast-paced, and rapidly-changingenvironment. The PM will be client focused billable consultant driving productdevelopment in the lab or traveling to client locations. The idealcandidate is passionate about creating products that make a difference for ourclients. You have strong product instincts, excellent communication skills, aretechnically fluent and have a good understanding of common product designpatterns. You enjoy working collaboratively with designers and engineers in ourlabs or client locations. You're passionate about your product management, andenjoy helping others mature as seasoned product managers. You are comfortablewith ambiguity and moving forward with imperfect information. You excel at leadingwithout authority, effectively aligning team members as well as clientstakeholders and executives around a shared set of objectives to progress thegoal of shipping a product that delights its users. You judge your success bythe success of your team and the happiness of our clients. RequiredSkills / Experiences * Expertise and ability topromote DevOps, Agile and Lean culture and practice to transform productmanagement and software development within the group and with clients * Experience and ability todefine and develop new cloud-native products and services, including reusabledomain-specific microservices on Cloud Foundry * Experience in defining anddelivering cloud based products on at least one of leading cloud environmentsAmazon AWS, Microsoft Azure, Google Cloud, VMware, or OpenStack * Experience shippingsuccessful products, including defining vision, strategy, outcome-drivenproduct roadmaps and creating and managing backlogs * Experience articulating andvalidating product hypotheses * Deep user empathy and stronguser experience sensibilities * Demonstrated ability todefine and track KPIs and other measurable success criteria * Experience closelycollaborating with engineers and designers as part of small co-located teams * Demonstrated ability to getthings done in a rapidly changing environment * Ability to break downcomplex problems into actionable steps * Excellent verbal and writtencommunication skills and ability to adapt your communication style for the audience * Demonstrated ability toinfluence decision making in different contexts * Interest in coaching others * Ability to facilitatecollaborative decision-making in a workshop context * Ability to quicklyunderstand a specific client domain and identify the trends and opportunitiesin that space * Experience working directlywith clients and leading projects * Interest in coaching others;experience mentoring other PMs is a plus * Experience leading orsupporting user research * Experience working with orinside enterprise scale organizations a plus * Experience as a designer orengineer a plus * Flexibility to commute to thelocal Cognizant Labs, and to client premises Cognizant US Corporationis an Equal Opportunity Employer Minority/Female/Disability/Veteran. If you requireaccessibility assistance applying for open positions in the US, please send anemail with your request to CareersNA2@cognizant.com Cognizant Technology Solutions Boston MA

Solution Architect- Bigdata Engineering

Quantiphi