Senior Data Engineer

Urbint New York , NY 10001

Posted 2 weeks ago

At Urbint, our mission is to make communities more resilient. We do this by pairing external data with artificial intelligence to identify areas of high risk and prevent catastrophic loss for utilities and infrastructure operators across the country. We are a team of close-knit engineers, entrepreneurs, and data geeks who obsess over problem-solving, new technologies, and making a positive impact in our communities.

At Urbint, you will collaborate within a cross functional team of other software engineers, product designers, machine learning engineers and product managers to architect, create and maintain custom data pipelines, data lake(s) and a data warehouse to feed our customer facing applications and internal experimentation and modeling teams. Our data sources range from large, high security enterprise databases and storage services hosted by our customers to disparate open data from government organizations to proprietary third party aggregators and auditability and security are very important to their results. You will be working to solve direct customer needs and finding common abstractions to apply and guide the future of information at data driven organization.

Requirements

  • 8+ years of software development experience focused on web technologies including significant production work with Python
  • 3+ years of experience designing, building and maintaining enterprise data pipelines and/or warehouses
  • High level knowledge of machine learning algorithms and how ML models are built and deployed
  • Demonstrable knowledge of big data databases such as columnar data stores (e.g. Cassandra or BigTable) or Hadoop as well as SQL (MySQL, MSSQL or PostgreSQL) and ability to select the right tool for the job
  • Experience with queued work management and message processing (e.g., Kafka, RabbitMQ)
  • Experience working closely with product and account support personnel to help prioritize the best solutions to the largest problems.
  • Reliable organization and communication skills and follow through on verbal and written commitments.
  • Persistent approach to problem-solving and ability to see solutions through to completion even in the face of complexities or unknowns. A proactive mindset that drives you to pursue solutions rather than waiting for the answers to come to you.
  • Attention to detail in work and ability to identify ambiguities in specifications.
  • Exceptional written and verbal communication skills, especially when communicating trade-offs between technical decisions to non-technical colleagues.
  • Flexibility to work and maintain focus in an evolving environment. Ability to let go of previous projects and move on to new ones or to dig deeper into existing projects and grow them depending on the business needs.

Benefits

What We Offer:

  • Mission Driven- Some companies use AI to serve better digital ads and trade stocks, we seek to make our communities more resilient.
  • Top Compensation- Competitive compensation package.
  • Best in Class Medical Coverage- 100% benefits and premiums paid.
  • Prime NoHo Location- Our office sits in the heart of NYCs historic NoHo district and is just minutes away from the BDFM, 6, and RW subway lines.
  • Health Perks- Gym reimbursement and Citibike membership.
  • Strong Culture - collaborative office focused on teamwork, humility, and hustle.
  • Catered lunch on Thursdays, plus a kitchen filled with snacks and drinks.

We're an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

605

Posted 1 week ago

VIEW JOBS 8/14/2019 12:00:00 AM 2019-11-12T00:00 <p><strong>ABOUT 605</strong></p><p>At 605 we are engineers, analysts, data scientists, media experts, marketing strategists and political operatives. Our team of data scientists pioneered the field of TV data analytics. We offer unique, independent audience measurement and analytics to build better marketing and programming initiatives within the media and entertainment industries.</p><p>The Sr. Data Engineer at 605 must have a broad and deep data skillset as well as strong analytical capabilities . In addition to being a hands on individual contributor, the ideal candidate is a productive team player and a mentor to Junior. Data Engineers. Additionally, we are looking for strong technical experts.<br></p><p><br></p><p><strong>Responsibilities include:<br></strong></p><ul> <li>Actively participate in team technical discussions in all things data</li> <li>Identify and address issues with data sets from multiple vendors</li> <li>Identify and address code and data quality issues</li> <li>Actively participate in code reviews and grooming sessions </li> <li>Actively participate in technology architecture discussions for product development</li> <li>Translate business requirements into strategy</li> <li>Advocate for software best practices within your team as well as across engineering</li> <li>Be ultra-responsive and capable of making instant decisions, always kicking the ball forward </li> <li>Work on unique and interesting data challenges around architecting, building and managing pipelines that securely process hundreds of terabytes of data</li> <li>Work closely with analysts and statisticians to ensure the validity of our processes</li> </ul><p><br></p><p>Our engineers are expected to wear a number of hats and have the opportunity to touch all parts of the stack. Our stack includes Apache Spark, Scala, Redshift and an ever-growing list of many other cool technologies.</p><p><strong>Requirements</strong></p><ul> <li>Skillful user of Apache Spark</li> <li>Experience wrangling terabytes of big, complicated, imperfect data</li> <li>Experience with AWS products (Redshift, EMR, S3, IAM, RDS, etc)</li> <li>You have a deep understanding of scalable systems and you have large-scale engineering experience in an Agile development environment</li> <li>Bachelor's degree in Computer Science or a related field (or 4 additional years of relevant work experience)</li> <li>A strong understanding of data structures, algorithms, and effective software design </li> <li>Significant development experience with a major modern language (e.g. Java, Scala, Python, Ruby, C/C++, etc.)</li> <li>Significant experience working with structured and unstructured data at scale and comfort with a variety of different stores (key-value, document, columnar, etc.) as well as traditional RDBMSes and data warehouses</li> <li>Experience with or interest in AWS Glue, Redshift Spectrum and any other tools that enable data querying at scale</li> <li>Experience writing unit, functional and integration tests</li> <li>Comfort with version control systems (e.g. Git, SVN)</li> <li>Excellent verbal and written communication skills; must work well in an agile, collaborative team environment<br> </li> </ul><p><strong>Preferred Qualifications</strong></p><ul> <li>Master's in Computer Science or a related field</li> <li>Practical experience with supervised machine learning techniques</li> <li>Strong background with test-driven development</li> <li>Basic understanding of statistics and experience with statistical packages such as R, Matlab, SPSS, etc</li> </ul><p><strong>Benefits</strong></p><p><strong>Important and Standard</strong></p><ul> <li>Comprehensive health, dental and vision insurance for employees and their families</li> <li>Life &amp; Disability insurance</li> <li>401k plan with match, eligible for match after one year</li> <li>Pre-tax flexible compensation plan for medical, transit, parking or dependent care expenses</li> <li>Up to 15 paid vacation days depending on grade level</li> <li>7 paid sick days in a calendar year - if you’re sick, you stay home</li> </ul><p><strong>Other cool benefits</strong></p><ul> <li>4 work from home days/month</li> <li>A kitchen stocked with sodas, snacks, yogurt and other goodies</li> <li>A tight knit start up community who likes to eat! We celebrate everyone’s birthdays, have frequent team lunches, and do events in and out of the office</li> <li>605 is an active participant in conferences</li> </ul><p></p><p><strong>EEO STATEMENT<br></strong></p><p>At 605, we’re just as passionate about diversity as we are about pioneering the field of TV data analytics. We are committed to cultivating an environment of mutual respect and equal opportunity. All hiring and advancement decisions are made on the basis of qualification, merit, and business need.</p> 605 New York NY

Senior Data Engineer

Urbint