Data Engineer

Truedata Los Angeles , CA 90001

Posted 7 days ago

TrueData is a leading mobile data platform that works with app publishers who generate mobile data and the apps, agencies, brands, and ad tech companies who need that data for mobile ad targeting, optimization, and measurement. We provide app publishers with a platform to safely generate user insights and an incremental revenue stream while delivering mobile marketers high quality mobile data that boosts campaign ROI, at scale.

We are experiencing great momentum and on the back of our Series B we are aggressively expanding our team. Our Data & Analytics Engineer will be the next addition to TrueData and will report directly to our CTO, and will be based in Downtown LA.

Position

As a member of the engineering team you will be responsible for designing and developing scalable high-performance applications for processing, transforming, and analyzing multi-TB volumes of data generated by mobile applications, including: location data (GIS), identity, and audience data.

You will also be involved in prototyping and testing new products and services for prospective clients like Google, and building next generation analytics, visualization and BI tools for internal and external stakeholders.


As an early member of our growing engineering team, you will receive enormous exposure to new technologies and methods, and have the opportunity to grow immensely within the TrueData organization.

What youll be doing:

  • Create and maintain optimal data pipeline architecture
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Executing custom match analytics and retrieving custom data samples from multiple datastores, and working with external engineers at our clients (including Google, Oracle, Verizon, etc.) to ensure successful pilots.
  • Building the next generation of Data Visualization and Analytics tools at TrueData, including data density analysis for location Data (clustering, univariate analyses, etc), Time series analytics for API/S2S/SDK health monitoring, etc.
  • Managing and automating data ingestion and data delivery processes for new clients, products and services.
  • Administering cloud server architectures (databases and application servers)
  • Deploying and configuring our monitoring, security, deployment, reporting, and automation tools as required
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Keep our data separated and secure across national boundaries through multiple AWS regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

What were looking for in an ideal candidate:

  • Passionate about coding and solving problems using software and automation.
  • Youre eager to work with the rest of the TrueData team and our Clients to solve problems, execute on pilots & integrations, and grow the TrueData business.
  • You plow through multiple obstacles in a day, using a combination of persistence, research, problem-solving skills, and your own experience
  • You take pride in your work, and especially work that is completed, tested, and delivered
  • You are a sink for problems, rather than a source. You make your co-workers' jobs easier, not harder
  • You are available for and responsive to questions. You are professional and collegial in your communications
  • You like being the person that others rely on
  • You quickly learn new technologies as needed and recognize that you are engaged in timely, business-critical tasks
  • You are transparent in what you do. You discuss, document, and commit your work as needed
  • You recognize technology is a means to an end, not an end in itself. Tech is always for some end user, not for the engineer
  • Excited to work in DTLA.

Requirements

Qualifications & experience

  • We are looking for a candidate with 4+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
    • Experience with big data tools:Spark, Kafka, Hadoop, etc.
    • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
    • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
    • Experience with AWS cloud services: EC2, EMR, RDS, Redshift,Kinesis, SQS,S3,
    • Experience with stream-processing systems: Spark-Streaming etc.
    • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
    • Ensure AWS cost is managed effectively by refining the pipelines & execution strategies
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing big data data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
  • Code unit testing.
  • Experience with the following data types, structures and techniques is a big plus:
    • Time series data
    • Location Data (GIS)
    • ML/AI techniques such as Neural Nets, SVM, Linear/Logistic Regression
    • Association Rule Mining, etc. for both out of sample prediction as well as inference
  • Ability and willingness to understand, learn, and use new programming languages quickly.
  • Must be familiar with Linux shell, scripting, process monitoring and management, SSH.

Benefits

Salary is based on experience & skill level.

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Work From Home
  • Free Food & Snacks
  • Stock Option Plan
  • Transportation Stipend
icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

Atrilogy

Posted 2 days ago

VIEW JOBS 8/21/2019 8:32:01 AM 2019-11-19T08:32 <strong>Atrilogy Solutions Group’s Direct Client is looking for a Data Engineer's in Phoenix, Arizona, on a Contract to Hire OR Full TIME.</strong><br /> <br /> <strong>Data Engineer<br /> Phoenix ,AZ <br /> GC / Citizens </strong><br /> <br /> <strong>GREAT COMPANY !!! GREAT CULTURE !!! GREAT COMPENSATION !!!</strong> <br /> <br /> <strong>Job Description:</strong><br /> Data Engineers are engaged in all phases of the software development lifecycle which include; gathering and analyzing user/business system requirements, responding to outages and creating application system models. Data Engineers primary functions are to design, develop, document, test and debug new and existing software systems and/or applications for internal use, perform defect corrections (analysis, design, code).<br />  <br /> <strong>MINIMUM REQUIREMENTS</strong><br /> • Bachelor's degree or 4 additional years of related experience beyond the minimum required may be substituted in lieu of a degree<br /> • 6 or more years of software development experience demonstrating depth of technical understanding within Business Intelligence, ETL, and/or Data Engineering<br />  <br /> <strong>PREFERRED</strong><br /> • 6+ years experience developing, deploying and supporting high-quality, fault-tolerant data pipelines (leveraging distributed, data movement technologies and approaches, including but not limited to ETL and streaming ingestion and processing)<br /> • 2+ years experience with <strong>Hadoop Ecosystem</strong><br /> • 3+ years experience in a software engineer role, leveraging Java, <strong>Python</strong>, Scala or C++<br /> • 4+ years advanced distributed schema and SQL development skills including partitioning for performance of ingestion and consumption patterns<br /> • 4+ years experience with distributed NoSQL databases and event brokers (Apache Cassandra, Kafka, Graph databases, Document Store databases)<br /> • 2+ years experience with cloud-based data offerings<strong> (Amazon AWS</strong>, Google GCP, Microsoft Azure)<br /> • 3+ years experience with ETL Tools (Informatica, DataStage)<br /> • Experience with Agile Development Methodologies<br /> <br />  <br /> <strong>PRIMARY RESPONSIBILITIES:</strong><br /> • Utilizing technical expertise; Creates system requirements, performs design and analysis, and coding and unit testing of complex to highly complex system functionality and/or defect correction across multiple platforms.<br /> • Identifies ideas to improve system performance and impact availability.<br /> • Resolves complex technical design issues.<br /> • Provides functional and/or technical guidance in evaluating applications systems or evaluating requests for proposals.<br /> • Coordinates changes and influences and prioritizes tasks with business or technical departments.<br /> • Analyzes and influences technical, system, and/or user requirements.<br /> <br /> <br /> <br /> <br /> <span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">For immediate consideration please submit your resume in Word format, along with daytime contact information.  <strong>LOCAL CANDIDATES ONLY PLEASE</strong> unless you are willing to relocate yourself at your own expense. All submittals will be treated confidentially. Selected candidate may be asked to pass a comprehensive background, credit and/or drug screening.  Principals only, no third parties please.</span></span> <div align="center"> <hr align="center" size="2" width="100%" /></div> <br /> <span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">Established in 2000, Atrilogy Solutions Group, Inc. provides organizations of all sizes with high-quality, cost effective information technology (IT), business process and health care consulting and staffing services.  Our industry-leading service model combines experienced project managers with seasoned technical and functional consultants to eliminate client uncertainty and deliver superior value and results.<br />  <br /> Clients turn to Atrilogy for expertise in:</span></span> <ul> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">IT staffing and placement (Project Managers, Business Analysts, DBA’s, Developers, Quality Assurance and Testing, Software Configuration Management, etc.)</span></span></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">All major Enterprise Resource Planning packages (including Oracle, PeopleSoft, JD Edwards, SAP, Microsoft,  Lawson)</span></span></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">Health care consulting resources and services (including ICD-10)</span></span></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">Customer Relationship Management (CRM)</span></span></li> <li style="padding: 0; margin: 0;" style="padding: 0; margin: 0;" style="padding: 0; margin: 0;"><span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">Creative (Interactive Project Manager/Art Director, Information Architect, UI/UX Designer, Web/Graphic Design)</span></span></li> </ul> <span style="font-family:arial,helvetica,sans-serif;"><span style="font-size:11px;">Atrilogy has been recognized by <em>CRN</em> magazine as one of the nation’s fastest-growing IT solution providers and by <em>Inc.</em> magazine as one of the nation’s fastest-growing, privately-held companies. Based in Irvine, California, Atrilogy also has offices in Denver, Phoenix, and Atlanta.</span></span><br />   Atrilogy los Angeles CA

Data Engineer

Truedata