Senior Back-end Engineer - Data/ML

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

A Lot About You:

The Senior Software Dev Engineer will analyze, program, debug and modify software enhancements and/or new products. You will have the opportunity to participate in the development of data platform designs with our team of Big Data engineers, and work in an agile scrum driven environment to deliver new and innovative products. You will design applications, write code, develop and test and debug, and document work and results. 

Responsibilities:

• Perform all phases of software engineering including requirements analysis, application design, and code development & testing  

• Design and implement reusable frameworks, libraries and components, product features in collaboration with business and IT stakeholders (25%)

• Develop and implement anomaly detection models using machine learning and statistical techniques (10%)

• Collaborate with cross-functional data engineers to improve data quality, ETL pipelines, and logging systems (10%)

• Define alerting mechanisms for automatic detection and response to anomalies. Conduct root cause analysis on detected anomalies to prevent future occurrences (10%)

• Interpret and visualize anomalies using dashboards (e.g., Looker Core, Looker Studio) (10%)

• Ingest data from various structured and unstructured data sources into Hadoop and other distributed Big Data systems (5%)

• Support the sustainment and delivery of an automated ETL pipeline and Validate data that is extracted from sources like HDFS, databases, and other repositories using scripts and other automated capabilities, logs, and queries (5%)

• Enrich and transform extracted data, as required. Monitor and report the data flow through the ETL process (5%)

• Perform data extractions, data purges, or data fixes in accordance with current internal procedures and policies (5%)

• Track development and operational support via user stories and decomposed technical tasks in a provided issue tracking software, including GIT, Maven, and JIRA (5%)

• Troubleshooting production support issues post-deployment and come up with solutions as required (5%)

• Mentor junior engineers within the team for development and delivery (5%)

Qualifications:

• Bachelor's degree or Master's degree in computer science or related discipline; or, equivalent experience

• Five years of related industry experience

• Experience in back-end programming, like Java, Python, and OOAD and ETL Tools

• Experience in Data analysis, data investigation and implementing data quality

• Strong Knowledge of GCP especially logging, alerting and metrics.

• Experience of working with large scale databases like Bigquery

• Knowledge and experience of Unix (Linux) Platforms and Shell Scripting

• Experience in writing Pig Latin scripts, MapReduce jobs, HiveQL etc. 

• Experience with Machine Learning frameworks

• Strong knowledge of anomaly detection algorithms

• Strong knowledge of visualization tools. (Looker Core, Looker Studio)

• Good knowledge of database structures, theories, principles, and practices

• Familiarity with data loading tools like Flume, Sqoop

• Knowledge of workflow/schedulers like Oozie, Airflow

• Analytical and problem solving skills, applied to Big Data domain

• Proven understanding with Hadoop, HBase, Hive, Pig

• Writing high-performance, reliable and maintainable code

• Expertise in version control tools like GIT

• Good aptitude in multi-threading and concurrency concepts

• Effective analytical, troubleshooting and problem-solving skills

• Strong customer focus, ownership, urgency and drive

#LI-AC1

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (

) or call . Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome. Check out our diversity and inclusion (

) page to learn more.

The compensation for this position ranges from $128,250.00 - $266,875.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.

Currently work for Yahoo? Please apply on our internal career site.