PROCESSING APPLICATION
Hold tight! We’re comparing your resume to the job requirements…
![](/assets/us/pia-loader-70070f7fbc395192a0ea0981429749cc3fe46f3aa0c6fe8387b444b8b92e4375.png)
ARE YOU SURE YOU WANT TO APPLY TO THIS JOB?
Based on your Resume, it doesn't look like you meet the requirements from the employer. You can still apply if you think you’re a fit.
Job Requirements of Senior BigData Engineer:
-
Employment Type:
Full-Time
-
Location:
USA (Remote)
Do you meet the requirements for this job?
Senior BigData Engineer
A Little About Us
As a global email provider, Yahoo Mail is the ultimate Consumer Inbox with over 220 million users. It is the best way to access your email and stay organized from a computer, phone or tablet. We create technology that changes the internet while handling billions of inbound connections per day to manage trillions of messages requiring petabytes of efficient storage.
Yahoo Mail's vision: Be the best consumer email platform to help users run the business of their life.
The Yahoo Mail engineering team develops solutions powering our mail brands, including a next-generation infrastructure that we are 100% moving to a native public cloud architecture.The Mail Intelligence AI/ML platform is responsible for building intelligent, smart capabilities at scale to discover interests, reveal habits, and deeply personalize user journeys for Yahoo Mail and across the entire Yahoo’s ecosystem.
We are looking for innovative, entrepreneurial, and passionate engineers. We are engineers who strive to deliver to our users only the absolute best and are willing to meticulously refine the details to achieve this goal. While Engineering is a core puzzle piece, we believe that your passion and owner mindset is as crucial as the high engineering standards, code quality and world-class architectural skills that we expect from our engineering teams.
We process billions of mail messages using cutting edge algorithms in areas including but are not limited to: Natural language processing, GenAI, Large Language Models, Machine Learning techniques, big data processing in order of petabytes to: Extract information, build mail content and user knowledge, and interconnect different sources to identify, highlight and amplify what matters.
Our work spans many technical challenges highly rewarding and fulfilling to high-caliber engineers hungry for impactful problem statements.
You will build tools and workflows to make it easier to manage and act on this vast information. You will also be working on AI-based data infrastructure, supporting new functionalities on existing platforms, and mining data for analytics insights and product features.
Our Hadoop clusters are among the largest few in the world, at double-digit petabyte scale. Developing this infrastructure presents many technical challenges in the areas of efficient query processing, large-scale data processing, machine learning and modeling, as well as satisfying complex business rules.
If you are someone who is passionate about harnessing data at insane scale, enjoys working with new technologies, setting up petabyte data infrastructures and implementing new machine learning solutions and metrics systems, we want to hear from you!
Your Day:
Architect, implement, optimize and maintain large scale batch data processing pipelines processing billions of messages accounting for several PB of data on a daily basis.
You will research and develop innovative algorithms for information retrieval, processing and ranking.
Take end to end ownership of Machine Learning-based distributed data systems - especially focused on data pipelines for data collection, validation and active learning and batch inference.
Work with other engineers to implement algorithms and systems in an efficient way
Interact with data analysts, data scientists, product managers, and software engineers to understand business problems, technical requirements to deliver data solutions
Lead data investigations to troubleshoot data issues that arise along the data pipelines
Maintenance and improvement of released systems
Engineering consulting on large and complex warehouse data
You Must Have:
BS with 8+ years of relevant Industry experience/M.S. in Computer Science with 5+ years of relevant Industry experience. Computer Science graduate ideally with specialization in Data Engineering or Machine Learning
Experience in Hadoop technologies (Map/Reduce, Oozie, Pig, Hive, Spark, Kafka, HBase, Storm,).
Strong fundamentals: algorithms, distributed computing, data structure, database
Fluency with at least one of:Java/Python/C++
Self-driven, challenge-loving, detail oriented, teamwork spirit, excellent communication skills, ability to multitask and manage expectations
You May Have:
Experience in any of: machine learning, analytics, data mining, or data mart and warehouse
Experience with Deep Learning platforms (Tensorflow/Keras/Spark MLlib) and SQL/Unix/Shell
Experience with machine learning algorithms, NLP, and/or statistical methods a big plus
Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (
) or callAt Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion (
) page to learn more.The compensation for this position ranges from $128,250.00 - $266,875.00/yr and will vary depending on factors such as your location, skills and experience. The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions, in addition to equity incentives. Yahoo provides industry-leading benefits including healthcare, 401K savings plan, company holidays, vacation, sick time, parental leave and an employee assistance program. Eligibility requirements apply.Yahoo has a high degree of flexibility around employee location and hybrid working. In fact, our flexible-hybrid approach to work is one of the things our employees rave about. Most roles don’t require specific regular patterns of in-person office attendance. If you join Yahoo, you may be asked to attend (or travel to attend) on-site work sessions, team-building, or other in-person events. When these occur, you’ll be given notice to make arrangements.
If you’re curious about how this factors into this role, please discuss with the recruiter.
Currently work for Yahoo? Please apply on our internal career site.