What Exactly Is Big Tech?

While many people associate "Big Tech" with the largest household names in the industry, the definition can, and should, be broader. This lesson provides a useful lens for identifying companies that operate like Big Tech, even if they’re not part of the traditional FAANG group.

- **Traditional Big Tech**: Commonly refers to the largest companies by market cap - *Microsoft, Google, Amazon, Apple, and Meta*. Sometimes Netflix is included (as in “FAANG”), but it's structurally different, e.g. Netflix historically had no engineering levels and treated everyone as senior engineers.
- **Critique of the FAANG Acronym**: Netflix is singled out as not entirely representative of "Big Tech" norms, being smaller in scale and structurally more unique than the others.
- **Broader Definition**: Companies with *$50B+ market cap* and *2,500+ engineers*, along with similar performance expectations, leveling systems, and engineering culture as the Big Five, should also be considered Big Tech. This includes companies like *Uber, Airbnb, and Stripe*.
- **Why This Matters**: Focusing only on the top 5–6 companies can be limiting. Many other companies now offer equivalent opportunities in terms of compensation, growth potential, and engineering culture, especially as they reach scale.

This broader perspective is helpful when evaluating job options and team culture - not all Big Tech companies are the usual suspects.

Machine Learning System Design Ask & Learn

**Event description**

Join us remotely for an interactive Q&A with Ilya Reznik—Founder of MLEPath, veteran ML engineer with nearly 15 years at Meta, Twitter, and Adobe, and interviewer of hundreds of real-world ML system design (MLSD) interviews (plus nearly 1,000 mock sessions in the last two years). Whether you’re tackling your first MLSD interview or leveling up for senior roles.

- **Core frameworks & approaches**: how to structure your end-to-end design, balance scalability, latency, cost, and reliability
- **Key components & trade-offs**: data pipelines, model serving, feature stores, monitoring, and A/B testing
- **Real-world insights**: pitfalls Ilya’s seen candidates fall into—and what top performers do differently
- **Live feedback**: get tailored advice on designing everything from recommendation systems to real-time anomaly detection

Perfect for ML engineers aiming to land roles at FAANG, startups, or anywhere that demands rock-solid system design chops. Come ready with your toughest questions—and leave with a clear, actionable roadmap for your next MLSD interview.

Learning From Mistakes

In this section, we reflect on how **mistakes and operational defects** became valuable sources of new input metrics at Amazon. Through a disciplined **Correction of Errors (CoE)** process, we turned setbacks into opportunities for learning, system improvement, and metric discovery.

### Key Takeaways:

- **We embraced mistakes as learning opportunities**: We openly discussed errors and failures—not to assign blame, but to understand what went wrong and how to prevent it next time.
- **We asked predictive questions**: For every defect, we asked: *What metric could have predicted or prevented this?* Often, the answer revealed a missing input metric that we needed to start tracking.
- **We built systems to measure what we were missing**: Once we identified a critical input metric, we prioritized building the tools and infrastructure to capture it—and ensured it was reviewed in our Weekly Business Review (WBR).
- **We used a structured CoE process**: The CoE included five steps—identifying the error, documenting and responding, root cause analysis (often using the “Five Whys”), developing corrective actions, and then implementing and monitoring those changes.
- **We integrated input metrics into operational reviews**: Many of the metrics that emerged from the CoE process became part of our regular metric reviews, helping us catch future problems early and improve reliability across systems.

This practice helped us create a culture where **defects became a trigger for innovation and deeper operational control**, not just patchwork fixes.

To dive deeper into Input Metrics Mastery and learn more from Bill and Colin, follow these links:

- Take the full course at their website: <https://workingbackwards.com/>
- Buy the book: <https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595>
- Bill's LinkedIn: <https://www.linkedin.com/in/bill-carr/>
- Colin's LinkedIn: <https://www.linkedin.com/in/colinbryar/>

Mine Customer Support Data

We expand beyond metrics mapping and customer experience mapping by introducing **additional, nuanced techniques** to help us continuously refine our input metrics. These customer- and defect-driven approaches give us real-world signals that are often overlooked—but are rich with opportunities for improvement.

### Key Takeaways:

- **We believe customer and shareholder interests are aligned**: At Amazon, we were driven by the conviction that obsessing over customers naturally serves the long-term interests of shareholders. This philosophy shaped our approach to metrics and improvement.
- **We treat every customer interaction as a source of insight**: Whether the "customer" is a buyer on Amazon or an internal team we support, we use their feedback to uncover meaningful input metrics that help us improve service and outcomes.
- **We mine customer support data as a diagnostic tool**: We tracked the top reasons customers contacted support—questions like “Where’s my stuff?” or complaints like “You sent the wrong item”—and used these to create new metrics such as “the switcheroo,” which measured item mix-ups.
- **We made problem frequency visible and actionable**: These contact reasons and metrics were reviewed weekly in our WBR, ensuring we remained focused on resolving the most impactful customer issues.
- **We talked directly to customer-facing teams**: We routinely engaged with customer support representatives to gather firsthand insights about recurring pain points by category—adding human intelligence to our data-driven approach.

These additional techniques may not generate as many metrics as mapping exercises, but they provide powerful context and depth to our understanding of what truly matters to customers.

To dive deeper into Input Metrics Mastery and learn more from Bill and Colin, follow these links:

- Take the full course at their website: <https://workingbackwards.com/>
- Buy the book: <https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595>
- Bill's LinkedIn: <https://www.linkedin.com/in/bill-carr/>
- Colin's LinkedIn: <https://www.linkedin.com/in/colinbryar/>

Amazon Metrics Map Example

In this lesson, we walk through **two core techniques—Metrics Mapping and Customer Experience Mapping**—that helped us systematically discover and define the input metrics that truly matter. These methods gave us a more granular, customer-focused way to understand and improve our business performance at Amazon.

### Key Takeaways:

- **We used Metrics Mapping to break down strategic goals**: Starting with broad objectives like lowering cost structure, we recursively drilled down to discover the specific drivers (e.g., shipping cost, pick cost, forecast accuracy) and converted them into measurable input metrics.
- **We cast a wide net during brainstorming**: In the early stages of metrics mapping, we didn’t worry about whether we could measure something yet or whether it was immediately useful. Our priority was to be comprehensive.
- **We built Customer Experience Maps to capture every user touchpoint**: From site entry to search, checkout, and delivery, we identified every customer interaction and defined metrics for speed, quality, and cost—measured both from the customer's and Amazon’s point of view.
- **We stayed grounded in the customer’s perspective**: Instead of focusing on internal outcomes like revenue per page view, we measured how intuitive, fast, and helpful each experience was for the customer, ensuring our metrics aligned with long-term value creation.
- **We operationalized customer obsession**: These techniques gave us a structured, measurable way to uphold our customer-obsessed culture. Other companies have found these frameworks to be transformative in how they assess and improve their own customer experience and operations.

To dive deeper into Input Metrics Mastery and learn more from Bill and Colin, follow these links:

- Take the full course at their website: <https://workingbackwards.com/>
- Buy the book: <https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595>
- Bill's LinkedIn: <https://www.linkedin.com/in/bill-carr/>
- Colin's LinkedIn: <https://www.linkedin.com/in/colinbryar/>

Define

In this section, we explain how we at Amazon adopted the **DMAIC process**—a structured Six Sigma methodology—to bring clarity and control to our increasingly complex operations. This approach helped us stay focused on what drives business performance, even as we scaled globally and diversified our offerings.

### Key Takeaways:

- **We turned to Six Sigma to manage complexity**: As Amazon grew from a book retailer into a multi-product, international company, we needed a structured way to measure, monitor, and improve our processes. Six Sigma’s DMAIC framework offered exactly that.
- **DMAIC became our operational foundation**: The five steps—**Define, Measure, Analyze, Improve, Control**—allowed us to break down complex systems into manageable parts, identify input metrics, and drive improvements with precision.
- **We embraced Donald Wheeler’s philosophy**: Following his principle that understanding variation is key to improvement, we focused on how changing inputs affects outputs, aligning our culture around continuous improvement.
- **We built clarity into invisible systems**: Since much of Amazon’s operations (software, fulfillment, logistics) were either virtual or distant, we created standard definitions and measurements to make the system’s performance tangible and actionable.
- **We aligned every part of our system to inputs**: From product selection and pricing to software reliability and delivery speed, we learned that managing the inputs across all departments ultimately shaped our outputs like revenue and customer satisfaction.

To dive deeper into Input Metrics Mastery and learn more from Bill and Colin, follow these links:

- Take the full course at their website: <https://workingbackwards.com/>
- Buy the book: <https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595>
- Bill's LinkedIn: <https://www.linkedin.com/in/bill-carr/>
- Colin's LinkedIn: <https://www.linkedin.com/in/colinbryar/>

Gilad’s Take: Missed Estimates

In this exercise, we explore how to manage an individual contributor who is consistently underperforming—missing estimates or failing in execution. This presents a valuable opportunity for us to create both individual and team-wide impact.

- We help the individual grow by **improving their estimation and execution skills**—through coaching, targeted training, mentorship, and root cause analysis.
- We aim to **understand the specific failure points** by collecting data and maintaining an open yet high-bar conversation with the individual.
- We don't just focus on the individual; we **expand our lens to the team**, recognizing that underperformance affects teammates who rely on timely outputs.
- To support the broader organization, we look for ways to **minimize the blast radius**, reducing the negative impact on the surrounding team while working toward resolution.
- This is about **maximizing delta**: helping one person improve while also protecting and enabling the rest of the group to thrive.

If you want to learn more from Gilad, he shares free leadership advice daily on [LinkedIn](https://www.linkedin.com/in/giladnaor/?utm_source=taro&utm_medium=course&utm_campaign=cta) and weekly on the[ δeltas newsletter](https://posts.managementdeltas.com/?utm_source=taro&utm_medium=course&utm_campaign=cta)

For SWE To ML Transitioners

In this final section on preparation strategy, we focus on how to transition successfully from software engineering into machine learning. Drawing on real experiences, we highlight practical, effective ways to stand out.

- **Lead with your strengths**: We already bring strong system design, coding, and production skills—qualities ML teams highly value. Hiring managers often prefer engineers moving into ML over scientists moving into engineering.
- **Leverage your current role**: Instead of relying only on side projects, we can grow by contributing to ML efforts at work—like model deployment, pipelines, or feature engineering.
- **Be selective with side projects**: One well-scoped project with clear business impact is far more compelling than several small tutorials.
- **Demonstrate your learning journey**: Show, don’t just tell—mention coursework, hands-on coding, and real applications of ML in your work.
- **Be honest and self-aware**: Interviewers appreciate curiosity and a growth mindset more than perfection. Let’s share where we are, what we’re learning, and how we’re applying it.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

ML System Design Framework

In this segment, we’re introduced to a powerful **5-part framework** for approaching ML system design interviews. This structured method ensures we address both technical depth and strategic thinking—key traits interviewers look for in strong candidates.

- **1. Problem Navigation**: We start by asking clarifying questions to understand functional and non-functional requirements, product goals, infrastructure constraints, and user experience. We define success metrics, state our assumptions, and frame the scope clearly.
- **2. High-Level Design**: We map business goals to ML objectives, walk through core system components (data ingestion, processing, modeling, inference, monitoring), and identify what needs to run in real-time versus batch.
- **3. Data Strategy & Feature Engineering**: We explain how data is collected and labeled, ensure data quality, and outline our approach to creating, storing, and updating features—including how we handle feature freshness and online/offline processing.
- **4. Modeling Approach**: We present specific model choices with trade-offs in interpretability, scalability, and accuracy. We detail training methods (batch, online, hybrid), address data distribution shifts, and outline infrastructure needs.
- **5. Evaluation, Deployment & Monitoring**: We describe offline evaluation strategies, deployment infrastructure (latency, model size, caching), and our plan for monitoring model health (drift, degradation) while tying results back to business KPIs.

Using this framework helps us think like **system-level ML engineers**, ensuring we cover everything from high-level goals to production-readiness with clarity and confidence.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

Role-Specific System Design Focus

In this part of the system design section, we explore how **ML system design interviews vary depending on the role and level** we’re applying for. Knowing what’s emphasized helps us tailor our preparation strategically.

- For **product-focused ML roles**, we focus on modeling choices, feature engineering, and connecting ML decisions to tangible business impact.
- **ML infrastructure roles** emphasize architecture, scalability, reliability, and serving systems—including distributed training and feature stores.
- **Research-oriented roles** dive into experimentation frameworks, novel modeling techniques, and how to transition prototypes into production.
- In **ML generalist roles** (common at startups or smaller teams), we’re expected to demonstrate a balanced understanding across the full ML lifecycle.
- Importantly, **interview expectations are tied more to seniority level than company size**—a senior role at a startup may involve deeper system questions than a junior role at a large tech company.

Next, we’ll learn a system design framework that can flex across these scenarios and help us organize our thinking effectively.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

Notebook Interview Example: Ad Click Prediction

In this final part of the section, we bring all the core concepts together through a realistic, end-to-end ML interview example. The walkthrough demonstrates how to apply best practices across the entire notebook round—from EDA to model evaluation—with clarity, intention, and real-world relevance.

- In **EDA**, we go beyond surface checks by exploring unique value counts, visualizing target distribution, spotting class imbalance, and identifying trends like CTR by device type—ensuring every insight informs downstream modeling.
- In **feature engineering**, we thoughtfully create new features (e.g., age buckets, time-of-day flags), handle multicollinearity, and tailor transformations based on domain intuition, not just standard recipes.
- During **model training**, we justify our choice of random forest for its robustness and interpretability, apply cross-validation and stratified splits, and run grid search for tuning—demonstrating intention behind every step.
- In **evaluation**, we use metrics that align with the problem (precision, recall, F1, AUC-ROC, confusion matrix) and interpret results in context, showing we understand the real-world stakes of false positives and negatives.
- For **follow-up questions**, we proactively discuss improvements (e.g., deeper models, richer features), production monitoring (CTR by segment, drift detection), and handling class imbalance—proving we think like end-to-end ML practitioners, not just coders.

This example illustrates how to move from “checking boxes” to demonstrating thoughtful, production-aware problem-solving under real interview conditions.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

Model Training

In this segment, we cover **model training**, a phase where many candidates fall into autopilot. To stand out, we need to show thoughtfulness, adaptability, and a clear connection between our choices and the problem at hand.

- **Mediocre performance** involves picking a default model (e.g., logistic regression or random forest), using out-of-the-box settings with no tuning or justification.
- **Strong candidates** choose models deliberately, explaining how their selection fits the **data characteristics, business goals, or system constraints**.
- We improve performance through **hyperparameter tuning**, using techniques like grid search or informed manual adjustments based on EDA insights.
- When appropriate, we apply **ensemble methods** (e.g., boosting, bagging, stacking) to push performance further.
- Most importantly, we demonstrate that our modeling choices are **intentional and grounded in context**, not just rote or random experimentation.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

Feature Engineering

In this part of the course, we focus on **feature engineering**, a critical area where interviewers differentiate between average and exceptional ML candidates. This is our opportunity to show not just technical skill, but creativity and judgment.

- **Mediocre feature engineering** relies on basic, mechanical steps—like one-hot encoding categoricals or normalizing numericals—without much customization.
- **Stellar candidates go further**, creating new features from raw data (e.g., extracting time-of-day from timestamps, or combining variables into meaningful interactions).
- We show thoughtfulness by **dropping irrelevant features**, checking for **multicollinearity**, and aligning features closely with the problem's objectives.
- We demonstrate versatility by handling **complex data types**—such as transforming freeform text, working with embeddings, or aggregating time series effectively.
- Ultimately, we recognize that **feature engineering can matter more than the model itself**, and our job is to shape the data so that the model can truly learn from it.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

Round Structure

In this section, we dive into one of the most important—and often most hands-on—parts of the ML interview process: the practical machine learning coding and modeling round. This is where we demonstrate how we think and work like real ML practitioners.

- We’ll usually work in a **Jupyter notebook environment**, either in a take-home format or during a live 60–90 minute session.
- The task typically involves a **real-world problem** like text classification or demand forecasting, where we're expected to deliver an end-to-end ML workflow.
- Unlike algorithm rounds, we’re **encouraged to use standard ML libraries** (e.g., pandas, scikit-learn, TensorFlow, PyTorch) to solve the problem efficiently.
- We’ll be evaluated on how we **explore data, engineer features, choose models, tune hyperparameters**, and **communicate our results**.
- This round is about **thinking like an ML practitioner**, showing that we can handle messy, ambiguous problems using practical tools to deliver meaningful solutions.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

The CLEAR Framework

In this part of the course, we learn how to speak about machine learning concepts in a way that’s clear, confident, and impactful. The instructor introduces a practical, repeatable framework—CLEAR—that helps us explain any concept with structure and depth.

- **C is for Conceptualize**: Start with a high-level, simple definition of the concept (e.g., logistic regression predicts binary outcomes).
- **L is for Link**: Connect the concept to related ideas or typical use cases, showing broader understanding.
- **E is for Example**: Provide a real-world application to ground the concept in practice.
- **A is for Advantages and Disadvantages**: Discuss trade-offs to demonstrate critical thinking.
- **R is for Result**: Explain how success is measured using appropriate evaluation metrics.

By using the CLEAR framework, we present ourselves as organized, knowledgeable, and experienced—even when discussing foundational topics.

If you want to learn even more from Yayun:

- Book 1 on 1 career guidance with her here: <https://calendly.com/your-friend-yayun/1on1>
- Follow her on LinkedIn: <https://www.linkedin.com/in/yayunjin/>

Before you challenge them, ask if they trust you yet.

You’ve seen this happen.\
A good idea, pushed too soon—and everything shuts down.

This section gives you the signal to look for before you push.\
And what to do if it’s not there yet.

**Want to go deeper?**

- Explore more tools and courses at [**Taha’s Method**](https://www.tahasmethod.com/) — from interview prep to leadership development.

- Follow me on [**LinkedIn**](https://www.linkedin.com/in/tahahussain/) and subscribe to my weekly newsletter, [**The Conscious Leader**](https://tahahussain.substack.com/), for more lessons like these.

- Get 30% off [**Top Tech Leader**](https://bit.ly/tarotopleader) with code **ILOVETARO** (exclusive for Taro members).

You listened. But not to what mattered.

It’s possible to replay the entire meeting in your head and still miss the thing they needed you to hear.

This isn’t about listening better.\
It’s about listening for something else entirely.

**Want to go deeper?**

- Explore more tools and courses at [**Taha’s Method**](https://www.tahasmethod.com/) — from interview prep to leadership development.

- Follow me on [**LinkedIn**](https://www.linkedin.com/in/tahahussain/) and subscribe to my weekly newsletter, [**The Conscious Leader**](https://tahahussain.substack.com/), for more lessons like these.

- Get 30% off [**Top Tech Leader**](https://bit.ly/tarotopleader) with code **ILOVETARO** (exclusive for Taro members).

They’re not resisting change. They’re protecting something.

It’s easy to think they’re pushing back just to be difficult.\
But more often, they’re trying to keep something from breaking.

This section slows the moment down.\
Just enough to ask: what might they lose if they say yes?

**Want to go deeper?**

- Explore more tools and courses at [**Taha’s Method**](https://www.tahasmethod.com/) — from interview prep to leadership development.

- Follow me on [**LinkedIn**](https://www.linkedin.com/in/tahahussain/) and subscribe to my weekly newsletter, [**The Conscious Leader**](https://tahahussain.substack.com/), for more lessons like these.

- Get 30% off [**Top Tech Leader**](https://bit.ly/tarotopleader) with code **ILOVETARO** (exclusive for Taro members).

Maximize Your Equity And Benefits In Tech [Part 23] - Conclusion

Congratulations on making it to the end of this course! Here are core points from the lesson:

- Know the details of your equity, 401k, and ESPP plans, and set calendar reminders for things like stock option expirations, enrollment windows, and rollover opportunities
- Automate what you can only after understanding your holdings—review RSU tax withholdings, grant docs, and whether you’re using pre-tax vs. Roth intentionally
- Explore advanced options like mega backdoor Roths if your 401k allows them, and ensure you're not missing out on your employer match or other benefits
- Review your health plan and associated perks like HSAs, FSAs, and wellness stipends, and use reminders to avoid letting free money go to waste

If you want to get additional support from Andy:

- [Connect with Andy on LinkedIn](https://www.linkedin.com/in/andymoranio)
- [Receive other bonuses, leave feedback, and/or sign up for Andy’s newsletter](https://subscribepage.io/taroequitycourse)
- [Schedule a consultation](http://adastrafp.com/contact-us/)

Build Deep Relationships Quickly In Tech [Part 10] - "Good To Know" People

You never know who's going to come in and completely change your career for the better. This lesson teaches you:

- What "good to know" connections are
- Why networking with these connections can actually be quite easy
- The most powerful way to identify "good to know" connections

Tech Career Growth Videos

Our instructional videos provide software engineers with insights needed for career growth. Masterclasses go incredibly in-depth on a specific tech topic while case studies are real examples from established engineering leaders.