Skip to main content

Recommendation Systems 101

· 3 min read
Eric Ngo
Eric Ngo
ML Engineer @dodo, ex-ML engineers @Meta/Samsung-Research/7-11

What is a Recommendation System?​

At its heart, a Recommendation System (RecSys) is an engine for personalization. While traditionally defined as a tool for predicting user preferences, its true purpose in the modern digital landscape is to curate a unique, individualized experience for every user.

Instead of a "one-size-fits-all" interface, a RecSys transforms a platform into a living environment that adapts to each user's specific tastes, behaviors, and evolving needs. It acts as a bridge between a massive, often overwhelming catalog of choices and the unique intent of the person interacting with it.

Why is it Important and Valuable?​

In the age of "Infinite Scroll" and "Paradox of Choice," the value of a recommendation system cannot be overstated. It is often the primary driver of both user satisfaction and business growth.

1. Delivering Human-Centric Value​

  • Reducing Cognitive Load: By surfacing what's relevant, a RecSys saves users from the "choice paralysis" that comes with too many options.
  • Discovery and Serendipity: A great system doesn't just show you what you know you like; it introduces you to "the next big thing" you didn't even know existed.
  • Contextual Relevance: Modern systems understand that a user's needs change based on time, location, and device, providing the right recommendation at the right moment.

2. Driving Business Impact​

The implementation of an effective recommendation engine often results in a massive shift in key business performance indicators:

  • Revenue and Conversion: personalization directly correlates with higher conversion rates. When users see products they actually want, they are significantly more likely to purchase.
  • Customer Lifetime Value (CLV): By consistently providing value through personalization, businesses build deep trust and loyalty, keeping users on the platform for years rather than months.
  • Operational Efficiency:
    • Inventory Liquidity: Surfacing the "long tail" of products reduces dead stock and ensures a more diverse range of items are sold.
    • Automated Curation: Reduces the need for manual, rule-based merchandising which is impossible to scale at the individual level.
  • Data-Driven Insights: The feedback loop from a RecSys provides invaluable data on market trends and user preferences, informing future product development and marketing strategies.

The impact is measurable and profound: industry leaders often attribute 30% to 75% of their total revenue to personalized recommendations.

Simple Rec-Sys Algorithms​

Starting with recommendation systems doesn't always require complex deep learning. Here are the foundational approaches:

1. Collaborative Filtering (CF)​

This approach is based on the idea that "if User A and User B have similar tastes in the past, they will likely have similar tastes in the future."

  • User-Based: Find similar users and recommend what they liked.
  • Item-Based: Find items similar to those the user has interacted with based on other users' behaviors.

2. Content-Based Filtering​

This method uses item features (e.g., category, price, description) and user profiles to make recommendations. If you like "Action Movies," the system will recommend more "Action Movies" regardless of what other users do.

3. Popularity-Based (Heuristics)​

The simplest form of recommendation: show everyone the "Trending" or "Best Selling" items. While not personalized, it's a strong baseline and effective for new users (the "Cold Start" problem).

Next read​