Fashion recommendation that adapts, follows trends and completes the look
The research context behind OutfitIQ: what earlier work achieved, where it stops, and how our four-engine system addresses the gap.
01Literature survey
Fashion recommendation has moved away from static profiles and towards systems that react to how users behave. Commercial platforms like Amazon Fashion, Zalando and ASOS offer filters, popularity rankings and collaborative filtering. These rely on generic user segments and rarely capture an individual's style or context.
Dynamic user modelling
Earlier studies show that personalisation improves when explicit preferences are combined with later user feedback [1], [2]. The timing of interactions also reveals how interests change [3]. These methods support dynamic profiles, but in fashion it matters how inferred behaviour affects what a user explicitly chose. A few weak clicks should not easily override a strongly stated preference.
Semantic and visual representations
Sentence-BERT introduced efficient sentence embeddings that can be compared with cosine similarity [4]. CLIP showed the value of shared image–text representations [5], and FashionCLIP adapted this to fashion concepts and product imagery [6]. Together they show that relationships beyond exact attribute matching can be captured. However, matching a product to a user's taste is a different task from deciding whether it works with other garments.
Fashion trend forecasting
Temporal models have been used to forecast fine-grained fashion trends from historical signals [7]. Inventory research shows that observed sales may under-represent demand when products go out of stock [8]. This motivates using retailer sell-out and restocking behaviour as an extra market signal, combined with recurrent models that capture short-term movement [9].
Outfit compatibility
Individually attractive garments do not automatically form a good outfit. Compatibility across multiple items has been learned with bidirectional LSTMs [10], and type-aware embeddings showed that compatibility depends on garment categories [11]. Recent Transformer models use self-attention to reason over complete outfits [12], [13]. Recommendation quality also depends on variety, not on repeating near-identical alternatives [14].
02Research gap
Personalisation, semantic product understanding, trend forecasting and outfit compatibility have largely been studied as separate problems. No single adaptive framework combines dynamic user profiling, personalised clothing recommendation, live market trend analysis and outfit-level compatibility, while keeping each decision distinct.
The table compares OutfitIQ with the main families of existing approaches.
| Approach | Adaptive user profile | Semantic product matching | Market trend signals | Whole-outfit compatibility | Integrated workflow |
|---|---|---|---|---|---|
| E-commerce platforms (filters, popularity, CF) | Partial | — | Popularity only | — | — |
| Dynamic user-modelling studies [1]–[3] | ✓ | — | — | — | — |
| Semantic / visual embedding models [4]–[6] | — | ✓ | — | Partial | — |
| Trend forecasting studies [7] | — | — | ✓ | — | — |
| Outfit compatibility models [10]–[13] | — | — | — | ✓ | — |
| OutfitIQ (proposed) | ✓ | ✓ | ✓ MRTF + GRU | ✓ | ✓ |
03Research problem
Online shopping has made clothing easier to buy but not easier to choose. Users face many similar products across retailers, each described with different categories, styles and colours. Without in-store assistance, they browse excessively, make poor style choices or lack confidence in what they pick.
- Cold start and changing taste: new users have no interaction history, and existing users' interests shift over time.
- Inconsistent product data: exact attribute matching misses suitable products that retailers describe differently.
- Invisible market movement: users cannot see which styles, colours or categories are gaining interest in the local market.
- Item-level only: most systems recommend single products and do not help combine garments into a complete outfit.
Research question How can user preference modelling, hybrid product recommendation, market-based trend analysis and outfit compatibility be combined in one adaptive system, so that online fashion discovery becomes more personalised, trend-aware and complete?
04Research objectives
Main objective
To design, implement and evaluate an integrated fashion-assistance system that combines dynamic preference learning, hybrid product recommendation, market-based trend analysis and outfit compatibility modelling, supporting more personalised and complete online fashion discovery.
Sub-objectives
Adaptive user modelling
Build a user profile from explicit onboarding, update it continuously from interactions, and expand it in a controlled way with machine learning, without overriding stated preferences.
Hybrid product recommendation
Collect and normalise products from multiple retailers, then rank them by structured preference match, fashion-tuned semantic similarity and product-information quality.
Market-oriented trend analysis
Detect which fashion attributes are gaining market interest by combining retailer restock and turnover behaviour with GRU-based temporal forecasting.
Whole-outfit compatibility
Generate complete, occasion-aware outfits from a selected garment using explainable fashion rules together with a learned visual compatibility model.
Overall, the system also contributes an integrated workflow that connects all four capabilities through continued user interaction.
05Methodology
OutfitIQ is built as four intelligent engines working across a shared workflow. The system first understands the user's preferences, then uses them to find suitable products from a normalised multi-retailer catalogue. In parallel it identifies emerging trends from market observations, and it can generate complete outfits from any selected product.
A. User preference analysis & dynamic modelling
During onboarding, users state preferred categories, colours, styles, occasions, brands and priorities. This forms the initial profile and supports personalisation before any behaviour is available. The profile then updates from views, clicks, saves, selections and dislikes, weighted by interaction strength and recency (30-day half-life):
Here wi is the interaction weight (view 1, click 2, save 3, select 4, dislike −2) and ai is the interaction's age in days. Learned weights L(a) are blended with onboarding choices O, and the onboarding influence λ(N) fades from 1.00 to 0.25 as interactions grow:
Scores below 0.30 are dropped and the top three per dimension are kept. A multi-label Logistic Regression model then predicts extra category, colour and style co-preferences using probability uplift over an empty-profile baseline. This produces the Final Enriched Preference Profile.
B. Product data collection & hybrid recommendation
Products from multiple online retailers are validated, deduplicated and standardised into one catalogue, with availability checks. Ranking combines three signals:
- Structured preference match U(u,p): weighted across category 0.30, style 0.25, colour 0.20, brand 0.15 and price 0.10, normalised only over the dimensions the user has.
- Semantic similarity M(u,p): an all-MiniLM-L6-v2 SentenceTransformer fine-tuned on fashion triplets (anchor, positive, negative), with attribute-conflict checks.
- Product-information quality Q(p): image, retailer link, description, price and availability completeness.
A product is only recommended when it has a positive structured match or strong semantic similarity. Diversification stops one retailer or near-duplicate products from dominating the list.
C. Trend analysis
Daily product observations are collected from 20 Sri Lankan fashion retailers using a four-stage extractor: Shopify JSON, JSON-LD, static HTML, then Gemini-assisted extraction. The data is cleaned and normalised separately from the recommendation catalogue.
- Market Restock–Turnover Factor (MRTF): a product that sells out and is restocked suggests demand, while stock that lingers at full price suggests low interest. MRTF is treated as a market indicator, not direct sales evidence.
- TrendNet: a GRU network that reads an attribute's last four share-of-assortment observations and predicts its direction of movement.
G is the TrendNet prediction and R the MRTF score for attribute a at time t. The resulting trend snapshots link directly to catalogue products to surface trending items.
D. Outfit compatibility & generation
When a user selects a garment, the mobile app sends the item, occasion and preferences to the outfit engine. The engine validates the item and works out the required structure: a top needs a bottom, a bottom needs a top, and a dress can stand alone. Outerwear, footwear or accessories get the core pieces added. Candidates are filtered by availability, category, price, colour and occasion, and pre-screened with pairwise checks.
The rule-based score covers style S, colour C, category structure K and occasion Q. For visual compatibility, each product image becomes a cached 512-dimensional FashionCLIP embedding, and an Outfit Transformer scores all items together, M(o):
Outfits are ranked by H(o) and diversity-reranked, and returned with score breakdowns and reason tags so users can see why an outfit works.
06Results
Each engine was evaluated on the task it is responsible for.
| Component | Metric | Result | Evaluation setting |
|---|---|---|---|
| Preference expansion | Average precision | 54.83% | 431 test users (from 2,439); 7,317 training rows |
| Preference expansion | Average recall | 11.92% | |
| Preference expansion | Hit rate | 91.96% | |
| Semantic ranking | Pretrained test accuracy | 71.60% | 19,641 H&M preference–purchase triplets, 80/10/10 split |
| Semantic ranking | Fine-tuned test accuracy | 85.29% | |
| Semantic ranking | Validation accuracy | 85.18% | |
| TrendNet (H&M) | Spearman IC | 0.4276 | 106 weeks, 80 attributes, 95 cutoffs (t = 16.51) |
| TrendNet (H&M) | Non-overlapping IC | 0.345 | 14 independent windows (t = 5.37) |
| TrendNet + MRTF (Sri Lanka) | 3-day IC / win rate | 0.237 / 80% | 23 days, 56 attributes; 95% CI [0.107, 0.371] |
| TrendNet + MRTF (Sri Lanka) | 5-day IC / win rate | 0.227 / 75% | Beat all four baselines |
| Outfit Transformer | Test accuracy | 66.2% | Polyvore Outfits (disjoint split) |
| Outfit Transformer | F1-score | 0.673 | |
| Outfit Transformer | Test ROC-AUC | 0.728 | |
| Outfit Transformer | Best validation ROC-AUC | 0.751 |
The Information Coefficient (IC) is a rank correlation, so 0.4276 is not the same as 42.76% accuracy. The combined TrendNet + MRTF engine outperformed random, current-share, recent-growth and restock-only baselines at both horizons.
07Technologies used
Machine learning & models
Data collection
Backend & data
Mobile app
Datasets
References
- S. Chakraborty et al., “Fashion Recommendation Systems, Models and Methods: A Review,” Informatics, vol. 8, no. 3, 2021.
- W. Lei et al., “Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems,” in Proc. ACM WSDM, 2020.
- J. Li, Y. Wang and J. McAuley, “Time Interval Aware Self-Attention for Sequential Recommendation,” in Proc. ACM WSDM, 2020.
- N. Reimers and I. Gurevych, “Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks,” in Proc. EMNLP-IJCNLP, 2019.
- A. Radford et al., “Learning Transferable Visual Models From Natural Language Supervision,” in Proc. ICML, 2021.
- P. J. Chia et al., “Contrastive language and vision learning of general fashion concepts,” Scientific Reports, vol. 12, 2022.
- Y. Ma et al., “Knowledge Enhanced Neural Fashion Trend Forecasting,” in Proc. ACM ICMR, 2020.
- J. R. Trapero, E. H. de Frutos and D. J. Pedregal, “Demand forecasting under lost sales stock policies,” Int. J. Forecasting, vol. 40, no. 3, 2024.
- K. Cho et al., “Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation,” in Proc. EMNLP, 2014.
- X. Han et al., “Learning Fashion Compatibility with Bidirectional LSTMs,” in Proc. ACM Multimedia, 2017.
- M. I. Vasileva et al., “Learning Type-Aware Embeddings for Fashion Compatibility,” in Proc. ECCV, 2018.
- R. Sarkar et al., “OutfitTransformer: Learning Outfit Representations for Fashion Recommendation,” in Proc. IEEE/CVF WACV, 2023.
- S.-I. Papadopoulos et al., “VICTOR: Visual incompatibility detection with transformers and fashion-specific contrastive pre-training,” J. Vis. Commun. Image Represent., vol. 90, 2023.
- Y. Zhao et al., “Fairness and Diversity in Recommender Systems: A Survey,” ACM Trans. Intell. Syst. Technol., vol. 16, no. 1, 2025.