Data Science

How to effectively manage training data bias in Multimodal AI systems for retail?

SA Asked by Sarah Jenkins · 21-09-2023
0 upvotes 11,594 views 0 comments
The question

We are developing a multimodal recommendation engine that uses customer images, voice search queries, and past purchase history. We've noticed that the model often ignores the voice context and defaults to visual patterns, leading to repetitive suggestions. This "Modality Imbalance" seems to be a form of bias in our training set. How do we ensure the model gives equal weight to conversational intent? Are there specific loss functions or data augmentation tricks to balance text, audio, and visual features?

 

3 answers

0
BA
Answered on 23-09-2023

Modality imbalance often occurs because visual features are usually more "dense" than short text queries. To counter this, you can implement a "Balanced Multimodal Gradient Blend." This technique monitors the learning rate of each modality independently during training. If the vision branch starts over-performing or converging too quickly, the system automatically penalizes its loss weight, forcing the model to extract more information from the voice and text branches. Additionally, try "Cross-Modal Data Augmentation," such as generating synthetic text descriptions for your images, to provide the model with more aligned pairs to learn from. 

0
ST
Answered on 26-09-2023

Are you using a "Shared Embedding Space" like a Triplet Loss architecture to ensure that the voice query 'blue dress' is mathematically close to the actual pixels of a blue dress? 

CH 27-09-2023

Steven, we recently implemented Triplet Loss and noticed a massive improvement in our "Zero-Shot" retrieval capabilities. By forcing the audio embeddings of a brand name to cluster near the visual logos of that brand, the model finally stopped ignoring the voice inputs. We also added a "Modality Dropout" phase during training, which randomly hides the image data. This forced the model to rely solely on the voice and history, effectively "training its ears" so it doesn't just rely on its "eyes" for every single recommendation.

0
AM
Answered on 29-09-2023

I've found that using "Attention Maps" to visualize what the model is looking at helps identify bias. If it never "attends" to the text tokens, you know your fusion layer is the problem. 

SA 30-09-2023

Exactly, Amanda. Visualization is key. Using Grad-CAM on the vision side alongside attention weights on the text side really highlighted that our model was completely blind to adjectives.

Share your thoughts

Your email address will not be published. Required fields are marked (*)

Professional Counselling Session

Still have questions?
Schedule a free counselling session

Our experts are ready to help you with any questions about courses, admissions, or career paths. Get personalized guidance from industry professionals.

Request a Call Back

Search Online

We Accept

We Accept

Follow Us

"PMI®", "PMBOK®", "PMP®", "CAPM®" and "PMI-ACP®" are registered marks of the Project Management Institute, Inc. | "CSM", "CST" are Registered Trade Marks of The Scrum Alliance, USA. | COBIT® is a trademark of ISACA® registered in the United States and other countries.

World globe icon Country: Canada

Book Free Session