Tag: Kafka
Finding True Love with TrueView!
You know how you’re scrolling through a listing on a matchmaking app and this one profile just catches your eye? You click to check out the full profile. You’re Intrigued! You want to know more. And then there are times when you feel nothing, so you just keep scrolling? At shaadi.com we were wondering if…
Our Search for a better Search : ES Indexing Architecture
On our mission to ensure that millions meet their soulmates – ‘search‘ plays a crucial role in finding our perfect matches. But when we wanted to introduce new fields in ElasticSearch(ES) to add new search feature requirements, it wasn’t scalable with our old architecture. After going live, it would have taken us 4-5 days for the field…
Debugging Kafka Consumer Rebalancing Issue
I would like to share a debugging session we had for an issue related to Kafka consumer rebalancing. A few days ago we got an alert that the Shaadi Metric Beat (SMB) consumer lag is consistently increasing. The APM of the service showed that the service is going on and off. The container of the…
Movin’ Data is a Dream
Search is a big feature at Shaadi.com. It helps our matchmaking algorithms bring out the best matches and it gets our customers closer to finding their partners based on their preferences. Almost two years ago, our search was running on Solr and MySQL. Data sync between these two systems was rough. We had to sync…
