Data Engineering
Finding True Love with TrueView!
You know how you’re scrolling through a listing on a matchmaking app and this one profile just catches your eye? You click to check out the full profile. You’re Intrigued! You want to know more. And then there are times when you feel nothing, so you just keep scrolling? At shaadi.com we were wondering if…
Our Search for a better Search : ES Indexing Architecture
On our mission to ensure that millions meet their soulmates – ‘search‘ plays a crucial role in finding our perfect matches. But when we wanted to introduce new fields in ElasticSearch(ES) to add new search feature requirements, it wasn’t scalable with our old architecture. After going live, it would have taken us 4-5 days for the field…
Datadog Real User Monitoring (RUM) for a faster payment page
At Shaadi.com we focus a lot on customer experience and one of the key outcomes we strive to achieve is giving a seamless experience to our users across our website. In our effort to do that, we are working on – making our payment pages blazing fast! While planning this, one of the first things that…
ML Model Consumption Dilemmas: Part 1
Tuning Partner Preferences At times, pragmatically consuming ML models gets more challenging than the training process itself. In this series, we will discuss some of the unique problems we encountered in consuming our models and how we tackled those problems at Shaadi.com. In this part, we would look at a classic tuning issue on our…
Debugging Kafka Consumer Rebalancing Issue
I would like to share a debugging session we had for an issue related to Kafka consumer rebalancing. A few days ago we got an alert that the Shaadi Metric Beat (SMB) consumer lag is consistently increasing. The APM of the service showed that the service is going on and off. The container of the…
Movin’ Data is a Dream
Search is a big feature at Shaadi.com. It helps our matchmaking algorithms bring out the best matches and it gets our customers closer to finding their partners based on their preferences. Almost two years ago, our search was running on Solr and MySQL. Data sync between these two systems was rough. We had to sync…
