Where LiveRamp landed on match quality
The researchers dug into the match rate vs. match quality question with one of the industry’s leading data onboarding tools, LiveRamp.
Methodology
The researchers used LiveRamp to match a 2019/2020 national voter file to online identifiers (Mobile Ad IDs, or MAIDs), and then targeted these MAIDs with in-app survey requests (a core LiveRamp offering).
The in-app surveys asked hard demographic questions from the voter file, such as age and gender, to see whether they matched with the voter file. The surveys were conducted with mobile ad IDs that had been successfully targeted with previous poll requests.
The overall sample of voter file-matched survey responses was 119 for one vendor (LiveRamp) and 1,176 for the other (Kochava) .
Results*
The results warrant scrutiny for any team using LiveRamp for data matching.
After comparing the age and gender recorded in the voter file with the data collected from in-app surveys, they matched at a rate of 21.8%. Kochava achieved a 12.8% rate.
The researchers use these results to evaluate the extent to which the delivered matches may correspond to the intended individuals. The study points out that if matches were done at random on a 5x2 demographic grid (two genders, five age groups), then the expected match accuracy would be 10% even if accuracy was random. That means LiveRamp and Kochava are matching age and gender successfully only 11.8 percentage points and 2.8 percentage points higher than this random-assignment benchmark, respectively.
We acknowledge that the study evaluated historical data and particular identity resolution workflows, and its results should not be read as an evaluation of LiveRamp's or Kochava's current technologies, products, or performance. Match quality may vary by product, dataset, matching methodology, use case, and time period. The findings nevertheless illustrate why advertisers may benefit from evaluating match quality alongside reported match rate.