Evaluating the impact of design decisions on passive DNS-based domain rankings

Victor Le Pochat, Simon Fernandez, Tom Van Goethem, Samaneh Tajalizadehkhoob, Lieven Desmet, Andrzej Duda, Wouter Joosen, Maciej Korczyński

Presented at 8th Network Traffic Measurement and Analysis Conference (TMA 2024)

TMA 2024 Community Contribution Award

Download paper Download slides

'Top sites' rankings of the most popular domains are a core resource for the large-scale measurements that are crucial in Web and Internet research. Recent rankings evolved towards using passive DNS traffic data, but this data's suitability for measuring website popularity is poorly understood. In this paper, we holistically evaluate how design decisions influence the composition and desired properties of passive DNS-based domain rankings. We isolate the effects of these decisions by generating a ranking from the ground up using aggregated 'post-recursor' passive DNS data. We evaluate the impact of corrections for resolver caching and CDNs, and confirm that measures such as service classification, bucketing, or long-term aggregation produce more reliable rankings. Our goal is to give transparent insight into the process of using passive DNS data for domain rankings, as a framework for the research community to understand how to develop future rankings that address their needs.

Dataset: https://domain-ranking-design-decisions.distrinet-research.be/

DOI: 10.23919/TMA62044.2024.10559182

BibTeX:

@inproceedings{LePochat2024designdecisions,
author = {Le Pochat, Victor and Fernandez, Simon and Van Goethem, Tom and Tajalizadehkhoob, Samaneh and Desmet, Lieven and Duda, Andrzej and Joosen, Wouter and Korczyński, Maciej},
title = {Evaluating the impact of design decisions on passive DNS-based domain rankings},
booktitle = {8th Network Traffic Measurement and Analysis Conference},
series = {TMA '24},
year = 2024,
doi = {10.23919/TMA62044.2024.10559182}
}