vwhois: A Practical WHOIS Parser Conquering the Wilderness of All TLDs
DAY 1
15:00-
15:40
WHOIS is an important source of information for many kinds of Internet observation, including threat intelligence, incident response, and attack surface discovery, and it remains widely used even now that its successor, RDAP, has arrived.
However, WHOIS responses are intended to be read by humans, and field names and record structures vary endlessly across TLDs and registries. As a result, machine processing of WHOIS has been extremely difficult, to the point that WHOIS has been called a darkness, a swamp, and a labyrinth.
Various parsers have been developed from before 2000 to the present, but all of them are ad hoc implementations that work only in very limited situations.
We therefore systematically analyzed WHOIS responses collected from all 875 TLDs that support WHOIS, up to 100 per TLD. As a result, we found that the TLDs can be organized into eight strategies, and based on this classification we developed vwhois, a practical parser built with LLM assistance. vwhois covers every TLD for which WHOIS responses were observed, parses the information contained in the responses, extracts all fields, and stores them in a unified schema.
In this presentation, we will demonstrate the evaluation method used during the tool’s development as well as vwhois in action, and explain that comprehensive WHOIS parsing is possible for nearly all domains.
-
Location :
-
Track 3(Room 3)
-
-
Category :
-
Bluebox
-
-
Share :
Speakers
-
Hiroki Hada
羽田 大樹
Hiroki Hada has worked for 18 years at the Security Operation Center of NTT Security (Japan) KK. His expertise includes threat analysis, incident response, and pentest. He is currently active with the Red Team. He obtained his Ph.D. from the Information Institute of Security in 2019 and also served as a visiting lecturer there. His past achievements include presentations at Black Hat USA 2017 and Black Hat Europe 2018 and 2023's Arsenal.