Monday, 27 April 2009

Resolving DNS records

We need to resolve all www.DOMAIN and DOMAIN A records, mx records and ns A records.

102,359,087 domains... the set is currently limited to .com, .net and .org. The www.DOMAIN run just finished:


real 931m10.251s
user 722m37.686s
sys 123m5.790s


Not too bad! That's about 110K queries per minute on a single box. Lots of timeout though. The queries are sent to a local DJB dnscache. In the future, I'll probably split the resolve jobs between multiple machines at different ISPs.

0 comments:

Post a Comment