dmoz parser / dumps from 2017

[ghost]

Hi,

Hope you are all well !

Just wanted to share with you a dmoz dump parser in golang.
ref. https://github.com/lin11230/DMOZ/blob/master/dmoz_content_parser.go

I used it to build my own dump. But, I did not picked the description and title from the content.rdf.u8 as I wanted a fresh title/description for each link.

For sure, there is a space of improvement for this script.

Also, here is a dump of the latest tarballs from dmoz:

wget -r -l1 --no-check-certificate https://curlz.org/dmoz_rdf/

Cheers,
X

[boyter]

Neat. Cheers. I'll start work on this again in due time.