Skip to content

Commit 828cb04

Browse files
committed
Replace tldextract with simple awk script, to solve badly parsed urls
1 parent 6103ade commit 828cb04

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

.github/workflows/build.yml

+2-2
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ jobs:
5757
apt-key adv --keyserver keyserver.ubuntu.com --recv-keys CC86BB64
5858
add-apt-repository ppa:rmescandon/yq
5959
apt-get update
60-
apt-get install yq curl tldextract
60+
apt-get install yq curl
6161
EOF
6262
)"
6363
- name: Generate blocklist
@@ -68,7 +68,7 @@ jobs:
6868
get_domains() {
6969
curl -sSL "$1" |\
7070
yq e '.[].domain' - |\
71-
python -c 'import sys,tldextract as t; print("\n".join(t.extract(a).registered_domain for a in sys.stdin))'
71+
awk -F'.' -vOFS='.' '{ if ($1 ~ /^(*|(www))$/) { $1 = ""; print substr($0,2) } else { print } }'
7272
}
7373
7474
cat << EOF >| no_copycats.new

0 commit comments

Comments
 (0)