[PR #308] Refactor list format to reduce the burden of maintaining the list #397

New Issue

saavagebueno · 2026-08-06T02:14:43-04:00

saavagebueno commented

2026-08-06 02:14:43 -04:00

📋 Pull Request Information

Original PR: https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/pull/308
Author: @Mangochicken13
Created: 12/28/2025
Status: 🔄 Open

Base: main ← Head: main

📝 Commits (10+)

33da4f4 start refactor to script-based organisation
8633189 start work on list-generator script
ecff372 split off subpages of sites & specific elements
6bdd24c split porn blocklist out of main file
992e48c create alphabeticicse helper script
765eee5 reorganise porn filter
70b4b68 move element list outside of url list folder
7c724da start content farm list
fafe57d actually save the content farm file
c1384c6 prep twitter file to be simplified

📊 Changes

36 files changed (+25291 additions, -7720 deletions)

View changed files

➕ .gitignore (+3 -0)
➕ Export/Nuclear_bing-list_uBlockOrigin.txt (+81 -0)
➕ Export/Nuclear_duckduckgo-list_uBlockOrigin.txt (+81 -0)
➕ Export/Nuclear_google-list_uBlockOrigin.txt (+81 -0)
📝 Export/Nuclear_list_uBlacklist.txt (+53 -40)
➕ Export/Nuclear_list_uBlockOrigin.txt (+5438 -0)
➕ Export/bing-list_uBlockOrigin.txt (+1811 -0)
➕ Export/duckduckgo-list_uBlockOrigin.txt (+1811 -0)
➕ Export/google-list_uBlockOrigin.txt (+1811 -0)
➕ Export/hosts-www.txt (+1182 -0)
➕ Export/hosts.txt (+1182 -0)
📝 Export/list_hosts.txt (+2368 -2304)
📝 Export/list_uBlacklist.txt (+1517 -1561)
➕ Export/list_uBlockOrigin.txt (+5438 -0)
➕ Lists/Common/_header.txt (+18 -0)
➕ Lists/Common/contentFarms.txt (+22 -0)
➕ Lists/Common/list.txt (+980 -0)
➕ Lists/Common/nsfw.txt (+155 -0)
➕ Lists/Elements/elements.txt (+23 -0)
➕ Lists/Nuclear/_header.txt (+8 -0)

...and 16 more files

📄 Description

Purpose

Addresses #204 and #164, and makes addressing #54 and #301 significantly easier (by just adding an entry to the ublock_formats dictionary in the new list_generator.py file (line 297)

Moving forward would also include looking at prefixing most, if not all urls with a . to address #158 and #198, and potentially changing the google wrapper to address #268

Changes

Lists have been split up into folders for:
- Common pages (ie. base urls that are shared between uBlockOrigin, uBlacklist, and hosts formats)
- SubPages (ie. specific subdomains, users, or blogs under a parent page)
- Nuclear (the nuclear option files shared between uBlockOrigin and uBlacklist)
- Elements (the extra elements blocked in the uBlockOrigin list)
The source lists have been split up from the original list.txt file to better sort and organise sites, and why they are on the list
The newly split lists have been (mostly) organized alphabetically under their headers, to better organize and de-duplicate page entries
- The YouTube list is a notable exception, as it has to be manually sorted due to the existence of channel names and channel ids
Python scripts have been created to "alphabeticise" the source lists, and compile these source lists into the blocklists under the Export/ directory.
- These currently have to be manually run by the maintainer, I am hoping to potentially work on the .githooks folder to have the generation run before committing files.

Regressions

The regex in the uBlacklist list are not currently preserved, this can be changed if deemed necessary before merging 9bb188e270/list_uBlacklist.txt (L1818-L1832)

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/pull/308 **Author:** [@Mangochicken13](https://github.com/Mangochicken13) **Created:** 12/28/2025 **Status:** 🔄 Open **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (10+) - [`33da4f4`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/33da4f4c22127233638edd8cbb72f76f786c9eec) start refactor to script-based organisation - [`8633189`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/863318918025cffec42edee9586b458ec8b7e428) start work on list-generator script - [`ecff372`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/ecff3721c36f220f38c6b04ad4440502462a1cbc) split off subpages of sites & specific elements - [`6bdd24c`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/6bdd24c7df9d2b07fbdaadbe84eb71a09659b654) split porn blocklist out of main file - [`992e48c`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/992e48c6f1a34d1a8f18486dfafa4a7c191e08c8) create alphabeticicse helper script - [`765eee5`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/765eee5c25cec0b1b0cdc844ab5fe9df85b957e7) reorganise porn filter - [`70b4b68`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/70b4b683a4c6609d6e12357d792bd4ceac1fcd09) move element list outside of url list folder - [`7c724da`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/7c724da25db78d52afb17c8cd35bfe6fa452ba78) start content farm list - [`fafe57d`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/fafe57dead5891e56c9a5d8a1469a74fe0a00c5b) actually save the content farm file - [`c1384c6`](https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/commit/c1384c64ea2aac90aeec56c0b63fafd9b34cb8f4) prep twitter file to be simplified ### 📊 Changes **36 files changed** (+25291 additions, -7720 deletions) <details> <summary>View changed files</summary> ➕ `.gitignore` (+3 -0) ➕ `Export/Nuclear_bing-list_uBlockOrigin.txt` (+81 -0) ➕ `Export/Nuclear_duckduckgo-list_uBlockOrigin.txt` (+81 -0) ➕ `Export/Nuclear_google-list_uBlockOrigin.txt` (+81 -0) 📝 `Export/Nuclear_list_uBlacklist.txt` (+53 -40) ➕ `Export/Nuclear_list_uBlockOrigin.txt` (+5438 -0) ➕ `Export/bing-list_uBlockOrigin.txt` (+1811 -0) ➕ `Export/duckduckgo-list_uBlockOrigin.txt` (+1811 -0) ➕ `Export/google-list_uBlockOrigin.txt` (+1811 -0) ➕ `Export/hosts-www.txt` (+1182 -0) ➕ `Export/hosts.txt` (+1182 -0) 📝 `Export/list_hosts.txt` (+2368 -2304) 📝 `Export/list_uBlacklist.txt` (+1517 -1561) ➕ `Export/list_uBlockOrigin.txt` (+5438 -0) ➕ `Lists/Common/_header.txt` (+18 -0) ➕ `Lists/Common/contentFarms.txt` (+22 -0) ➕ `Lists/Common/list.txt` (+980 -0) ➕ `Lists/Common/nsfw.txt` (+155 -0) ➕ `Lists/Elements/elements.txt` (+23 -0) ➕ `Lists/Nuclear/_header.txt` (+8 -0) _...and 16 more files_ </details> ### 📄 Description ## Purpose Addresses #204 and #164, and makes addressing #54 and #301 significantly easier (by just adding an entry to the ublock_formats dictionary in the new `list_generator.py` file (line 297) Moving forward would also include looking at prefixing most, if not all urls with a `.` to address #158 and #198, and potentially changing the google wrapper to address #268 ## Changes 1. Lists have been split up into folders for: - Common pages (ie. base urls that are shared between uBlockOrigin, uBlacklist, and hosts formats) - SubPages (ie. specific subdomains, users, or blogs under a parent page) - Nuclear (the nuclear option files shared between uBlockOrigin and uBlacklist) - Elements (the extra elements blocked in the uBlockOrigin list) 2. The source lists have been split up from the original `list.txt` file to better sort and organise sites, and why they are on the list 3. The newly split lists have been (mostly) organized alphabetically under their headers, to better organize and de-duplicate page entries - The YouTube list is a notable exception, as it has to be manually sorted due to the existence of channel names and channel ids 4. Python scripts have been created to "alphabeticise" the source lists, and compile these source lists into the blocklists under the `Export/` directory. - These currently have to be manually run by the maintainer, I am hoping to potentially work on the .githooks folder to have the generation run before committing files. ## Regressions - The regex in the uBlacklist list are not currently preserved, this can be changed if deemed necessary before merging https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist/blob/9bb188e2701138e03f73bacebd6b19b181ca0012/list_uBlacklist.txt#L1818-L1832 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

saavagebueno added the pull-request label 2026-08-06 02:14:43 -04:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: DYNR/uBlockOrigin-HUGE-AI-Blocklist#397