Why URL lists get messy
Exports from crawlers, Search Console, analytics, backlink tools and spreadsheets rarely agree on format. One list has http://Example.com/Blog/, another https://www.example.com/blog. To a computer these are different strings, so VLOOKUPs fail, duplicates hide, and redirect maps break. Normalising first saves hours.
What each option does
| Option | Before | After |
|---|---|---|
| Remove trailing slash | https://example.com/blog/ | https://example.com/blog |
| Add trailing slash | https://example.com/blog | https://example.com/blog/ |
| Force HTTPS | http://example.com | https://example.com |
| Remove www | https://www.example.com | https://example.com |
| Lowercase | https://Example.com/Shoes | https://example.com/shoes |
| Remove tracking | …/page?utm_source=x&id=2 | …/page?id=2 |
"Add trailing slash" skips URLs that end in a file extension (like .pdf or .html), because /guide.pdf/ would break.
Trailing slash: does it matter for SEO?
For Google, /blog and /blog/ are two different URLs. Neither is better — what matters is consistency. Pick one style, redirect the other with a 301, use the chosen style in internal links, canonicals and your sitemap. If both versions return 200 with the same content, you have a duplicate-content issue. Check how your server behaves with the Redirect Checker.
Be careful with lowercasing
Domain names are case-insensitive, but paths are case-sensitive on most Linux servers. Lowercasing is right when your site uses lowercase URLs (most CMSs do). If your site has mixed-case paths, untick the option, or /Products/ABC-123 may become a 404.
Typical uses
- Building a redirect map for a site migration.
- Comparing sitemap URLs with crawled URLs.
- De-duplicating a backlink export before outreach.
- Preparing a list for the Bulk HTTP Status Code Checker.
Everything runs in your browser. To strip only specific parameters, use the Query Parameter Remover.
Frequently asked questions
How do I remove trailing slashes from a list of URLs?
Paste your URLs one per line, choose Remove trailing slash and copy the cleaned list. The root URL keeps its slash-free form, and duplicates can be removed automatically.
Is a trailing slash better for SEO?
Neither form is better. Choose one, redirect the other with a 301, and use it consistently in internal links, canonical tags and your sitemap.
Will lowercasing URLs break links?
It can. Domains are case-insensitive, but paths often are not. Only lowercase if your site already uses lowercase URLs.
How many URLs can I clean at once?
Thousands. Processing happens in your browser, so the limit is your device memory, not a server quota.
Does it remove duplicates after cleaning?
Yes. Duplicates are removed after normalisation, so http://www.Example.com/ and https://example.com count as one URL.