Extract URL using regex?

Question

I have the following strings

1. !abc.com
2. abc.com!
3. Hey there this is .abc.com!. This is amazing

I am trying to find a way such that I can identify special characters before or after the end of the URL in the string and add in a space only if the special character is at the beginning or end of the string, e.g.

!abc.com -> ! abc.com
abc.com! -> abc.com !
Hey there this is .abc.com!. This is amazing -> Hey there this is . abc.com !.This is amazing

What would be a good way to handle this scenario?

I tried the following regex: re.match('^.*$',w). But this seems very generic. Any advice or suggestion would be greatly appreciated.

helpful [reference](https://stackoverflow.com/questions/14007545/python-regex-instantly-replace-groups) — Aven Desta, May 09 '21 at 21:17
Does this answer your question? [Regular expression to find URLs within a string](https://stackoverflow.com/questions/6038061/regular-expression-to-find-urls-within-a-string) — albert, May 10 '21 at 07:02

score 0 · Answer 1 · answered Jun 25 '21 at 14:00

The trick is to:

Find all URLs in the string
Build a new (empty) string
For every URL match
- Add the text up until the match
- Look just before the URL, add whitespace if needed
- Look just after the URL, add whitespace if needed
- repeat
Add the end of the original string

This should work:

import re
import string

# Your input texts + one extreme case with multiple URLs
texts = [
    "!abc.com",
    "abc.com!",
    "Hey there this is .abc.com!. This is amazing",
    "Hey there this is .abc.com!. This is amazing... Hey there this is .abc.com!. This is amazing",
]


# From (match any URL): https://www.regextester.com/93652
pattern = r"(http:\/\/www\.|https:\/\/www\.|http:\/\/|https:\/\/)?[a-z0-9]+([\-\.]{1}[a-z0-9]+)*\.[a-z]{2,5}(:[0-9]{1,5})?(\/.*)?"

# Loop the texts
for text in texts:

    # Start building the new text
    new_text = ""
    position = 0

    # Loop over the matches
    for match in re.finditer(pattern, text):

        # Extract the start and end positions of the match (URL)
        start, end = match.span()

        # Add until the start of this match
        new_text += text[position:start]

        # Check the character just before the match
        if start > 0:
            if text[start - 1] in string.punctuation:
                # Add a space
                new_text += " "

        # Add the actual match
        new_text += text[start:end]

        # Check the character after the match
        if end < len(text):
            if text[end] in string.punctuation:
                # Add a space
                new_text += " "

        # Move to the end of the match
        position = end

    # Add the end of the original string
    new_text += text[position:]

    # Show the new string
    print(new_text)

Output:

! abc.com
abc.com !
Hey there this is . abc.com !. This is amazing
Hey there this is . abc.com !. This is amazing... Hey there this is . abc.com !. This is amazing

Extract URL using regex?

1 Answers1