Remove Special Characters from String in Python

Using filter() Function

The filter() function allows you to construct an iterator by filtering elements from a sequence. By combining it with str.isalnum(), you can remove special characters from a string effectively.

Example

# Remove special characters using filter() and isalnum()
input_string = "Hello@# World!!123"
clean_string = ''.join(filter(str.isalnum, input_string))
print("Original String:", input_string)
print("Cleaned String:", clean_string)

You can also try this code with Online Python Compiler

Run Code

Output

Original String: Hello@# World!!123
Cleaned String: HelloWorld123

Explanation

1. The filter() function checks each character of the string.
    
2. The str.isalnum() method ensures only alphanumeric characters (letters and numbers) are kept.
    
3. The join() function concatenates the filtered characters back into a string.

Using Regular Expressions

Regular expressions, commonly known as regex, provide a powerful & flexible way to pattern match & manipulate strings. In Python, the re module is used to work with regular expressions.

For example: 

import re


string = "Hello, world! This is a sample string with special characters: !@#$%^&*()_+"


# Remove special characters using regular expressions
new_string = re.sub(r'[^a-zA-Z0-9\s]', '', string)


print(new_string)

You can also try this code with Online Python Compiler

Run Code

Output:

Hello world This is a sample string with special characters 

In this example, we use the re.sub() function to remove special characters. The re.sub() function takes three arguments:

1. The regular expression pattern to match (in this case, `r'[^a-zA-Z0-9\s]'`)
 

2. The replacement string (an empty string `''` to remove the matched characters)
 

3. The input string

The regular expression pattern `[^a-zA-Z0-9\s]` matches any character that is not a letter (uppercase or lowercase), a digit, or a whitespace character. The caret `^` inside the square brackets negates the character set, meaning it matches any character not included in the specified set.

With a regular expression pattern, we can remove all special characters from the string in a single line of code. The re.sub() function replaces each matched special character with an empty string, effectively removing them from the string.

Note: Regular expressions provide a concise & efficient way to remove special characters, especially when dealing with a wide range of characters or complex patterns.

Using translate()

The translate() method is another built-in Python function that can be used to remove special characters from a string. It allows you to map each character in the string to a corresponding character in a translation table.

For example: 

import string


string_with_special_chars = "Hello, world! This is a sample string with special characters: !@#$%^&*()_+"


# Create a translation table
translation_table = str.maketrans("", "", string.punctuation)


# Remove special characters using translate()
new_string = string_with_special_chars.translate(translation_table)


print(new_string)

You can also try this code with Online Python Compiler

Run Code

Output:

Hello world This is a sample string with special characters 

In this example, we first create a translation table using the str.maketrans() function. The str.maketrans() function takes three arguments:
 

1. The first argument is a string specifying the characters to be replaced (in this case, an empty string "")
 

2. The second argument is a string specifying the corresponding replacement characters (again, an empty string "")
 

3. The third argument is a string specifying the characters to be removed (here, we use string.punctuation, which is a pre-defined string containing all the punctuation characters)
 

By providing an empty string for both the first and second arguments and string.punctuation for the third argument, we create a translation table that maps each punctuation character to None, effectively removing them.

We then call the translate() method on our string, passing the translation table as an argument. The translate() method applies the translation table to each character in the string, removing any characters mapped to None.

Note: Translate() with a pre-defined character set like string.punctuation makes it easy to remove a wide range of special characters without explicitly specifying each one individually.

Using str.isalnum()

The str.isalnum() method checks if a string contains only alphanumeric characters. By iterating through each character, you can exclude special characters and build a cleaned string.

Example

# Remove special characters using isalnum()
input_string = "Python@#$Programming!!!2023"
clean_string = ''.join(char for char in input_string if char.isalnum())

print("Original String:", input_string)
print("Cleaned String:", clean_string)

You can also try this code with Online Python Compiler

Run Code

Output

Original String: Python@#$Programming!!!2023
Cleaned String: PythonProgramming2023

Explanation

1. A generator expression iterates through each character in the string.
    
2. Characters are included only if they pass the isalnum() check.
    
3. The join() method creates the cleaned string from valid characters.

Using List Comprehension

List comprehension is a compact way of generating a list by filtering and transforming elements. It can also be used to remove special characters efficiently.

Example

# Remove special characters using list comprehension
input_string = "Learn@Python!#Code2024"
clean_string = ''.join([char for char in input_string if char.isalnum()])

print("Original String:", input_string)
print("Cleaned String:", clean_string)

You can also try this code with Online Python Compiler

Run Code

Output

Original String: Learn@Python!#Code2024
Cleaned String: LearnPythonCode2024

Explanation

1. The list comprehension iterates through each character in the string.
    
2. The isalnum() method filters only alphanumeric characters.
    
3. The join() function combines these characters into a clean string.
    

Key Benefit

List comprehension is concise and integrates seamlessly into Python code.

Using re.sub() for Custom Patterns

The re.sub() function from Python's re (regular expressions) module provides flexibility for defining custom patterns. It replaces all characters matching a given pattern.

Example

import re
# Remove special characters using re.sub()
input_string = "Clean$%^Code&123"
clean_string = re.sub(r'[^a-zA-Z0-9]', '', input_string)


print("Original String:", input_string)
print("Cleaned String:", clean_string)

You can also try this code with Online Python Compiler

Run Code

Output

Original String: Clean$%^Code&123
Cleaned String: CleanCode123

Explanation

1. The pattern [^a-zA-Z0-9] matches any character that is not a letter or number.
    
2. The re.sub() function replaces these characters with an empty string ('').
    
3. The result is a string containing only alphanumeric characters.

When to Use re.sub()?

Use re.sub() when you need advanced pattern matching or want to handle specific characters selectively. For instance, if you wish to allow spaces or certain punctuation marks, you can modify the regex pattern accordingly.

Frequently Asked Questions

What is the easiest way to remove special characters from a string in Python?

The easiest way is using the filter() function combined with str.isalnum(). This method requires minimal setup and works efficiently for basic alphanumeric filtering.

How can I remove specific special characters and keep others?

You can use the re.sub() function with a custom regex pattern to specify which characters to remove and which to keep. For example, to keep spaces, use re.sub(r'[^a-zA-Z0-9 ]', '', string).

Is there a performance difference between these methods?

For small strings, all methods perform similarly. However, re.sub() can handle complex patterns but might be slower for large strings due to regex overhead. The filter() and list comprehension approaches are faster for simpler tasks.

Conclusion

In this article, we discussed four simple methods to remove special characters from a string in Python. These methods—using the filter() function, str.isalnum(), list comprehension, and re.sub() for custom patterns are all effective for cleaning strings. Whether you're working on a simple task or need more complex pattern matching, you now have the tools to handle string sanitization in Python. 

You can also check out our other blogs on Code360.