[Solved-5 Solutions] UnicodeEncodeError: 'ascii' codec can't encode character u'\xa0' in position 20: ordinal not in range(128)
Error Description:
UnicodeEncodeError: 'ascii' codec can't encode character u'\xa0' in position 20: ordinal not in range(128)
Solution 1:
UnicodeEncodeError: 'ascii' codec can't encode character u'\xa1'
in position 0: ordinal not in range(128) click below button to copy the code. By - python tutorial - team
- This error occurs when we pass a Unicode string containing non-English characters (Unicode characters beyond 128) to something that expects an ASCII bytestring.
- The default encoding for a Python bytestring is ASCII, "which handles exactly 128 (English) characters".
- This is why trying to convert Unicode characters beyond 128 produces the error.
- The good news is that we can encode Python bytestrings in other encodings besides ASCII.
- Django's smart_str function in the django.utils.encoding module, converts a Unicode string to a bytestring using a default encoding of UTF-8.
Here is an example using the built-in function, str:
a = u'\xa1'
print str(a) # this throws an exception click below button to copy the code. By - python tutorial - team
Results:
Traceback (most recent call last):
File "unicode_ex.py", line 3, in
print str(a) # this throws an exception
UnicodeEncodeError: 'ascii' codec can't encode character u'\xa1' in position 0: ordinal not in range(128)Solution 2:
- It will try to read file in ascii resulting in all too common: 'ascii' codec can't encode character u'\xa0' in position 111: ordinal not in range(128)
- After lots of trial and error we found a workaround that works. First of all check if we have this problem by executing:
import sys sys.getdefaultencoding()
click below button to copy the code. By - python tutorial - team
- if it comes back with 'ascii' then read on.
- Default encoding need to be changed. However this is only possible when sys module is reloaded.
Here is a complete solution:
import sys; reload(sys); sys.setdefaultencoding("utf8") click below button to copy the code. By - python tutorial - team
Solution 3:
- We need to read the Python Unicode HOWTO This error is the very first example ,
- Basically, stop using str to convert from unicode to encoded text / bytes.
- Instead, properly use .encode() to encode the string:
p.agent_info = u' '.join((agent_contact, agent_telno)).encode('utf-8').strip()
click below button to copy the code. By - python tutorial - team
- Or work entirely in unicode.
Solution 4:
- After googling around we figured the following and it helped. python 2.7 is in use.
# encoding=utf8
import sys
reload(sys)
sys.setdefaultencoding('utf8') click below button to copy the code. By - python tutorial - team
Solution 5:
- We just had this problem, and Google led me here, so just to add to the general solutions here, this is what worked for us:
# 'value' contains the problematic data
unic = u''
unic += value
value = unic click below button to copy the code. By - python tutorial - team
Learn python - python tutorial - python unicode encode error - python examples - python programs