Paul Tarjan Paul Tarjan - 1 year ago 60
Python Question

How to percent-encode url parameters in python?

If I do

url = "" + urllib.quote(query)

  1. It doesn't encode "/" to "%2F" (breaks OAuth normalization)

  2. It doesn't handle Unicode (it throw an exception)

Is there a better library?


From the docs:

urllib.quote(string[, safe])

Replace special characters in string using the %xx escape. Letters, digits, and the characters '_.-' are never quoted. By default, this function is intended for quoting the path section of the URL.The optional safe parameter specifies additional characters that should not be quoted — its default value is '/'

That means passing '' for safe will solve your first issue:

>>> urllib.quote('/test')
>>> urllib.quote('/test', safe='')

About the second issue, there is a bug report about it here. Apparently it was fixed in python 3. You can workaround it by encoding as utf8 like this:

>>> query = urllib.quote(u"Müller".encode('utf8'))
>>> print urllib.unquote(query).decode('utf8')

By the way have a look at urlencode