champions champions - 1 year ago 300
Python Question

How do I load session and cookies from Selenium browser to requests library in Python?

How can I load session and cookies from Selenium browser? The following code:

import requests

cookies = [{u'domain': u'',
u'expiry': None, u'path': u'/',
u'secure': True}]
response = requests.get(url2, cookies=cookies)

gives me the following exception:

Traceback (most recent call last):
File "F:\PYTHON\python_scripts\cookies\", line 23, in <module>
response = requests.get(url2, cookies=cookies)
File "C:\Python27\lib\site-packages\requests\", line 68, in get
return request('get', url, **kwargs)<br/>
File "C:\Python27\lib\site-packages\requests\", line 450, in request
prep = self.prepare_request(req)
cookies = cookiejar_from_dict(cookies)
File "C:\Python27\lib\site-packages\requests\", line 439, in cookiejar_from_dict
cookiejar.set_cookie(create_cookie(name, cookie_dict[name]))
TypeError: list indices must be integers, not dict

Answer Source

First you have to get the cookies from your driver instance:

cookies = driver.get_cookies()

This returns a set of cookie dictionaries for your session.

Next, set those cookies in requests:

s = requests.Session()
for cookie in cookies:
    s.cookies.set(cookie['name'], cookie['value'])
Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download