Sleepmode Sleepmode - 2 years ago 93
HTML Question

How do i parse this URL with beautiful Soup? What format is the URL?

I want to crawl some data from this type of url:

I don't know, it contains some kind of html-tags but i don't know how to actually scrape this page (i used beautifulSoup for my other urls).

Hope you can help me out.

Answer Source

The page you loaded is a JSON file. Use the JSON library like so:

import requests
import json

html = requests.get('')

# Load the parsed page into a JSON object.
steam_json = json.loads(html.text)

# Extract whatever you want like this:
success_status = steam_json['success']
Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download