Willcode4cash icon

Screenscraping using CFScrape and BeautifulSoup

Willcode4cash | PRO | 07/27/17 03:15:18 AM UTC | 0 ⭐ | 312 👁️ | Never ⏰ | []
Python |

280 B

|

None

|

0 👍

/

0 👎

import cfscrape
from bs4 import BeautifulSoup
 
scraper = cfscrape.CloudflareScraper()
html = scraper.get('http://www.CloudflareProtectedDomain.com').content
parsed_html = BeautifulSoup(html, 'lxml')
for link in parsed_html.select('div.className1 div.className2 a'):
    link.get('href')

Comments