145 Open Source Beautifulsoup Software Projects

Pythonic HTML Parsing for Humans™

A Python library for automating interaction with websites.

Web Scraper in Go, similar to BeautifulSoup

Simple but useful Python web scraping tutorial code.

A framework for creating semi-automatic web content extractors

Simple yet powerful automation stuffs.

Türkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.

Tool designed to help identify incorrectly configured Django applications that are exposing sensitive information.

Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)

JavaScript + BeautifulSoup = JSSoup

Unofficial API for PornHub.com in Python

Scrape GSoC organisations using a single script.

lots of spider (很多爬虫）

Various python scripts, mostly geared towards dataviz.

Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!

A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.

A modern CSS selector implementation for BeautifulSoup

:notes: Unofficial python API for pitchfork.com reviews.

Web scrapper for Shutterstock and Getty Images.

📊Python script to analyze the contents of your Facebook data export

Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube

A supreme web bot, written in python, to grab a list of specified products, and checkout before they sell out!

:soccer: Instantly find :trophy:EURO 2016 live-streams & highlights, now a Web App!

extract data from html table

:newspaper: News at the command line

:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:

Tool to scrape linkedin

Python web-scraping library that wraps urllib2 and BeautifulSoup

Have fun tracking your project's stargazers

Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices

초보자들을 위한 웹크롤링 온라인 강의

智联招聘关键词搜索职位信息爬虫

🐤️ Lost Ark wait notifier

Scraper, Data and Analysis for "Analyzing 1000+ Greek Wines with Python"

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

Wikipedia API wrapper for references

An Inshorts API which provides news for different categories from the Inshorts Website. Built using Flask and Beautiful Soup.

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

web scraping tool for grailed.com

A scraper which scraps Ali Express

Python爬虫小项目汇总（招聘信息/电影信息/股票信息/天气信息/贴吧信息/图片信息/视频信息..）

抓取MM131美女写真图片，并将其保存至本地指定的文件夹中。

A modular template for scraping data from the web to send yourself scheduled email reports

:spider:some python spiders with BeautifulSoup or scarpy

Current repository contains all assignments, notes, quizzes and course materials from the "Python for Everybody Specialization" provided by Coursera and University of Michigan.

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

A Spider About Wechat Articles 、Official Accounts

Python app to help you become prudent in your spendings

A python instagram scraper which uses BeautifulSoup and JSON to scrape public instagram accounts

:books: A GoodReads.com Scraper script to get books reviews including text and rating.

The project is a spider that uses scrapy and beautifulsoup4 for crawl picture.

Use Python, Google Spreadsheet, Google Shortener and CALLR API to automate your apartment search in Paris.

Script to fetch webcomics and use them to create ebooks.

Techniques for Scraping the Web in Python

Automatically download Pixelarity templates :star:

【爬虫】基于Scrapy开发的微博（评论、转发、点赞）爬虫，可以批量抓取。

Download complete anime episodes

Fabulous Bot for Slack!

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

Python Scripts and Jupyter Notebooks

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

Script using requests module to register accounts to Slam Jam Socialism raffles.

A simple flask api for Atlas Obscura.

A dart port of the famous python library beautifulsoup

Scrapper and Parser for Indeed Jobs and Resumes using Python, BeautifulSoup and Selenium/Requests and storing and manipulating data using mongodb

🕸 List of mini projects that involve web scraping 🕸

Twitter-Bot-Selenium simulates the entry of a real person and perform the actions of Like, ReTweet, Follow and UnFollow using different keywords.

Pawn package manager for SA-MP

A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar

Automatically fetch metadata for your music collection and rename files accordingly

Programming in Python and Fundamentals of Software Development - Summer 2017

Scraping medium articles tagged under ML,DL and AI and performing Analysis

Lets learn web scraping and apply them in real application.

various web scrapers as examples

This Telegram-Bot answers python questions by using stackoverflow subjects.

Build a model which automatically classifies an article under Finance, Law, Fashion and Lifestyle, using the data from leading magazines for training the model.

A demo to use the BeautifulSoup Python package to get the book informations from websites

More than 50 web scraping examples using: Requests | Scrapy | Selenium | LXML | BeautifulSoup

:musical_note: Lyricaly gets Lyrics delivered to your Terminal for any Song. Uses Python beautifulsoup4 to scrap lyrics. pypi: lyricaly

Web Scraping using Python Data mining , Data Analyzing & Data Visualization of the collected Data, The python script is written to fetch all the individual categories the website , The code is written for fetching the data from the first page and it iterates to each and every pages of website ( activities, categories, count of bought), and I used statistical techniques for mathematically analysis and presenting the data into visualization

Web scrapping & Data Analysis on EDGAR, the Electronic Data Gathering, Analysis, and Retrieval system

Repository containing all the codes created for the lab sessions of CSE3020 Web Mining at VIT University Chennai Campus

CodeWarsProfileScraper. Only meant for practicing scraping.

A simple python script written using Selenium and BeautifulSoup to extract every horse's information in the races.

Flask App to scrape hrefs from websites and validate links

Python script for scraping product reviews

A Python wrapper for Indeed Job Search API

様々なサイトのスクレイピングチャレンジです

Web-scraping Udemy online courses using BeautifulSoup in Python and with a bash script that automates webscraping

Tools for accessing and using data from the University of Massachusetts Amherst. Unofficial.

create word clouds with wrodcloud-fa for twitter and telegram chat

Scrape job websites into a single spreadsheet with no duplicates.

:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

Scraping articles of medium and providing audio versions 📑 to 🔊 using django

A Reddit bot that transcribes tweets from comments and submissions links, mirrors their images and replies back with a formatted Markdown message.

A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.

Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre: :japan: :sushi: Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

A web scraper that exports your entire WhatsApp chat history.

This repository provides usage examples for the Python module Newspaper3k.

A collection of tools that you can use to collect data from Facebook