Open Source Libs
Find Open Source Packages
Open Source Libraries
👉
Beautifulsoup
145 Open Source Beautifulsoup Software Projects
Free and open source beautifulsoup code projects including engines, APIs, generators, and tools.
Requests HTML
12325 ⭐
Pythonic HTML Parsing for Humans™
Mechanicalsoup
3884 ⭐
A Python library for automating interaction with websites.
Anaskhan96 Soup
1704 ⭐
Web Scraper in Go, similar to BeautifulSoup
Easy ScrAPIng Tutorial
645 ⭐
Simple but useful Python web scraping tutorial code.
Scrapple
474 ⭐
A framework for creating semi-automatic web content extractors
Python Automation Scripts
358 ⭐
Simple yet powerful automation stuffs.
Turkce Python Kaynaklari
362 ⭐
Türkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.
Djangohunter
230 ⭐
Tool designed to help identify incorrectly configured Django applications that are exposing sensitive information.
Bet On Sibyl
199 ⭐
Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
Jssoup
259 ⭐
JavaScript + BeautifulSoup = JSSoup
Pornhub API
223 ⭐
Unofficial API for PornHub.com in Python
Gsoc Organisation Scraper
122 ⭐
Scrape GSoC organisations using a single script.
Hive
111 ⭐
lots of spider (很多爬虫)
Pudzu
104 ⭐
Various python scripts, mostly geared towards dataviz.
Codingforentrepreneurs Web ScrAPIng
99 ⭐
Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!
Daftlistings
101 ⭐
A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Soupsieve
115 ⭐
A modern CSS selector implementation for BeautifulSoup
Michalczaplinski Pitchfork
67 ⭐
:notes: Unofficial python API for pitchfork.com reviews.
Shutterscrape
97 ⭐
Web scrapper for Shutterstock and Getty Images.
Facebook Data Analyzer
77 ⭐
📊Python script to analyze the contents of your Facebook data export
Souqscraper
162 ⭐
Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube
Supremedropbot
72 ⭐
A supreme web bot, written in python, to grab a list of specified products, and checkout before they sell out!
Euro2016_terminalapp
54 ⭐
:soccer: Instantly find :trophy:EURO 2016 live-streams & highlights, now a Web App!
HTML Table Extractor
67 ⭐
extract data from html table
News At Command Line
49 ⭐
:newspaper: News at the command line
Bookingscraper
59 ⭐
:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:
Linkedin Scraper
71 ⭐
Tool to scrape linkedin
Beautifulscraper
40 ⭐
Python web-scraping library that wraps urllib2 and BeautifulSoup
Track Stargazers
38 ⭐
Have fun tracking your project's stargazers
Data Wrangling With Python
71 ⭐
Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices
Webcrawlingstudy
37 ⭐
초보자들을 위한 웹크롤링 온라인 강의
Zhilian_spider
34 ⭐
智联招聘关键词搜索职位信息爬虫
Lostark Wait Notifier
35 ⭐
🐤️ Lost Ark wait notifier
Greek Wines Analysis
34 ⭐
Scraper, Data and Analysis for "Analyzing 1000+ Greek Wines with Python"
Non API Fb Scraper
39 ⭐
Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Wikipedia Reference Scraper
33 ⭐
Wikipedia API wrapper for references
Inshorts API
44 ⭐
An Inshorts API which provides news for different categories from the Inshorts Website. Built using Flask and Beautiful Soup.
Universityrecruitment Ssurvey
35 ⭐
用严肃的数据来回答“什么样的企业会到什么样的大学招聘”?
Grailer
30 ⭐
web scraping tool for grailed.com
Ali Scraper
36 ⭐
A scraper which scraps Ali Express
Pyproject
50 ⭐
Python爬虫小项目汇总(招聘信息/电影信息/股票信息/天气信息/贴吧信息/图片信息/视频信息..)
Grab_beautiful_girls_pictures
34 ⭐
抓取MM131美女写真图片,并将其保存至本地指定的文件夹中。
Email Report
34 ⭐
A modular template for scraping data from the web to send yourself scheduled email reports
Yangzhedi Pythonspider
28 ⭐
:spider:some python spiders with BeautifulSoup or scarpy
Coursera Python For Everybody Specialization
70 ⭐
Current repository contains all assignments, notes, quizzes and course materials from the "Python for Everybody Specialization" provided by Coursera and University of Michigan.
Tieba Birthday Spider
27 ⭐
百度贴吧生日爬虫,可抓取贴吧内吧友生日,并且在对应日期自动发送祝福
Alihanniba Wechat_articles_spider
25 ⭐
A Spider About Wechat Articles 、Official Accounts
Bahi Khata
23 ⭐
Python app to help you become prudent in your spendings
Selenabot
24 ⭐
A python instagram scraper which uses BeautifulSoup and JSON to scrape public instagram accounts
Omareinea Goodreadsscraper
34 ⭐
:books: A GoodReads.com Scraper script to get books reviews including text and rating.
Scrapy Picture Spider
25 ⭐
The project is a spider that uses scrapy and beautifulsoup4 for crawl picture.
Househunterbot
21 ⭐
Use Python, Google Spreadsheet, Google Shortener and CALLR API to automate your apartment search in Paris.
Comicbookmaker
27 ⭐
Script to fetch webcomics and use them to create ebooks.
Web_scrAPIng_python
23 ⭐
Techniques for Scraping the Web in Python
Pixelarity Download
21 ⭐
Automatically download Pixelarity templates :star:
Weibocar
24 ⭐
【爬虫】基于Scrapy开发的微博(评论、转发、点赞)爬虫,可以批量抓取。
Anyme Dl
21 ⭐
Download complete anime episodes
Fabulous
19 ⭐
Fabulous Bot for Slack!
Chopper
21 ⭐
Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules
Ds Ml Public
37 ⭐
Python Scripts and Jupyter Notebooks
Torscrapper
24 ⭐
A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Sjs_drops
19 ⭐
Script using requests module to register accounts to Slam Jam Socialism raffles.
Atlas Obscura API
28 ⭐
A simple flask api for Atlas Obscura.
Beautifulsoup.dart
19 ⭐
A dart port of the famous python library beautifulsoup
Indeed_scrapper
17 ⭐
Scrapper and Parser for Indeed Jobs and Resumes using Python, BeautifulSoup and Selenium/Requests and storing and manipulating data using mongodb
Scraper Projects
24 ⭐
🕸 List of mini projects that involve web scraping 🕸
Twitter Bot Selenium
15 ⭐
Twitter-Bot-Selenium simulates the entry of a real person and perform the actions of Like, ReTweet, Follow and UnFollow using different keywords.
Pacpaw
14 ⭐
Pawn package manager for SA-MP
Sig To Googlecalendar
14 ⭐
A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar
Music Library Ocd Fixer
13 ⭐
Automatically fetch metadata for your music collection and rename files accordingly
Nyu Info 2335 201706
13 ⭐
Programming in Python and Fundamentals of Software Development - Summer 2017
WebscrAPIng And Analysis Of Medium Articles
20 ⭐
Scraping medium articles tagged under ML,DL and AI and performing Analysis
WebscrAPIng
23 ⭐
Lets learn web scraping and apply them in real application.
Web Scrapers
16 ⭐
various web scrapers as examples
Sofpythonbot
11 ⭐
This Telegram-Bot answers python questions by using stackoverflow subjects.
Manishanker Cnn_text_classification
15 ⭐
Build a model which automatically classifies an article under Finance, Law, Fashion and Lifestyle, using the data from leading magazines for training the model.
Book_scraper_python
14 ⭐
A demo to use the BeautifulSoup Python package to get the book informations from websites
Lkuffo Web ScrAPIng
93 ⭐
More than 50 web scraping examples using: Requests | Scrapy | Selenium | LXML | BeautifulSoup
Lyricaly
12 ⭐
:musical_note: Lyricaly gets Lyrics delivered to your Terminal for any Song. Uses Python beautifulsoup4 to scrap lyrics. pypi: lyricaly
Webscrapping
17 ⭐
Web Scraping using Python Data mining , Data Analyzing & Data Visualization of the collected Data, The python script is written to fetch all the individual categories the website , The code is written for fetching the data from the first page and it iterates to each and every pages of website ( activities, categories, count of bought), and I used statistical techniques for mathematically analysis and presenting the data into visualization
Edgar Company Filings Web Scrapping Data Analysis
13 ⭐
Web scrapping & Data Analysis on EDGAR, the Electronic Data Gathering, Analysis, and Retrieval system
Cse3020 Web Mining Labs
15 ⭐
Repository containing all the codes created for the lab sessions of CSE3020 Web Mining at VIT University Chennai Campus
Cowaps
9 ⭐
CodeWarsProfileScraper. Only meant for practicing scraping.
Hong Kong Jockey Club Web Crawler
14 ⭐
A simple python script written using Selenium and BeautifulSoup to extract every horse's information in the races.
Web Link Tester
11 ⭐
Flask App to scrape hrefs from websites and validate links
Flipkart Review Scraper
12 ⭐
Python script for scraping product reviews
Indeed Python Wrapper
11 ⭐
A Python wrapper for Indeed Job Search API
ScrAPIng Designs
12 ⭐
様々なサイトのスクレイピングチャレンジです
Udemy
18 ⭐
Web-scraping Udemy online courses using BeautifulSoup in Python and with a bash script that automates webscraping
Umass Toolkit
10 ⭐
Tools for accessing and using data from the University of Massachusetts Amherst. Unofficial.
Create_word_cloud
20 ⭐
create word clouds with wrodcloud-fa for twitter and telegram chat
Jobfunnel
1538 ⭐
Scrape job websites into a single spreadsheet with no duplicates.
Beautifulsoup Tutorial
30 ⭐
:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.
Mediumscraper
12 ⭐
Scraping articles of medium and providing audio versions 📑 to 🔊 using django
Tweet Transcriber
15 ⭐
A Reddit bot that transcribes tweets from comments and submissions links, mirrors their images and replies back with a formatted Markdown message.
Gsocanalyzer
64 ⭐
A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.
Languagepod101 Scraper
113 ⭐
Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre: :japan: :sushi: Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Whatsoup
69 ⭐
A web scraper that exports your entire WhatsApp chat history.
Newspaper3_usage_overview
64 ⭐
This repository provides usage examples for the Python module Newspaper3k.
Facebook Web Scraper
46 ⭐
A collection of tools that you can use to collect data from Facebook