Search Results for "threading"

...It focuses on ease of use with a zero-configuration setup, making it accessible to both beginners and experienced users. It supports high performance downloads through multi-threading and includes resume capabilities so interrupted downloads can continue without starting over. It can parse different types of links such as standard video pages, short links, and collection or activity pages to automatically retrieve downloadable media. It also allows users to choose video resolution, audio quality, and encoding format based on the available sources. ...

...These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages. Several scripts also incorporate multi-threading and proxy usage to improve scraping efficiency and help avoid common anti-scraping limitations. In addition to raw data collection, some spiders include basic data processing and analysis using tools such as pandas and simple visualization with matplotlib. It also contains examples of proxy pool integration and encapsulation to support more reliable crawling when working with sites that enforce request limits.

PSpider is a lightweight web crawling framework written in Python designed to simplify the development of custom web spiders. It focuses on providing an easy-to-understand architecture while still supporting concurrent crawling for improved performance. It uses a multithreaded model that separates the crawling workflow into several components responsible for fetching, parsing, and saving data. Tasks are managed through queues, allowing different parts of the crawler to process work...

The aimy project is a set of python packages that provide services I consider important in a platform for implementation of a meaningful artificial intelligence. The intention is to steadily add 'service' items that each will increase the base platform's functionality and seamlessly add to the AI's capabilities. BE AWARE: This is EARLY DEVELOPMENT. There's not much here yet, and what's here is likely to change frequently and significantly.

Proxy Tester is a proxy list tester and then it generates a wpad.dat file you can use for your browser based on working servers. wpad.dat file selects a random proxy server from the list of provided working proxy servers with each connection request.

A minimalistic, quick and simple (KISS simple) browser implemented in python using pywebkitgtk, pygtk and python 2.7.3. Do note that this project would use python 3.x, however the owner has no desire whatsoever to port webkit to python 3.x at this time. The goal of this project is to create a simple, fast and easily expandable (for now manually, later on with easy python addons). For now configuration will be done using text files and (in case of adding features) doing small...