Scrapy @ScrapyProject

The most popular open source web scraping framework in Python. scrapy.org Joined January 2010

Tweets

447
Followers

6K
Following

7
Likes

100

“scrapy” became my alter ego. it all started with my first ever python project, a simple web scraper that pulled headlines from top news sites. i used the scrapy library by @ScrapyProject. it wasn’t much, just a script. but it was the first thing i built that actually worked.…

1 2 5 240 0

Scrapy @ScrapyProject

4 months ago

10 years after the release of 1.0, Scrapy has become table stakes for modern web scraping projects. Creator Shane Evans talks through Scrapy's current position in the industry. #ScrapyAnniversary #OpenSource #WebScraping

0 0 1 262 0

Download Video

Scrapy @ScrapyProject

5 months ago

Scrapy didn’t start in a lab. It started in a startup. From solving real-world data problems to becoming one of the most trusted scraping frameworks out there—here’s how it all began. 👉 zyte.com/blog/the-rise-… #ScrapyAnniversary #OpenSource #Python

0 3 5 349 2

Download Image

Scrapy @ScrapyProject

3 years ago

Scrapy 2.8.0 is out. This is a maintenance release, with minor features, bug fixes, and cleanups. See the full changelog at docs.scrapy.org/en/latest/news…

3 0 8 2K 0

Scrapy @ScrapyProject

3 years ago

Have you got what it takes to be called a web scraping whizz? Join the @ExtractSummit 2022 Coding Contest to find out!

ExtractSummit @ExtractSummit

3 years ago

Have you got what it takes to be called a web scraping whizz? Join the @ExtractSummit 2022 Coding Contest to find out!

0 0 1 0 0

Download Gif

0 0 4 0 0

Scrapy @ScrapyProject

3 years ago

Dive into the world of web data! Register for Extract Summit.

ExtractSummit @ExtractSummit

3 years ago

Dive into the world of web data! Register for Extract Summit.

0 0 2 0 0

Download Video

0 0 1 0 2

Scrapy @ScrapyProject

3 years ago

Scrapy 2.6.2 and 1.8.3 are out, addressing a security issue: docs.scrapy.org/en/2.6/news.ht… 2.6.2 also addresses the remaining regressions of 2.6.0.

0 1 11 0 0

Scrapy @ScrapyProject

4 years ago

Scrapy 2.6.1 is out, with security fixes around cookies also backported to Scrapy 1.8.2. But it is not just security fixes! There is official Python 3.10 support, asyncio support no longer being experimental, and new features for feed exports: docs.scrapy.org/en/latest/news…

0 1 8 0 0

Scrapy @ScrapyProject

4 years ago

Have you not tried Playwright and Scrapy together yet? Get started in 10 minutes! youtube.com/watch?v=0wO7K-… Thank you, @jhnwr!!!

1 3 18 0 5

Scrapy @ScrapyProject

4 years ago

We have released Scrapy 2.5.1 and Scrapy 1.8.1, which fix a security issue that could lead to the leak of HTTP authentication credentials to target websites. Find out more in the release notes: docs.scrapy.org/en/2.5/news.ht…

0 0 8 0 0

Scrapy @ScrapyProject

4 years ago

An introduction to Scrapy from @bsekiewicz , winner of the Extract Summit 2021 Coding Contest: worksmarter.pl/en/post/webscr…

0 1 4 0 2

Scrapy @ScrapyProject

4 years ago

Ready!

ExtractSummit @ExtractSummit

4 years ago

Ready!

0 1 1 0 0

0 1 5 0 0

Scrapy @ScrapyProject

4 years ago

Join Extract Summit for a day dedicated to web data extraction.

Zyte @zytedata

4 years ago

Join Extract Summit for a day dedicated to web data extraction.

0 1 2 0 0

Download Image

0 0 3 0 0

Shane Evans @shaneaevans

4 years ago

There are prizes for the first 3 people with all data correctly scraped. The solutions must run on Scrapy Cloud. #scrapy #scraping #Python

ExtractSummit @ExtractSummit

4 years ago

There are prizes for the first 3 people with all data correctly scraped. The solutions must run on Scrapy Cloud. #scrapy #scraping #Python

0 1 1 0 0

Download Image

0 6 8 0 0

Scrapy @ScrapyProject

4 years ago

Thanks to @NoelTautges, itemadapter 0.3.0 makes it possible to use #pydantic models as Scrapy items!

0 1 5 0 0

Scrapy @ScrapyProject

4 years ago

We have moved our IRC channel to Libera.Chat: web.libera.chat/?channel=#scra… Mind, however, that you’ll probably find more people on Discord: discord.gg/fbCHpAm6KM