6

State of Web Scraping 2023

 1 year ago
source link: https://docs.google.com/forms/d/e/1FAIpQLSf6VHIrsh9sWkptxHsrtCzJmBQYOUmchYBkwTovk-apk_dBBA/viewform
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

State of Web Scraping 2023

State of Web Scraping 2023
We believe in open knowledge and the power of shared insights. We're committed to publishing the results of the 'State of Web Scraping 2023' survey for free. Not only will we share the analysis of the data, but we will also release the raw data for everyone in the community. This way, we hope to foster transparency, promote collective learning, and encourage new discoveries in the field of web scraping.

All the results will be available on Scraping Fish blog. You can follow Scraping Fish or Jordan Hansen on Twitter to stay up to date.
Google にログインすると作業内容を保存できます。詳細
What is your role?
Web scraper
Software Developer
Business owner
Freelancer
Which country are you from?
United States of America
China
India
Japan
Germany
France
United Kingdom
Canada
Poland
Brazil
Spain
選択を解除
What is your age group?
<= 10
11 - 18
19 - 24
25 - 34
35 - 44
45 - 54
55 - 64
>= 64
選択を解除
How would you rate your web scraping expertise level?
Beginner
Intermediate
Advanced
選択を解除
How many years have you worked in web scraping?
I don't work in web scraping
< 1 year
1- 2 years
3 - 5 years
6 - 10 years
11-20 years
> 20 years
選択を解除
Which programming languages do you use for web scraping?
I don't code
Python
JavaScript
C/C++
Which development tools do you use for web scraping?
Selenium
Scrapy
Puppeteer
Playwright
Crawlee
If you use proxies for web scraping, which providers do you prefer?
I don't use proxies
Oxylabs
Froxy
SmartProxy
BrightData
Custom build
What type of proxy do you use?
I don't use proxies
Datacenter
Residential
Mobile
From which country or region do the IPs you use for web scraping originate?
I don't care, I don't use geotargeting
United States of America
India
China
Canada
Brazil
Spain
Germany
France
Do you scrape dynamic websites which need JavaScript rendering?
Sometimes (less than 50%)
Mostly (50% - 90%)
Always or almost always (90% or more)
選択を解除
If you use web scraping API, which one do you use?
I don't
Scraping Fish
ScrapingBee
ScrapingAnt
ScrapFly
ScrapeOps
ScraperAPI
ZenRows
Apify
How important for you is ethics in web scraping?
Not important at all
Very important
選択を解除
Do you care about ethics in sourcing IPs for web scraping?
Not at all
Very much
選択を解除
If you make money from web scraping, how you do it?
I don't
I'm employed as a software engineer doing web scraping
I develop scrapers and sell the code as a freelancer
I sell scraped data
I build my own products based on scraped data
What is the size of the organization you work for?
Just me
2 - 5 people
6 - 10 people
11 - 20 people
21 - 50 people
51 - 100 people
101 - 1000 people
1001+ people
選択を解除
Do you hold a higher education degree?
Yes, related field
Yes, unrelated field
選択を解除
How many hours per week do you spend on web scraping development?
<= 5 hours
6 - 20 hours
21 - 40 hours
I web scrape full time
選択を解除
How much money do you make from web scraping (salary or revenue) per year in USD?
I don't make any money on web scraping
$1 - $1,000
$1,000 - $10,000
$10,000 - $30,000
$30,000 - $50,000
$50,000 - $100,000
$100,000 - $200,000
> $200,000
選択を解除
What kind of data or websites do you scrape?
All kinds of data
Social media
E-commerce
Job postings
Shoes / sneakers
Hotels
Customer reviews
Online ads
Products
Restaurants
Grocery
Prices
Deals, special offers, discounts
Cargo tracking
Medical
Public Government Data
How challenging do you find the websites you scrape?
Not challenging at all
Almost impossible
選択を解除
What are your sources of information about web scraping?
r/WebScraping subreddit
Facebook group
StackOverflow
YouTube
Blog posts
Discord
Medium

Thank you for taking the time to complete our "State of Web Scraping 2023" survey. Your input is invaluable to us as we strive to better understand the evolving landscape of web scraping and how we can serve our community more effectively.

As a token of our appreciation for your time and insights, we're delighted to offer you a 50% discount on Scraping Fish API for web scraping.

Scraping Fish offers a comprehensive suite of web scraping tools designed to simplify and streamline your scraping tasks, no matter the scale or complexity. From efficiently dealing with dynamic websites that require JavaScript rendering to handling various data formats, Scraping Fish has got you covered.

To claim your discount, simply enter the code "SURVEY2023" at checkout on our website. This code is valid till the end of June, 2023.

Thank you once again for your participation, and we hope you continue to be part of our journey as we work to make web scraping accessible and efficient for everyone.

The Scraping Fish Team

Thank you!
1/1 ページ
フォームをクリア
Google フォームでパスワードを送信しないでください。

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK