Legal guide16 min read

Web Scraping Law in the UK and EU

Short answer

Web scraping is legal in the EU and the UK, but the GDPR and the UK GDPR apply to every piece of personal data you scrape, even when it is public: you need a lawful basis, usually legitimate interests, and you may collect only what your purpose needs. Prices, stock levels and product data are not personal data, so the main limits for them are the database right (15 years of protection against taking a substantial part, or repeated small parts, of a database) and website terms you accepted; breaching terms is a civil matter, while getting past a login is a crime under the UK's Computer Misuse Act 1990 and Germany's § 202a StGB. ProxyField sells residential proxies for lawful public-data work from $1.95/GB; start with the Easy Trial: 1 GB for $2.95.

residential IPs
412M+
from, traffic never expires
$1.95/GB
Easy Trial
1 GB for $2.95
At a glance
What you scrapeMain rule in the EU and UKRisk
Prices, stock, product specs, public statisticsContract terms you accepted; database right for wholesale copyingLower
Names, profiles, contact details, photos, reviews with namesGDPR / UK GDPR: lawful basis, minimization, information dutiesHigher
Health, political views, religion, sexuality and other special categoriesGDPR Article 9: prohibited unless an exception appliesHighest
A substantial part of one site's database, or repeated small parts of itDatabase Directive 96/9/EC; UK database right (SI 1997/3032)Higher
Articles, images, text for AI trainingCopyright and the text-and-data-mining rulesDepends on opt-outs and purpose
Pages behind a login or after a blockComputer-crime law and the terms you acceptedHighest
On this page 14 sections
  1. Web scraping and the GDPR: the short answer
  2. Is web scraping legal in the UK?
  3. The EDPB's 2026 guidelines on web scraping
  4. How to collect web data in compliance with the GDPR
  5. Enforcement: fines and decisions on scraping
  6. The database right: prices, listings and catalogs
  7. Contracts in the EU
  8. Copyright and text and data mining
  9. Germany: the database right and other rules
  10. Spain: public prices and the law
  11. Switzerland
  12. Country by country
  13. Web Scraping Law in the UK and EU FAQ
  14. Sources

Web scraping and the GDPR: the short answer

The GDPR does not ban scraping; it governs personal data, whatever its source. Regulation (EU) 2016/679 applies to any processing of personal data, and collecting, storing and organizing scraped data are processing. The UK keeps the same rules as the UK GDPR, as amended by the Data (Use and Access) Act 2025, alongside the Data Protection Act 2018.

If your scraper collects no personal data, the GDPR is not the rule that limits you. If it does, five obligations follow:

  1. A lawful basis

    Under Article 6. For private companies it is usually legitimate interests, Article 6(1)(f).

  2. Purpose limitation and data minimization

    Decide in advance what you collect and why, and collect nothing else.

  3. Transparency

    Article 14 requires you to inform people whose data you did not get from them, unless that proves impossible or would need disproportionate effort (Article 14(5)(b)).

  4. Special categories

    Article 9 prohibits processing health, political, religious and similar data unless an exception applies.

  5. Accuracy, security and rights

    People can object, ask for access and ask for deletion.

The US and general picture is in is web scraping legal.

Sources GDPR; EDPB, basic principles.

The EDPB's 2026 guidelines on web scraping

In July 2026, the European Data Protection Board published Guidelines 03/2026 on web scraping in the context of generative AI for public consultation (dated July 8, 2026 on the EDPB site; consultation ongoing in October 2026). They are written for private companies that scrape, or have others scrape, data to train generative AI, but their reading of the GDPR is the most detailed regulator text on scraping so far.

  • Legitimate interests needs three conditions: a legitimate interest, the necessity of the processing for it, and a balancing test in which people's rights do not override that interest.
  • Minimization before collection: precise collection criteria, filters for certain categories of data, and excluding websites that clearly oppose scraping through technical measures, which the guidelines list as login requirements, robots.txt or ai.txt files and CAPTCHAs.
  • Mitigating measures for the balancing test include limiting collection to freely accessible data, excluding certain sources by default, and deleting, anonymizing or pseudonymizing personal data as soon as possible.
  • Transparency: depending on the design, individual notices may not be needed where informing people is impossible or would take disproportionate effort.
  • Special categories: a derogation under Article 9(2) is needed in addition to a lawful basis.

They build on the EDPB's Opinion 28/2024 on AI models, adopted December 17, 2024, and on national guidance such as the CNIL's focus sheet on web scraping.

Easy Trial: 1 GB for $2.95.
Try for the price of 1 GB, no subscription, traffic never expires.

How to collect web data in compliance with the GDPR

These steps follow from the GDPR text and the EDPB and CNIL guidance above:

  1. Write down the purpose and the fields before the first request, and record your legitimate-interests assessment.
  2. Leave out personal data you do not need. For price and catalog monitoring, drop seller names, reviewer profiles and contact details at collection time.
  3. Exclude sources that object: sites whose robots.txt or terms refuse scraping, and areas behind logins.
  4. Filter special categories and data about children out of the stream.
  5. Keep it only as long as you need it, and pseudonymize or delete it after that.
  6. Answer requests: a contact for objections, access and deletion.
  7. Run a data protection impact assessment for large-scale collection about people.

Enforcement: fines and decisions on scraping

Regulators have fined companies that scraped personal data without a lawful basis, and closed cases where no personal data was processed.

  • Netherlands, 2024. The Dutch authority fined Clearview AI €30,500,000 for building a facial-recognition database from scraped photos (decision of May 16, 2024, announced September 3, 2024), citing among others Articles 6, 9 and 12 of the GDPR (EDPB news).
  • France. The CNIL fined a company €240,000 whose browser extension collected the contact details of people whose profiles its customers visited on a professional social network; the findings included the lack of a lawful basis (EDPB news).
  • Spain, 2025. The AEPD closed a complaint about a tool that scanned public social media posts by keyword and showed their sentiment as a chart, because processing of personal data was not proven: the demonstration showed only aggregated information, with no reference to identified or identifiable people (AEPD legal criteria, published November 25, 2025).
  • UK and 11 other regulators, 2023. The ICO and its peers said in a joint statement that publicly accessible personal information is still covered by data protection law, and asked platforms to protect it against unlawful scraping.

The database right: prices, listings and catalogs

The EU's Database Directive 96/9/EC gives the maker of a database a sui generis right to prevent the extraction or reuse of all or a substantial part of its contents, where obtaining, verifying or presenting them took substantial investment. Repeated and systematic extraction of insubstantial parts counts too when it conflicts with normal use of the database or unreasonably harms the maker. The right lasts 15 years.

  • In British Horseracing Board v William Hill (C-203/02), November 9, 2004, the Court of Justice held that the protected investment is in obtaining, verifying and presenting existing materials, not in creating the data, and that taking a substantial part needs permission even when the database is public.
  • In CV-Online Latvia v Melons (C-762/19), June 3, 2021, the Court held that a search engine copying and indexing a job-ad database extracts and reuses it, but that this is prohibited only where it adversely affects the maker's investment.

For price monitoring, this means: tracking the prices of 200 products you compete on is a different act from copying a retailer's whole catalog, or re-collecting it piece by piece every day. The UK kept its own database right after Brexit (GOV.UK guidance).

Contracts in the EU

In Ryanair v PR Aviation (C-30/14), January 15, 2015, the Court of Justice held that the Database Directive does not stop a site from limiting, by contract and subject to national law, the use of a database that neither copyright nor the database right protects. So for public, non-personal data, terms you accepted can matter as much as the database right. In both the EU and the UK, scraping logged in is where contract risk concentrates, because creating the account is where you accepted the terms.

Germany: the database right and other rules

Scraping public, non-personal pages is lawful in Germany within five rules of national law, on top of the GDPR:

RuleSectionWhat it says
What a database is§ 87a UrhGA collection of independent elements, arranged systematically and individually accessible, whose obtaining, verification or presentation needed a substantial investment; the maker is whoever made that investment
What the maker can stop§ 87b UrhGCopying, distributing or publicly reproducing the database or a substantial part of it; repeated and systematic copying of insubstantial parts counts the same where it conflicts with normal use or unreasonably harms the maker (para. 1, sentence 2)
How long§ 87d UrhG15 years from publication (or from creation, if unpublished)
Text and data mining§ 44b UrhGCopies of lawfully accessible works for automated analysis are allowed, unless the rightholder reserves them; online, the reservation counts only "in maschinenlesbarer Form" (machine-readable)
Access protection§ 202a StGBOvercoming access protection to obtain data not meant for you is the offense of data espionage
Unfair competition§ 4 UWGProtects competitors, for example against targeted obstruction and against imitating their products

For a price monitor this means: sample the products you compete on, check robots.txt and similar machine-readable reservations (how to check if a website allows scraping), and never mirror a shop's catalog or log in to areas you have no right to.

Spain: public prices and the law

Collecting public prices is lawful in Spain; prices are not personal data, so the GDPR and Spain's Organic Law 3/2018 on data protection (LOPDGDD) apply only if you also take names of sellers, reviewers or other people. Four national rules set the limits:

RuleSpanish lawWhat it means for price scraping
Database rightIntellectual Property Law (Royal Legislative Decree 1/1996), Book II, Title VIII, Articles 133–137A retailer's catalog can be a protected database: no substantial extraction, and no repeated small extractions that conflict with its normal use
Unauthorized accessCriminal Code, Article 197 bisAccessing an information system by breaking its security measures without authorization is an offense
Unfair competitionUnfair Competition Act (Law 3/1991)Misleading use of the data, or conduct that unfairly harms a competitor, can be challenged
Personal dataGDPR and LOPDGDD, overseen by the AEPDApplies only to data about people; the AEPD closed a 2025 case where a tool showed only aggregated results

Example: tracking the prices of 200 competing products once a day is ordinary monitoring; copying a retailer's full catalog with its descriptions and photos is where the database right and copyright risk lies. Store terms and product data in more detail: is scraping e-commerce sites legal; the job itself: price monitoring proxies.

Switzerland

Switzerland is outside the EU but has similar rules. The revised Federal Act on Data Protection (in force since September 1, 2023) governs personal data, and the Unfair Competition Act, Article 5(c), makes it unfair to take over and exploit another's market-ready work product by technical reproduction without an appropriate effort of your own. A business that copies a competitor's whole dataset to resell it runs that risk; reading public prices for comparison is a different act.

Country by country

The EU rules above apply in every member state; national law adds to them.

CountryRegulatorNational points
United KingdomICOUK GDPR (as amended by the Data (Use and Access) Act 2025), Data Protection Act 2018, Computer Misuse Act 1990 s. 1, database right in SI 1997/3032 Part III (reg. 16), CDPA 1988 s. 29A
GermanyFederal and state data protection authoritiesDatabase right in §§ 87a–87e UrhG (15 years, § 87d); text and data mining opt-out in § 44b UrhG; data espionage in § 202a StGB; § 4 UWG
SpainAEPDLOPDGDD (Organic Law 3/2018); database right in Articles 133–137 of the Intellectual Property Law; Criminal Code Article 197 bis; Unfair Competition Act (Law 3/1991)
FranceCNILFocus sheet on web scraping under legitimate interests; the €240,000 browser-extension fine
NetherlandsAutoriteit PersoonsgegevensThe €30.5M Clearview decision (2024)
ItalyGaranteGDPR and the Database Directive's sui generis right as transposed into Italian copyright law; the CV-Online test (C-762/19) for price scraping
PolandUODOGDPR and the Database Directive's sui generis right as transposed into Polish law; the GDPR applies only to sellers' or reviewers' data
SwitzerlandFDPICFADP and the Unfair Competition Act, Article 5(c)

The infrastructure for lawful collection across Europe: proxies for web scraping and Europe locations.

Web Scraping Law in the UK and EU FAQ

How does GDPR apply to scraping?

ProxyField sells proxies from $1.95/GB for public-data work, and the GDPR question is about the data you collect, not the tool: as of October 2026, the GDPR applies to the personal data you scrape, not to scraping itself. As soon as you collect names, profiles, contact details or photos, you need a lawful basis (usually legitimate interests), must collect only what your purpose needs and must meet the information duties of Article 14. Public availability does not take data outside the GDPR.

Is web scraping GDPR compliant?

It can be. Scraping that collects no personal data raises no GDPR issue; scraping that does is compliant when it has a lawful basis, a defined purpose, minimal fields, a retention limit and a way for people to object. The EDPB's 2026 guidelines add that scrapers should exclude sites that clearly oppose scraping, for example through robots.txt or CAPTCHAs.

How do I collect web data in compliance with GDPR?

Define the purpose and fields first, document a legitimate-interests assessment, drop personal data you do not need at collection time, filter out special categories, skip sites and areas that object or require a login, and delete or pseudonymize data once you no longer need it. For large-scale collection about people, run a data protection impact assessment.

Does the Computer Misuse Act apply to web scraping?

Only to access you know is unauthorised: section 1 of the Computer Misuse Act 1990 makes it an offence to cause a computer to give you access to material you are not authorised to access. Reading public pages that anyone can open is not that; using someone else's login, or getting into an area closed to you, is.

What is the database right in the UK?

A right of the maker of a database, under Part III of the Copyright and Rights in Databases Regulations 1997, to stop anyone extracting or re-utilising all or a substantial part of its contents without consent. Regulation 16(2) adds that repeated and systematic extraction of insubstantial parts can count as a substantial part, so re-collecting a whole site in small pieces is the risk, not checking a few prices.

Show 4 more questionsShow fewer questions

Sources

Easy Trial: 1 GB for $2.95.

Try for the price of 1 GB, no subscription, traffic never expires.