Major publishers are opting out of allowing Apple’s AI training tool, Applebot-Extended, to access their content. The New York Times, Condé Nast, Financial Times, The Atlantic, and USA Today are among the publishers that have blocked Apple Intelligence from scraping their data. Social media platforms including Facebook and Instagram have also prevented Apple AI from scraping their data. 

Apple introduced ‘Applebot-Extended’ as an upgrade to its original web-crawling bot. The new tool allows publishers to prevent Apple’s AI models from training their data while enabling basic web crawling for search purposes. 

Apple claimed this move was designed to address concerns about intellectual property and data usage by offering publishers greater control over their content.

Using a simple text file, robots.txt, publishers can block AI companies from accessing their web content, ensuring that automated systems do not scrape data without their permission. 

Several publishers are now using this file to block Apple's AI crawler, Applebot-Extended. According to Wired 6% to 7% of high-traffic websites have blocked Applebot-Extended, while another study by Ben Welsh discovered that about 25% of sites take similar actions.

Some publishers are opting to negotiate significant licensing deals with Apple to control how their content is used in AI training and receive compensation. 

This approach reflects the current trend among publishers to protect their content. In May, Reddit CEO Steve Huffman claimed that Microsoft has been using Reddit’s data to help improve its artificial intelligence models. 

Companies including Perplexity and Anthropic have also been accused of scraping data without authorization. 

Get Smarter at Marketing
The Keyword weekly update → your inbox
Writer, The Keyword
Nelson Oboh
HOME PAGE
Apple
01
How can your services help improve my website's performance?
Our services enhance your website's performance by optimizing load times, improving user experience, and ensuring seamless functionality across all devices. We specialize in custom Webflow builds that are tailored to your specific needs, ensuring your site is both visually appealing and highly efficient.
02
What is the process for starting a project with your team?
Our process begins with an initial consultation to understand your goals and requirements. We then conduct a thorough analysis of your current setup, followed by a collaborative planning phase where we outline the project scope and timeline. Once the plan is approved, our team gets to work on designing and developing your custom Webflow solution.
03
How do you ensure the security of the websites you develop?
We ensure the security of the websites we develop by implementing robust security protocols, including SSL encryption, regular security audits, and secure coding practices. Our team stays updated with the latest security trends and threats to proactively protect your site from vulnerabilities.
04
What support do you offer after a project is completed?
After a project is completed, we offer comprehensive support to ensure your website continues to perform optimally. This includes regular maintenance checks, updates to keep your site secure and up-to-date, and troubleshooting any issues that may arise. Our team is always available to provide guidance and assistance as needed.
05
What is your approach to handling website redesigns?
Our approach to website redesigns involves a comprehensive analysis of your current site to identify areas for improvement. We prioritize user experience and performance, ensuring that the redesign aligns with your brand's goals and enhances functionality. By leveraging the capabilities of Webflow, we create visually stunning and efficient websites tailored to your specific needs.