Reddit CEO Steve Huffman recentlyInterviewed by The VergeAt the same time, it called on companies such as Microsoft, Anthropic or Perplexity.ai that use crawler robots to mine data from various websites to pay for their actions.
OnAgreements reached with Google and OpenAIAfter paying the relevant fees for content licensing cooperation, Steve Huffman said that with the prevalence of artificial intelligence technology, it is necessary to use specific methods to restrict the arbitrary use of crawlers to mine its website data. He also stated that industry players including Microsoft, Anthropic or Perplexity.ai have no plans to negotiate.
Steve Huffman pointed out that Microsoft has been using Reddit website content to train its artificial intelligence models and arbitrarily displaying relevant summary content in its Bing Search search results. The data has even been accessed by crawler robots and transferred to other third-party search engines through Bing API resources.
Therefore, under current practices, Reddit has restricted the use of any crawler robots to crawl its website data. Therefore, users will not be able to find Reddit website content through Microsoft Bing Search or other search engine services based on Bing API, while Google Search Engine, which has currently reached a cooperation agreement, can find it smoothly.
However, Anthropic responded that it has not used crawlers to crawl Reddit content since mid-May, and Perplexity.aiAnnounceIn September this year, we will launch a cooperative model to share advertising revenue with content providers to achieve mutual benefit.
