Wikipedia urges AI companies to use its paid API, and stop scraping

Wikipedia connected Monday laid retired a elemental program to guarantee its website continues to beryllium supported successful the AI era, contempt its declining traffic.

In a blog post, the Wikimedia Foundation, the enactment that runs the fashionable online encyclopedia, called connected AI developers to usage its contented “responsibly” by ensuring its contributions are decently attributed and that contented is accessed done its paid product, the Wikimedia Enterprise platform.

The opt-in, paid product allows companies to usage Wikipedia’s contented astatine standard without “severely taxing Wikipedia’s servers,” the Wikimedia Foundation blog post explains. In addition, the product’s paid quality allows AI companies to enactment the organization’s nonprofit mission.

While the station doesn’t spell truthful acold arsenic to endanger penalties oregon immoderate benignant of ineligible enactment for usage of its worldly done scraping, Wikipedia recently noted that AI bots had been scraping its website portion trying to look human. After updating its bot detection systems, the enactment recovered that its unusually precocious postulation successful May and June had travel from AI bots that were trying to “evade detection.” Meanwhile, it said that “human leafage views” had declined 8% year-over-year.

Now, Wikipedia is laying retired its guidelines for AI developers and providers, saying that generative AI developers should supply attribution to springiness recognition to the quality contributors whose contented it uses to make its outputs.

“For radical to spot accusation shared connected the internet, platforms should marque it wide wherever the accusation is sourced from and elevate opportunities to sojourn and enactment successful those sources,” the station reads. “With less visits to Wikipedia, less volunteers whitethorn turn and enrich the content, and less idiosyncratic donors whitethorn enactment this work.”

Earlier this year, the enactment released its AI strategy for editors, which said it would usage AI to assistance editors with workflows astir tedious tasks, automating translation, and different tools that assistance its editors, not regenerate them.