REDACTED@REDACTED@infosec.pub
edited

Replying to @⁨beep@piefed.world⁩

The drop correlates with the time reddit locked down old reddit from accessing anonymously/without logging in to avoid AI scraping. Reddit themselves did this.

EDOT: And OpenAI also changed how the web search works; forbes.com/…/reddit-nearly-vanishes-from-chatgpt-…

ForbesReddit Nearly Vanishes From ChatGPT Citations After OpenAI Search Change, Report SuggestsReddit's share of ChatGPT citations collapsed 86% to 0.5% after OpenAI changed how ChatGPT Search works — the same week Reddit joined the S&P 500.
REDACTED@REDACTED@infosec.pub
edited

Replying to @⁨im_fine_sandy@nord.pub⁩

They actually did use old reddit, as confirmed by reddit itself, as confirmed by massive drop after the change. It was simply far easier to scrape old reddit (pre-rendered instead of relying on JavaScript and dynamic content load)

engadget.com/…/old-reddit-could-be-the-next-casua…

EngadgetOld Reddit could be the next casualty of Reddit's war on AI scraping - EngadgetThe company is also planning to retire its public API.
im_fine_sandy@im_fine_sandy@nord.pub

Replying to an earlier post

You seem to have misunderstood, and the article you linked doesn’t contradict what I’ve said.

Wealthy, sophisticated LLM developers would not have been scraping old reddit. They would pay reddit for API access.

Shutting down old reddit closes the door on back yard developers, not OpenAI.

Additionally, when you run a prompt in a chatbot, it doesn’t scurry away and scrape old reddit and then formulate an answer. The scraping of content is going on while the model is being developed.