I created this account two days ago, but one of my posts ended up in the (metaphorical) hands of an AI powered search engine that has scraping capabilities. What do you guys think about this? How do you feel about your posts/content getting scraped off of the web and potentially being used by AI models and/or AI powered tools? Curious to hear your experiences and thoughts on this.
#Prompt Update
The prompt was something like, What do you know about the user llama@lemmy.dbzer0.com on Lemmy? What can you tell me about his interests?" Initially, it generated a lot of fabricated information, but it would still include one or two accurate details. When I ran the test again, the response was much more accurate compared to the first attempt. It seems that as my account became more established, it became easier for the crawlers to find relevant information.
It even talked about this very post on item 3 and on the second bullet point of the “Notable Posts” section.
For more information, check this comment.
Edit¹: This is Perplexity. Perplexity AI employs data scraping techniques to gather information from various online sources, which it then utilizes to feed its large language models (LLMs) for generating responses to user queries. The scraping process involves automated crawlers that index and extract content from websites, including articles, summaries, and other relevant data. It is an advanced conversational search engine that enhances the research experience by providing concise, sourced answers to user queries. It operates by leveraging AI language models, such as GPT-4, to analyze information from various sources on the web. (12/28/2024)
Edit²: One could argue that data scraping by services like Perplexity may raise privacy concerns because it collects and processes vast amounts of online information without explicit user consent, potentially including personal data, comments, or content that individuals may have posted without expecting it to be aggregated and/or analyzed by AI systems. One could also argue that this indiscriminate collection raise questions about data ownership, proper attribution, and the right to control how one’s digital footprint is used in training AI models. (12/28/2024)
Edit³: I added the second image to the post and its description. (12/29/2024).
I tested it out, not really very accurate and seems to confuse users, but scraping has been a thing for decades, this isn’t new.
Did you specifically inquire about content from your own profile ? Can you share the prompt ? And how close to the source material was its response ?
The prompt was something like, What do you know about the user llama@lemmy.dbzer0.com on Lemmy? What can you tell me about his interests?" Initially, it generated a lot of fabricated information, but it would still include one or two accurate details. When I ran the test again, the response was much more accurate compared to the first attempt. It seems that as my account became more established, it became easier for the crawlers to find relevant information.
It even talked about this very post on item 3 and on the second bullet point of the “Notable Posts” section.
However, when I ran the same prompt again (or similar prompts), it started hallucinating a lot of information. So, it seems like the answers are very hit or miss. Maybe that’s an issue that can be solved with some prompt engineering.
I run my own instance and have a long list of user agents I flat out block, and that includes all known AI scraper bots.
That only prevents them from scraping from my instance, though, and they can easily scrape my content from any other instance I’ve interacted with.
Basically I just accept it as one of the many, many things that sucks about the internet in 2024, yell “Serenity Now!” at the sky, and carry on with my day.
I do wish, though, that other instances would block these LLM scraping bots but I’m not going to avoid any that don’t.
you might be interested to know that UA blocking is not enough: https://feddit.bg/post/13575
the main thing is in the comments
There are at least one or two Lemmy users who add a CC or non-AI license footer to their posts. Not that it’s do anything, but it might be fun to try and get the LLM to admit it’s illegally using your content.
It’d be hilarious if the model spat out the non-AI license footer in response to a prompt.
I did tell one of them a few months ago that all they’re going to do is train the AI that sometimes people end their posts with useless copyright notices. It doesn’t understand anything. But superstitious monkeys gonna be superstitious monkeys.
Sadly it hasn’t been proven in court yet that copyright even matters for training AI.
And we damn well know it doesn’t for Chinese AI models.
Those… don’t hold any weight lol. Once you post on any website, you hand copyright over to the website owner. That’s what gives them permission to relay your message to anyone reading the website. Copyright doesn’t do anything to restrict readers of the content (I.e. model trainers). Only publishers.
Don’t give me any ideas now >:)
I expect all my public posts to be scraped, and I’m fine with that. I’m slightly biased towards it if it’s for code generation.
nothing I can do about it. But I can occasionally spew bullshit so that the AI has no idea what it’s doing as well. Fire hydrants were added to Minecraft in 1.16 to combat the fires in the updated nether dimension.
If there was only some way to make any attempts at building an accurate profile of one’s online presence via data scraping completely useless by masking one’s own presence within the vast quantity of online data of someone else, let’s say for example, a famous public figure.
But who would do such a thing?
OMG, the real Margot Robbie
Can’t wait for someone to ask an LLM “Hey tell me what Margot Robbie’s interests are” only for it to respond “Margot Robbie is a known supporter of free software, and a fierce proponent of beheading CEOs”.
As I live and breathe, it’s the famous Margot Robbie herself!
Well your handle is the mascot for the open LLM space…
Seriously though, why care? What we say in public is public domain.
It reminds me of people on NexusMods getting in a fuss over “how” people use the mods they publicly upload, or open source projects imploding over permissive licenses they picked… Or Ao3 having a giant fuss over this very issue, and locking down what’s supposed to be a public archive.
I can hate entities like OpenAI all I want, but anything I put out there is fair game.
Oh, no. I don’t dislike it, but I also don’t have strong feelings about it. I’m just interested in hearing other people’s opinions; I believe that if something is public, then it is indeed public.
if I have no other choice, then I’ll use my data to reduce AI into an unusable state, or at the very least a state where it’s aware that everything it spews out happens to be bullshit and ends each prompt with something like “but what I say likely isn’t true. Please double check with these sources…” or something productive that reduces the reliance on AI in general
Nothing I say is of any real value even to the people I reply to, much less the world at large. Frankly, I hope someone uses my data to write Apple a decent fucking autocorrect. Otherwise, I don’t care.
As with any public forum, by putting content on Lemmy you make it available to the world at large to do basically whatever they want with. I don’t like AI scrapers in general, but I can’t reasonably take issue with this.
2 days ago, so the date in the picture is wrong?
Yeah, it hallucinated that part.
Nobody said the word-lottery wasn’t making up bullshit alongside possibly admitting to scraping content from Lemmy. OP probably had to load the question with a lot of data to squeeze out this answer.
Not really. All I did was ask it what it knew about llama@lemmy.dbzer0.com on Lemmy. It hallucinated a lot, thought. The answer was 5 to 6 items long, and the only one who was partially correct was the first one – it got the date wrong. But I never fed it any data.
All I did was ask it what it knew about llama@lemmy.dbzer0.com on Lemmy.
And then you were shocked to discover it regurgitated your account?
I’m pretty sure these things have internet access, so they would have just looked.
Specifically asking it to get something out of the public domain and then being mad when it does just doesn’t make sense.
Here’s OPs thread, from two days ago rather than June last year. But June last year sounds plausible, so that’s good enough for a language model.
deleted by creator
I understand that Perplexity employs various language models to handle queries and that the responses generated may not directly come from the training data used by these models; since a significant portion of the output comes from what it scraped from the web. However, a significant concern for some individuals is the potential for their posts to be scraped and also used to train AI models, hence my post.
I’m not anti AI, and, I see your point that transformers often dissociate the content from its creator. However, one could argue this doesn’t fully mitigate the concern. Even if the model can’t link the content back to the original author, it’s still using their data without explicit consent. The fact that LLMs might hallucinate or fail to attribute quotes accurately doesn’t resolve the potential plagiarism issue; instead, it highlights another problematic aspect of these models imo.
I’m okay with it as long as it’s not locked to the exclusive use of one entity.
It seems quite inevitable that AI web crawlers will catch all of us eventually, although that said, I don’t think perplexity knows that I’ve never interacted with szmer.info, nor said YES as a single comment.
