Wondering if any of you programmers out there know an algorithm that can check and see if what one is about to post is already posted somewhere else on the site. Information is coming in at a blazing pace, and trying to scroll through NEW to check is challenging. I know there are tools that check to see if a username or email is in use when people try to join any website. Maybe something similar that scans for duplicate links and certain key words? I don't know. Not a programmer. But with all the traffic right now, it's easy to see why so much info is being duplicated. Or, is there already something that exists here that i'm missing. Don't tell me it's "Search", because that is hit or miss at best - mostly "miss".
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (4)
sorted by:
This suggestion is not about censoring content. It's about checking to see if that content has already been posted somewhere on the site. Duplicate posts are a big problem right now, and the mods are taking them down as soon as they see them. Having a way to check for duplicate content would help them out a lot.
Usually this is handled by an URL checker, seeing if the specific URL has been posted before. The main drawback is that the same story, from different outlets or even the same site but with i.e. a different timestamp in the URL still all get through. But it's better than nothing.
I have no idea what this site currently is using.