Aug
25
2008

groovyblogs gets feed moderation

Well… it had to happen. After a week of people signing up twitter feeds and feedburner feeds from groovyblogs itself, I took some good advice from James, and implemented feed moderation. When you sign up your feed to groovyblogs, you now get a message saying

Moderation Message

Behind the scenes groovyblogs will now send me an email with your feed url and an opportunity to approve/deny your feed signup with a single click (so it’s pretty low impact for me, given that we only get a couple of signups a week):

Moderation Email

Next on the list is to work out how we can filter out the numerous duplicates we get from downstream aggregators. I could do some sort of title-based algo, but it might result in false positives – filtering out the original author’s post and leaving the aggregator’s copy. Or worse, skipping original unrelated posts with the same title.

Or perhaps I could do content matching. If the first para of this post appears in any other recent post, just keep the oldest one? Sounds more expensive… but may be doable…

If people have any good ideas here, let me know.

About the Author: Glen Smith

7 Comments + Add Comment

  • This is great – there’s a ton of repetition currently, and the twitter feeds were pretty annoying. I’d suggest removing the Grails Tutorials feed since it’s basically another aggregator and has a significant overlap since most articles they point to are also registered in groovyblogs.

  • I’d suggest just not letting any aggregation feeds into groovy blogs. They’re not really blogs and don’t add anything to the conversation. People who want their content listed on groovyblogs should be adding their blog as a feed directly.

    I don’t think that you’ll miss much, if any, new content by only having original sources get aggregated in the first place, and you’ll eliminate the duplication.

    I’ve actually got about 4 groovy aggregators in my RSS reader right now, but lately have been skipping over reading any of them because it’s become just a big echo chamber of repetition.

    Thanks for looking into this, it’s been getting much worse recently

  • +1 for kicking other aggregators!

    It has become very annoying, aggregators aggregating ‘content’ from aggregators recursively.

  • +1 for removing duplicate posts

    I would suggest to collaborate with the aggregators (Grails Tutorials, HolyGrails.net), so they may have a chance to either mark already aggregated entries or their own original content (at least for Grails Tutorials). (maybe they simply offer a feed containing only their own original content)

  • I think that removing duplicate posts is good idea. I also believe that other aggregators and posts that have only little with grails and groovy should be removed too.
    I would remove Grails Tutorials myself but unfortunately I am not the one who registered its feed. I registered only my blog jan-so.blogspot even before Grails Tutorials was created.

  • +1 For all the points above! The aggregators are the biggest pain IMHO.

  • Did you commit the code yet?

Leave a comment

Glen Smith

About Glen

Co-author Grails in Action