Link Harvest 1.0

Posted in: News, WordPress

Link Harvest is a WordPress plugin that uses the content in your posts and pages to build a links list for you, based on the sites you actually link to. You can see it in action on my Links page

I created this to help me better leverage my content as part of my recent site redesign. I finally found time to test everything in WordPress 2.0 and 2.1, finish the README, etc. so I could release it.

The initial link harvest can be fairly resource intensive and can take a while as it goes through all of your posts and pages looking for links and processing them. My initial harvest took around 3 hours for about 2000 posts. Future posts are added incrementally and you probably won’t even notice it.

Link Harvest is a fairly complicated plugin, so I highly recommend reading the README and following the installation steps carefully. If you get really stuck, I do offer consulting services.

On the technical side, I’ve recently added special handling support for FeedBurner redirect URLs and the ability to backfill page titles in the event some pages don’t load properly during the initial harvest operation. Like my Share This plugin, Link Harvest also uses Prototype for the reasons I’ve explained previously.

I’d also like to thank the folks that have sent in a donations to help support all the projects and plugins I make available for free here. Please consider making a donation if you find this stuff useful.

The download is available on my WordPress Plugins page.

If you have any trouble with this, please open a thread in the WP Support Forums and send me the link.

Popularity: 12% [?]

Posted February 26th, 2007 @ 2:09 PM

17 Replies

  1. Baris Unver adds this Comment:

    At last :)

    February 26th, 2007 at 2:19 pm

  2. strajk adds this Comment:

    hi, how many query this plugin generate?
    i tested related plugins but toooo much qurey

    February 26th, 2007 at 4:32 pm

  3. Alex adds this Comment:

    strajk - Sorry, your comment doesn’t make sense to me.

    February 26th, 2007 at 4:41 pm

  4. Aaron Brazell adds this Comment:

    Alex, he’s asking how many database calls the plugin makes. Without looking at the code, I’m expecting very little… I think this is more RSS based as opposed to database based right?

    February 26th, 2007 at 4:43 pm

  5. Alex adds this Comment:

    That’s not a very useful question. It makes tons of database calls when it’s doing a harvest. It makes none when it isn’t…

    It really doesn’t have anything to do with RSS that I can think of.

    February 26th, 2007 at 4:50 pm

  6. Kesämaa adds this Comment:

    Seems like a great plugin! I’ll surely be giving it a try!

    February 27th, 2007 at 2:01 am

  7. Bakkel adds this Comment:

    I’ve downloaded the plugin and it is harvesting as we speak. Thx!

    February 27th, 2007 at 11:03 am

  8. Bakkel adds this Comment:

    No problems here! about 500 posts and it took about 30 minutes to harvest. check http://www.bakkel.co[...]s-collectie/ for the result.

    February 28th, 2007 at 2:21 am

  9. David Bradley adds this Comment:

    Once I got this to run (there was a single dodgy post that revealed itself as a troublemaker when I used the debug version) it was quite fascinating to watch as the harvest takes place. I created a standalone science link harvest page, which gradually accumulated the links from my 800+ posts. Some links were to sites I’d totally forgotten about ever having pointed to in some of my more obscure posts from years back. I had to exclude several sites that aren’t properly 301′ing their non-www canonical form but that’s not hard to do.

    Anyway, thanks once again for bringing us such fun Alex.

    And, just in case anyone is interested in seeing the links on my site here’s the URL - http://www.scienceba[...]harvest.html

    db

    February 28th, 2007 at 11:34 am

  10. Alex adds this Comment:

    I’m glad you got it working, but it would have been really helpful if you’d shared information about the problem post with me. My goal is to work around these issues for everyone, not to have each individual solve specific problems.

    February 28th, 2007 at 2:22 pm

  11. Michele adds this Comment:

    Interesting plugin. It took about 25 minutes to process over 1000 posts on my main blog.

    Would you consider adding more options to the links it harvests at some point?

    Several of the sites I link to would have affiliate IDs that it would be nice to preserve if possible

    Thanks

    Michele

    March 5th, 2007 at 4:25 pm

  12. Joan adds this Comment:

    Great plugin and working flawlessness on my blog.

    A suggestion for the future:
    adding favicons to the list of links.

    maybe using the existing favicache plugin
    (http://neo-geek.net/?p=portfolio&id=10 )

    March 12th, 2007 at 4:51 am

  13. Eugene adds this Comment:

    I like your plugin. One thing I would prefer is that you provide a link to the original page and not to the domain. For example, on one post, there is a link to a NYTimes article, but the Link Harvest just picks up the domain part. It would be also really good if you retained the original “text” part associated with the link instead of using the Title of the page. I’m looking at the php and trying to figure out how to accomplish this, but obviously, it would be easier for you to do this.

    March 12th, 2007 at 4:18 pm

  14. Alex adds this Comment:

    The links are retained - click “show links”.

    March 12th, 2007 at 4:23 pm

  15. Thoughts on linking : Meandering Passage adds this Pingback:

    […] TO” from Meandering Passage posts. This list is the output of a WordPress Plug-in call “Link Harvest” and it will automatically update as I […]

    May 11th, 2007 at 8:03 am

  16. 50 Wordpress plugins | Webmastern.se adds this Pingback:

    […] Link Harvest […]

    June 8th, 2007 at 12:36 pm

  17. DonsTag » Plugin-Wochen bei Donstag: TopLinks adds this Pingback:

    […] hat. Hab da vor einiger Zeit schonmal ein ähnliches Plugin  bei Robert Basic gefunden:  Link Harvest. Leider hat das bei mir nie funktioniert, schon nach einigen Beiträgen hat er wegen […]

    March 27th, 2008 at 3:14 pm

Add a Comment

Please note: Use of a non-personal web site or blog in the field below and/or comments that are off-topic, personal attacks, or support requests will likely be removed at my discretion.

Note: This post is over a year old. You may want to check later in this blog to see if there is new information relevant to your comment.

Twitterrific » « Too Many Browsers (Again)

About This Site

This is the personal web site of Alex King, an independent developer based in Denver, Colorado USA. More...


Crowd Favorite

Crowd Favorite is my software and web development business.

We build web applications, design and develop custom WordPress themes and plugins, and build custom sites using WordPress as a CMS.


I also have a tumblog that aggregates my online content from other services (Twitter, Flickr, del.icio.us. etc.).

Ads