<html><head><base href="x-msg://3/"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">How's about this? <div><br></div><div><a href="http://drupal.org/node/297190">http://drupal.org/node/297190</a></div><div><br></div><div>I'm not familiar with these at all, but you may want to consider getting the output of one of those crawlers to display inside of Drupal.</div><div><br></div><div>Cheers</div><div><br></div><div><br></div><div><br><div><div>On 2009-10-13, at 9:09 PM, brendan, <a href="http://fresh-off.com">fresh-off.com</a> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div lang="EN-US" link="blue" vlink="purple"><div class="Section1"><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; ">Hello,<o:p></o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; ">I have a client that wants to know if there are any Drupal modules that search the web for content related to him and his company, and can then return the results (full articles or links to the content) to his drupal website. For example, search the web for instances where "<b>john doe</b>" + "<b>XYZ Company</b>" both appear in the same piece of content. <o:p></o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; ">Creating the crawler is way beyond my technical ability, so I'm hoping there are some good open source (preferably a Drupal module) options for this functionality. Wikipedia has a list of open source web crawlers, but since this is a subject I'm unfamiliar with, I'm unsure about whether or not they can be integrated with Drupal - or if any open source web crawlers are even meant to be integrated with a CMS.<o:p></o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; ">A little bit more info about the use case: He and his company operate in the education field and are constantly being featured in articles (interviews, write-ups, etc) across the web. In addition - and most importantly - he and his company produce several papers/articles that are featured in articles and education related blogs across the internet as well. He is finding that searching manually for this content to be impractical and thus, would love to have it automatically aggregated and sent to his Drupal site.<o:p></o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; ">Any thoughts, ideas, or pointers in the right direction would be apprecaiated!<o:p></o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; ">----<o:p></o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><b><span style="color: rgb(64, 64, 64); ">brendan,<span class="Apple-converted-space"> </span><a href="http://fresh-off.com" style="color: blue; text-decoration: underline; ">fresh-off.com</a><o:p></o:p></span></b></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="color: rgb(64, 64, 64); ">Creative Direction & Consultation: Web | Print | Brand<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="color: rgb(64, 64, 64); "><o:p> </o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="color: rgb(64, 64, 64); "><a href="http://fresh-off.com" style="color: blue; text-decoration: underline; ">http://fresh-off.com</a><o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="color: rgb(64, 64, 64); "><a href="mailto:hello@fresh-off.com" style="color: blue; text-decoration: underline; ">hello@fresh-off.com</a><o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="color: rgb(64, 64, 64); ">206.328.1067<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 11pt; font-family: Calibri, sans-serif; "><o:p> </o:p></div></div>_______________________________________________<br>consulting mailing list<br><a href="mailto:consulting@drupal.org" style="color: blue; text-decoration: underline; ">consulting@drupal.org</a><br><a href="http://lists.drupal.org/mailman/listinfo/consulting" style="color: blue; text-decoration: underline; ">http://lists.drupal.org/mailman/listinfo/consulting</a><br></div></blockquote></div><br></div></body></html>