search

Hi All.

We've now managed to import about 140k articles into our new drupal installation. So far - so good. Now the indexing begins. But it keeps stalling after approximately 6% and it generally takes up ALOT of the server resources making other work on the installation very patience demanding.

So (some of) the questions are...

This is my first update on groups.drupal.org about my SoC Project regarding enhancing drupal's search engine. I still have 3 more days of finals so I havn't gotten to any of the coding, but after putting forth much research and thought (and some kind help from my mentor Robert Douglass), I've decided on the following 2 parts as goals for my project.

Goals for Summer of Code Search Project:

http://framework.zend.com/

Some lucene goodies:

• Zend_Search_Lucene
  ZF-1262 CaseInsensitive.php missing require_once for the class it extends
  ZF-1263 DocumentWriter.php missing require_once for the class it extends
  ZF-1264 Default.php missing require_once for the class it extends
  ZF-1350 testUtf8(Zend_Search_Lucene_AnalysisTest) failing
  ZF-1351 testUtf8Num(Zend_Search_Lucene_AnalysisTest) failing
  ZF-1365 Zend_Search_Lucene::close() not setting or checking the $_close flag
  ZF-1376 Error in sample code of section 27.3.1.1 - Query Parsing

Drupal is used as a content management system (CMS) for various purposes; due its power relies on the modules and the fulfillment of all the needs / additional features / patches that has been arisen. However, auto-completion is still left out, except for auto-complete of user name.

Significance:

I've been doing my best to wrap my head around ways to make drupal more fuzzy search capable. The following are some goals of fuzzy search and I guess some comments. I'm not exactly sure how this will help as of now, but I really feel like along with improving the search engine's speed we should look at ways to provide more relevant results.

Any ideas on using the lucene indexing with cck fields, custom searches, and field weighting?

Just curious...

Zend Framework Beta 0.9.0

Zend_Search_Lucene: now matches the performance of Java Lucene

or so they say. We'll see...

• Zend_Search_Lucene
  ZF-96 Implement Search Highlighting
  ZF-295 Implement score normalisation
  ZF-626 Exception when adding document using static variables
  ZF-693 Using unoptimized indexing database damages storage
  ZF-943 Java examples are no longer necessary.
  ZF-1002 Document deleting/updating problem
  ZF-1050 Result sorting problem

For those keeping up-to-date. I'll be loading it next week.

They are claiming: Great performance improvement for Zend_Search_Lucene.

Drupal Norge, your user-driven community site for translators, developers, and users of Drupal in Norway, has been adding more and more features to help promote Drupal in Norway as well as features for helping existing norwegian users with their own Drupal installations.

New additions such as the "Drupal support på norsk", to be found at http://www.drupalnorge.no/support, is a forum category transformed into a Q&A feature ala Yahoo Answers where users who gave answers to support- questions are also highlighted in a sort-of Hall of Fame block. "Håndbøker på norsk", to be found at http://www.drupalnorge.no/bok, are 3 user handbooks in norwegian. Drupal Norge's user and node search can also be installed automatically as additional search providers for the Firefox and Internet Explorer. These two browsers automatically discover Drupal Norge's search plug-ins. Instructions on the latter are to be found at http://www.drupalnorge.no/sok-drupal-norge-vha-sokeboksen-i-din-nettlese... or visit the site and take a look at your browser's search bar.

Drupal Norge was launched on the 14th of February 2007. The site's address is http://www.drupalnorge.no.

The OS-CMS (aka Yahoo! Drupalcon) is coming up, and I'll be presenting Drupal's search capabilities. I intend to demo Lucene too, whether it is code from one of the J's or just some demo code I put together for the purpose. I may be calling on you for help, too! Anyway, just wanted to let people know. Come to the conference, it'll be fun!