A fork of Xapian-haystack (https://github.com/notanumber/xapian-haystack) that applies the Inkscape patch for dealing with long terms. (https://github.com/inkscape/xapian-haystack/commit/d1346dc53f35b0960badf6435cff468c648de694)
Go to file
Matthias Portzel d9c27b07f6 Merge remote-tracking branch 'upstream/master' 2023-11-30 12:35:07 -05:00
.github/workflows Prepare 3.1.0 release (confirmed Django 4.1 support) 2023-03-19 12:54:34 +01:00
tests Allow more internal data exact searches 2023-03-19 12:28:10 +01:00
.coveragerc Revert "coveragerc - switch from source to include" 2021-12-06 17:59:18 +01:00
.gitignore Updated .gitignore to ignore MANIFEST 2009-12-07 11:14:17 -05:00
AUTHORS Updated narrow_queries in backend search to AND queries rather than OR. Thanks to naktinis for the original patch. 2012-05-28 16:06:07 -07:00
CHANGELOG.rst Prepare 3.1.0 release (confirmed Django 4.1 support) 2023-03-19 12:54:34 +01:00
LICENSE Switched license back to GPL v2. 2011-07-14 15:52:03 -07:00
MANIFEST.in Bump version to 3.0.1 2021-11-13 09:52:24 +01:00
README.rst Add ability to configure NGRAM's 2022-07-08 21:52:10 +02:00
install_xapian.sh Bump Xapian version to 1.4.19 2022-03-19 11:41:39 +01:00
requirements.txt Management Command Database Locking 2022-02-10 20:44:21 +01:00
setup.py Prepare 3.1.0 release (confirmed Django 4.1 support) 2023-03-19 12:54:34 +01:00
xapian_backend.py Merge remote-tracking branch 'upstream/master' 2023-11-30 12:35:07 -05:00
xapian_wheel_builder.sh xapian_wheel_builder - better metadata 2021-09-24 21:11:18 +02:00

README.rst

Xapian backend for Django-Haystack

GitHub Actions

image

PyPI version

Xapian-haystack is a backend of Django-Haystack for the Xapian search engine. Thanks for checking it out.

You can find more information about Xapian here.

Features

Xapian-Haystack provides all the standard features of Haystack:

  • Weighting
  • Faceted search (date, query, etc.)
  • Sorting
  • Spelling suggestions
  • EdgeNGram and Ngram (for autocomplete)

Limitations

The endswith search operation is not supported by Xapian-Haystack.

Requirements

  • Python 3+
  • Django 2.2+
  • Django-Haystack 2.8.0
  • Xapian 1.4+

Installation

First, install Xapian in your machine e.g. with the script provided, install_xapian.sh. Call it after activating the virtual environment to install:

source <path>/bin/activate
./install_xapian.sh <version>

<version> must be >=1.4.0. This takes around 10 minutes.

Finally, install Xapian-Haystack by running:

pip install xapian-haystack

Configuration

Xapian is configured as other backends of Haystack. You have to define the connection to the database, which is done to a path to a directory, e.g:

HAYSTACK_CONNECTIONS = {
    'default': {
        'ENGINE': 'xapian_backend.XapianEngine',
        'PATH': os.path.join(os.path.dirname(__file__), 'xapian_index')
    },
}

The backend has the following optional settings:

  • HAYSTACK_XAPIAN_LANGUAGE: the stemming language; the default is english and the list of available languages can be found here.
  • HAYSTACK_XAPIAN_WEIGHTING_SCHEME: a tuple with parameters to be passed to the weighting scheme BM25. By default, it uses the same parameters as Xapian recommends; this setting allows you to change them.
  • HAYSTACK_XAPIAN_FLAGS: the options used to parse AutoQueries; the default is FLAG_PHRASE | FLAG_BOOLEAN | FLAG_LOVEHATE | FLAG_WILDCARD | FLAG_PURE_NOT See here for more information on what they mean.
  • HAYSTACK_XAPIAN_STEMMING_STRATEGY: This option lets you chose the stemming strategy used by Xapian. Possible values are STEM_NONE, STEM_SOME, STEM_ALL, STEM_ALL_Z, where STEM_SOME is the default. See here for more information about the different strategies.
  • XAPIAN_NGRAM_MIN_LENGTH, XAPIAN_NGRAM_MAX_LENGTH: options for custom configuration of ngrams (phrases) length.
  • HAYSTACK_XAPIAN_USE_LOCKFILE: Use a lockfile to prevent database locking errors when running management commands with multiple workers. Defaults to True.

Testing

Xapian-Haystack has a test suite in continuous deployment with GitHub Actions. The file .github/workflows/test.yml contains the steps required to run the test suite.

Source

The source code can be found in github.

Credits

Xapian-Haystack is maintained by Jorge C. Leitão; David Sauve was the main contributor of Xapian-Haystack and Xapian-Haystack was originally funded by Trapeze. Claude Paroz is a frequent contributor. ANtlord implemented support for EdgeNgram and Ngram.

License

Xapian-haystack is free software licenced under GNU General Public Licence v2 and Copyright (c) 2009, 2010, 2011, 2012 David Sauve, 2009, 2010 Trapeze, 2014 Jorge C. Leitão. It may be redistributed under the terms specified in the LICENSE file.

Questions, Comments, Concerns:

Feel free to open an issue here or pull request your work.

You can ask questions on the django-haystack mailing list: or in the irc #haystack.