Lupyne

The core engine is a high level interface to PyLucene, which is a Python extension for accessing the popular Java Lucene search engine.

Lucene has a reputation for being a relatively low-level toolkit, and the goal of PyLucene is to wrap it through automatic code generation.

So although PyLucene transforms Java idioms to Python idioms where possible, the resulting interface is far from Pythonic.

It also provides a RESTful JSON search server, based on the renowned CherryPy.

Many Python applications which require better search capabilities are migrating from using conventional client-server databases, whereas Lucene is an embedded search library.

Solr is a popular option for remote searching and other advanced features, but then any customization or embedded use is coupled to Java and XML.


Using a python web framework instead can provide the best of both worlds, e.g., batch indexing offline and remote searching live.

A simple client to make interacting with the server as convenient as an RPC interface.

It handles all of the HTTP interactions, with support for compression, json, and connection reuse.

Features:

• Advanced search features:
• Distributed searching with support for redundancy, partitioning, and sharding.
• Optimized faceted search.
• Optimized prefix and range queries.
• Geospatial support.
• Remote searching support:
• Production configuration
• Refreshing searcher
• "More like this" queries
• Retrieving document slices
• Hit text highlighting
• Query parsing options
• JSON errors
• Advanced term enumeration
• Multi-searchers
• Sorting options
• Facets

What is new in this release:

• PyLucene 4.8 and 4.9 supported
• PyLucene 4.4 and 4.5 dropped
• DocValues may be updated in-place
• Parallel indexing improvements

What is new in version 1.5:

• PyLucene 4.5 supported
• PyLucene 3 dropped
• Fields use new FieldType interface
• SortField comparators optimized and support multiple values

What is new in version 1.2:

• PyLucene 3.6 supported
• PyLucene 3.1 deprecated
• Support for all IndexWriterConfig options
• Dynamic filter wrappers
• Flexible hit sorting and filtering

What is new in version 1.1:

• PyLucene 3.5 supported.
• PyLucene 3.0 dropped.
• Storage and retrieval of binary fields.
• Term query boosting.

What is new in version 1.0:

• PyLucene 3.4 supported.
• PyLucene 3.0 deprecated.
• Hits natively support grouping by an arbitrary function.
• Span queries from multiterm queries.
• Segment based FieldCaches, optimized for incremental updates.
• Additional distance comparison utilities, optionally using the spatial contrib module.
• NumericField query to match a single term.

What is new in version 0.9:

• PyLucene 3.2 supported.
• PyLucene 2.9 dropped.
• Near real-time indexer.
• Optimized total hit count.
• Support for IndexWriterConfig and unlimited field length.
• Field settings validated upon initialization.
• Highlighting uses FastVectorHighlighter when available.
• New span queries: payload and position check.

What is new in version 0.8:

• PyLucene 3.1 supported.
• PyLucene 2.9 deprecated.
• Single document index for efficiently matching multiple queries.
• Optionally expunge deletes and optimize index on atomic commit.
• Numeric field implementations for datetimes and geospatial points.
• Atomic document updates.

What is new in version 0.7:

• Support for Lucene 2.4 dropped
• CherryPy 3.2 compatible
• Spatial within queries optimized and allow unlimited distance
• Searches can be timed out
• Sorted searches allow computing scores and tracking maxscore
• Disjunction queries
• Numeric range queries with custom precision step
• Enumeration of numeric terms
• Efficient copying of a subset of indexes
• Loading searchers into a RAMDirectory
• SortFields support custom parsers and field cache reuse

What is new in version 0.6:

• Python 2.7 compatible.
• Efficient spellchecking: suggestions (auto-complete) and corrections (did you mean?).
• Support for custom query parsers, including a spellchecker.
• Queries support extracting terms.
• Indexing supports boosting documents.
• Optimized document field selection.
• More configurable server start options, similar to cherryd.
• Span queries support masking and payloads.