org.nuxeo.ecm.core.storage

Class DefaultFulltextParser

java.lang.Object

org.nuxeo.ecm.core.storage.DefaultFulltextParser

All Implemented Interfaces:

FulltextParser

public class DefaultFulltextParser
extends Object
implements FulltextParser

Default fulltext parser, based on word and punctuation split, and lowercase normalization.

The regexp used can be configured using the system property "org.nuxeo.fulltext.wordsplit". The default is "[\\s\\p{Punct}]+".

Since:

5.9.5

Field Summary

Fields

Modifier and Type	Field and Description
static String	WORD_SPLIT_DEF
protected static Pattern	WORD_SPLIT_PATTERN
static String	WORD_SPLIT_PROP

Constructor Summary

Constructors

Constructor and Description
DefaultFulltextParser()

Method Summary

Modifier and Type	Method and Description
String	parse(String s, String path) Parses one property value to normalize the fulltext for the database.
void	parse(String s, String path, List<String> strings) Parses one property value to normalize the fulltext for the database.
protected String	preprocessField(String s, String path) Preprocesses one field at the given path.
protected String	removeHtml(String s)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

WORD_SPLIT_PROP

public static final String WORD_SPLIT_PROP

See Also:

Constant Field Values

WORD_SPLIT_DEF

public static final String WORD_SPLIT_DEF

See Also:

Constant Field Values

WORD_SPLIT_PATTERN

protected static final Pattern WORD_SPLIT_PATTERN

Constructor Detail

DefaultFulltextParser

public DefaultFulltextParser()

Method Detail

parse

public String parse(String s,
                    String path)

Description copied from interface: FulltextParser

Parses one property value to normalize the fulltext for the database.

The passed path may be null if the passed string is not coming from a specific path, for instance when it was extracted from binary data.

Specified by:

parse in interface FulltextParser

Parameters:

s - the string to be parsed and normalized

path - the abstracted path for the property (where all complex indexes have been replaced by *), or null

Returns:

the normalized words as a single space-separated string

parse

public void parse(String s,
                  String path,
                  List<String> strings)

Parses one property value to normalize the fulltext for the database.

Like FulltextParser.parse(String, String) but uses the passed list to accumulate words.

The default implementation normalizes text to lowercase and removes punctuation.

This can be subclassed.

Specified by:

parse in interface FulltextParser

Parameters:

s - the string to be parsed and normalized

path - the abstracted path for the property (where all complex indexes have been replaced by *), or null

strings - the list into which normalized words should be accumulated

preprocessField

protected String preprocessField(String s,
                                 String path)

Preprocesses one field at the given path.

The path is unused for now.

removeHtml

protected String removeHtml(String s)