com.exalead.mercury.mami.crawl.v20

Class CustomCrawlConfig

java.lang.Object

com.exalead.mercury.mami.crawl.v20.CustomCrawlConfig

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable

public class CustomCrawlConfig
extends java.lang.Object
implements java.io.Serializable, java.lang.Cloneable

Custom processors specification.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected java.lang.String	crawlerTemplate
protected java.lang.String	fetcherClassId
protected java.lang.String	htmlProcessorClassId
protected java.lang.String	linksFilterClassId
protected java.lang.String	postProcessorClassId
protected java.lang.String	preProcessorClassId
protected java.lang.String	processorClassId

Constructor Summary

Constructors

Constructor and Description
CustomCrawlConfig() Creates a new CustomCrawlConfig instance.
CustomCrawlConfig(CustomCrawlConfig o) Creates a new CustomCrawlConfig instance by deeply copying a given CustomCrawlConfig instance.

Method Summary

Modifier and Type	Method and Description
CustomCrawlConfig	clone() Creates and returns a deep copy of this object.
java.lang.String	getCrawlerTemplate() Alternatively, specify the url of a xml file describing the whole crawler.
java.lang.String	getFetcherClassId() Custom Fetcher.
java.lang.String	getHtmlProcessorClassId() Custom HTML Processor.
java.lang.String	getLinksFilterClassId() Custom LinksFilter.
java.lang.String	getPostProcessorClassId() Custom PostProcessor.
java.lang.String	getPreProcessorClassId() Custom PreProcessor.
java.lang.String	getProcessorClassId() Custom Processor.
void	setCrawlerTemplate(java.lang.String value) Sets the value of the crawlerTemplate property.
void	setFetcherClassId(java.lang.String value) Sets the value of the fetcherClassId property.
void	setHtmlProcessorClassId(java.lang.String value) Sets the value of the htmlProcessorClassId property.
void	setLinksFilterClassId(java.lang.String value) Sets the value of the linksFilterClassId property.
void	setPostProcessorClassId(java.lang.String value) Sets the value of the postProcessorClassId property.
void	setPreProcessorClassId(java.lang.String value) Sets the value of the preProcessorClassId property.
void	setProcessorClassId(java.lang.String value) Sets the value of the processorClassId property.
CustomCrawlConfig	withCrawlerTemplate(java.lang.String value)
CustomCrawlConfig	withFetcherClassId(java.lang.String value)
CustomCrawlConfig	withHtmlProcessorClassId(java.lang.String value)
CustomCrawlConfig	withLinksFilterClassId(java.lang.String value)
CustomCrawlConfig	withPostProcessorClassId(java.lang.String value)
CustomCrawlConfig	withPreProcessorClassId(java.lang.String value)
CustomCrawlConfig	withProcessorClassId(java.lang.String value)

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

preProcessorClassId

protected java.lang.String preProcessorClassId

fetcherClassId

protected java.lang.String fetcherClassId

processorClassId

protected java.lang.String processorClassId

htmlProcessorClassId

protected java.lang.String htmlProcessorClassId

linksFilterClassId

protected java.lang.String linksFilterClassId

postProcessorClassId

protected java.lang.String postProcessorClassId

crawlerTemplate

protected java.lang.String crawlerTemplate

Constructor Detail

CustomCrawlConfig

public CustomCrawlConfig()

Creates a new CustomCrawlConfig instance.

CustomCrawlConfig

public CustomCrawlConfig(CustomCrawlConfig o)

Creates a new CustomCrawlConfig instance by deeply copying a given CustomCrawlConfig instance.

Parameters:

o - The instance to copy.

Throws:

java.lang.NullPointerException - if o is null.

Method Detail

getPreProcessorClassId

public java.lang.String getPreProcessorClassId()

Custom PreProcessor. Called at the end of the preprocess pipe. (default: null)

Returns:

possible object is String

setPreProcessorClassId

public void setPreProcessorClassId(java.lang.String value)

Sets the value of the preProcessorClassId property.

Parameters:

value - allowed object is String

getFetcherClassId

public java.lang.String getFetcherClassId()

Custom Fetcher. (default: null)

Returns:

possible object is String

setFetcherClassId

public void setFetcherClassId(java.lang.String value)

Sets the value of the fetcherClassId property.

Parameters:

value - allowed object is String

getProcessorClassId

public java.lang.String getProcessorClassId()

Custom Processor. Called at the end of the process pipe. Catches all mime types. (default: null)

Returns:

possible object is String

setProcessorClassId

public void setProcessorClassId(java.lang.String value)

Sets the value of the processorClassId property.

Parameters:

value - allowed object is String

getHtmlProcessorClassId

public java.lang.String getHtmlProcessorClassId()

Custom HTML Processor. Called at the of the html process pipe. Catches only html documents. (default: null)

Returns:

possible object is String

setHtmlProcessorClassId

public void setHtmlProcessorClassId(java.lang.String value)

Sets the value of the htmlProcessorClassId property.

Parameters:

value - allowed object is String

getLinksFilterClassId

public java.lang.String getLinksFilterClassId()

Custom LinksFilter. Called at the end of the links filter list. Can decide whether to crawl an outgoing link. (default: null)

Returns:

possible object is String

setLinksFilterClassId

public void setLinksFilterClassId(java.lang.String value)

Sets the value of the linksFilterClassId property.

Parameters:

value - allowed object is String

getPostProcessorClassId

public java.lang.String getPostProcessorClassId()

Custom PostProcessor. Called at the end of the postprocess pipe. (default: null)

Returns:

possible object is String

setPostProcessorClassId

public void setPostProcessorClassId(java.lang.String value)

Sets the value of the postProcessorClassId property.

Parameters:

value - allowed object is String

getCrawlerTemplate

public java.lang.String getCrawlerTemplate()

Alternatively, specify the url of a xml file describing the whole crawler. (default: null)

Returns:

possible object is String

setCrawlerTemplate

public void setCrawlerTemplate(java.lang.String value)

Sets the value of the crawlerTemplate property.

Parameters:

value - allowed object is String

withPreProcessorClassId

public CustomCrawlConfig withPreProcessorClassId(java.lang.String value)

withFetcherClassId

public CustomCrawlConfig withFetcherClassId(java.lang.String value)

withProcessorClassId

public CustomCrawlConfig withProcessorClassId(java.lang.String value)

withHtmlProcessorClassId

public CustomCrawlConfig withHtmlProcessorClassId(java.lang.String value)

withLinksFilterClassId

public CustomCrawlConfig withLinksFilterClassId(java.lang.String value)

withPostProcessorClassId

public CustomCrawlConfig withPostProcessorClassId(java.lang.String value)

withCrawlerTemplate

public CustomCrawlConfig withCrawlerTemplate(java.lang.String value)

clone

public CustomCrawlConfig clone()

Creates and returns a deep copy of this object.

Overrides:

clone in class java.lang.Object

Returns:

A deep copy of this object.