com.exalead.mercury.mami.crawl.v10

Class FeedFetcher

java.lang.Object

com.exalead.mercury.mami.crawl.v10.ICrawler

com.exalead.mercury.mami.crawl.v10.FeedFetcher

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable

public class FeedFetcher
extends ICrawler
implements java.io.Serializable, java.lang.Cloneable

A feedfetcher configuration.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected CrawlSchedulerConfig	crawlSchedulerConfig
protected CustomCrawlConfig	customCrawlConfig
protected java.util.List<FeedFetcherSource>	feedFetcherSource
protected java.util.List<KeyValue>	keyValue

Fields inherited from class com.exalead.mercury.mami.crawl.v10.ICrawler

aggressive, buildGroup, crawlerServer, crawlSitemaps, defaultFetcher, enableConvertProcessor, ignoreRobotsTxt, name, nearDuplicateDetector, nthreads, patternsDetector, throttleTimeMS

Constructor Summary

Constructors

Constructor and Description
FeedFetcher() Creates a new FeedFetcher instance.
FeedFetcher(FeedFetcher o) Creates a new FeedFetcher instance by deeply copying a given FeedFetcher instance.

Method Summary

Modifier and Type	Method and Description
FeedFetcher	clone() Creates and returns a deep copy of this object.
CrawlSchedulerConfig	getCrawlSchedulerConfig() Gets the value of the crawlSchedulerConfig property.
CustomCrawlConfig	getCustomCrawlConfig() Gets the value of the customCrawlConfig property.
java.util.List<FeedFetcherSource>	getFeedFetcherSource() Gets the value of the feedFetcherSource property.
java.util.List<KeyValue>	getKeyValue() Gets the value of the keyValue property.
void	setCrawlSchedulerConfig(CrawlSchedulerConfig value) Sets the value of the crawlSchedulerConfig property.
void	setCustomCrawlConfig(CustomCrawlConfig value) Sets the value of the customCrawlConfig property.
FeedFetcher	withAggressive(java.lang.Boolean value)
FeedFetcher	withBuildGroup(java.lang.String value)
FeedFetcher	withCrawlerServer(java.lang.String value)
FeedFetcher	withCrawlSchedulerConfig(CrawlSchedulerConfig value)
FeedFetcher	withCrawlSitemaps(java.lang.Boolean value)
FeedFetcher	withCustomCrawlConfig(CustomCrawlConfig value)
FeedFetcher	withDefaultFetcher(java.lang.String value)
FeedFetcher	withEnableConvertProcessor(java.lang.Boolean value)
FeedFetcher	withFeedFetcherSource(java.util.Collection<FeedFetcherSource> values)
FeedFetcher	withFeedFetcherSource(FeedFetcherSource... values)
FeedFetcher	withIgnoreRobotsTxt(java.lang.Boolean value)
FeedFetcher	withKeyValue(java.util.Collection<KeyValue> values)
FeedFetcher	withKeyValue(KeyValue... values)
FeedFetcher	withName(java.lang.String value)
FeedFetcher	withNearDuplicateDetector(java.lang.Boolean value)
FeedFetcher	withNthreads(java.lang.Integer value)
FeedFetcher	withPatternsDetector(java.lang.Boolean value)
FeedFetcher	withThrottleTimeMS(java.lang.Integer value)

Methods inherited from class com.exalead.mercury.mami.crawl.v10.ICrawler

getBuildGroup, getCrawlerServer, getDefaultFetcher, getName, getNthreads, getThrottleTimeMS, isAggressive, isCrawlSitemaps, isEnableConvertProcessor, isIgnoreRobotsTxt, isNearDuplicateDetector, isPatternsDetector, setAggressive, setBuildGroup, setCrawlerServer, setCrawlSitemaps, setDefaultFetcher, setEnableConvertProcessor, setIgnoreRobotsTxt, setName, setNearDuplicateDetector, setNthreads, setPatternsDetector, setThrottleTimeMS

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

crawlSchedulerConfig

protected CrawlSchedulerConfig crawlSchedulerConfig

customCrawlConfig

protected CustomCrawlConfig customCrawlConfig

keyValue

protected java.util.List<KeyValue> keyValue

feedFetcherSource

protected java.util.List<FeedFetcherSource> feedFetcherSource

Constructor Detail

FeedFetcher

public FeedFetcher()

Creates a new FeedFetcher instance.

FeedFetcher

public FeedFetcher(FeedFetcher o)

Creates a new FeedFetcher instance by deeply copying a given FeedFetcher instance.

Parameters:

o - The instance to copy.

Throws:

java.lang.NullPointerException - if o is null.

Method Detail

getCrawlSchedulerConfig

public CrawlSchedulerConfig getCrawlSchedulerConfig()

Gets the value of the crawlSchedulerConfig property.

Returns:

possible object is CrawlSchedulerConfig

setCrawlSchedulerConfig

public void setCrawlSchedulerConfig(CrawlSchedulerConfig value)

Sets the value of the crawlSchedulerConfig property.

Parameters:

value - allowed object is CrawlSchedulerConfig

getCustomCrawlConfig

public CustomCrawlConfig getCustomCrawlConfig()

Gets the value of the customCrawlConfig property.

Returns:

possible object is CustomCrawlConfig

setCustomCrawlConfig

public void setCustomCrawlConfig(CustomCrawlConfig value)

Sets the value of the customCrawlConfig property.

Parameters:

value - allowed object is CustomCrawlConfig

getKeyValue

public java.util.List<KeyValue> getKeyValue()

Gets the value of the keyValue property.

This accessor method returns a reference to the live list, not a snapshot. Therefore any modification you make to the returned list will be present inside the JAXB object. This is why there is not a set method for the keyValue property.

For example, to add a new item, do as follows:

    getKeyValue().add(newItem);
 

Objects of the following type(s) are allowed in the list KeyValue

getFeedFetcherSource

public java.util.List<FeedFetcherSource> getFeedFetcherSource()

Gets the value of the feedFetcherSource property.

This accessor method returns a reference to the live list, not a snapshot. Therefore any modification you make to the returned list will be present inside the JAXB object. This is why there is not a set method for the feedFetcherSource property.

For example, to add a new item, do as follows:

    getFeedFetcherSource().add(newItem);
 

Objects of the following type(s) are allowed in the list FeedFetcherSource

withCrawlSchedulerConfig

public FeedFetcher withCrawlSchedulerConfig(CrawlSchedulerConfig value)

withCustomCrawlConfig

public FeedFetcher withCustomCrawlConfig(CustomCrawlConfig value)

withKeyValue

public FeedFetcher withKeyValue(KeyValue... values)

withKeyValue

public FeedFetcher withKeyValue(java.util.Collection<KeyValue> values)

withFeedFetcherSource

public FeedFetcher withFeedFetcherSource(FeedFetcherSource... values)

withFeedFetcherSource

public FeedFetcher withFeedFetcherSource(java.util.Collection<FeedFetcherSource> values)

withName

public FeedFetcher withName(java.lang.String value)

Overrides:

withName in class ICrawler

withCrawlerServer

public FeedFetcher withCrawlerServer(java.lang.String value)

Overrides:

withCrawlerServer in class ICrawler

withBuildGroup

public FeedFetcher withBuildGroup(java.lang.String value)

Overrides:

withBuildGroup in class ICrawler

withNthreads

public FeedFetcher withNthreads(java.lang.Integer value)

Overrides:

withNthreads in class ICrawler

withAggressive

public FeedFetcher withAggressive(java.lang.Boolean value)

Overrides:

withAggressive in class ICrawler

withThrottleTimeMS

public FeedFetcher withThrottleTimeMS(java.lang.Integer value)

Overrides:

withThrottleTimeMS in class ICrawler

withIgnoreRobotsTxt

public FeedFetcher withIgnoreRobotsTxt(java.lang.Boolean value)

Overrides:

withIgnoreRobotsTxt in class ICrawler

withEnableConvertProcessor

public FeedFetcher withEnableConvertProcessor(java.lang.Boolean value)

Overrides:

withEnableConvertProcessor in class ICrawler

withNearDuplicateDetector

public FeedFetcher withNearDuplicateDetector(java.lang.Boolean value)

Overrides:

withNearDuplicateDetector in class ICrawler

withPatternsDetector

public FeedFetcher withPatternsDetector(java.lang.Boolean value)

Overrides:

withPatternsDetector in class ICrawler

withDefaultFetcher

public FeedFetcher withDefaultFetcher(java.lang.String value)

Overrides:

withDefaultFetcher in class ICrawler

withCrawlSitemaps

public FeedFetcher withCrawlSitemaps(java.lang.Boolean value)

Overrides:

withCrawlSitemaps in class ICrawler

clone

public FeedFetcher clone()

Creates and returns a deep copy of this object.

Overrides:

clone in class ICrawler

Returns:

A deep copy of this object.