Package | Description |
---|---|
org.apache.manifoldcf.agents.incrementalingest | |
org.apache.manifoldcf.agents.interfaces | |
org.apache.manifoldcf.crawler.system |
Modifier and Type | Class and Description |
---|---|
class |
IncrementalIngester
Incremental ingestion API implementation.
|
Modifier and Type | Method and Description |
---|---|
static IIncrementalIngester |
IncrementalIngesterFactory.make(IThreadContext threadContext)
Get an appropriate incremental ingest manager handle.
|
Modifier and Type | Field and Description |
---|---|
protected IIncrementalIngester |
WorkerThread.ProcessActivity.ingester |
Modifier and Type | Method and Description |
---|---|
protected static void |
WorkerThread.processDeleteLists(IPipelineConnections pipelineConnections,
IRepositoryConnector connector,
IRepositoryConnection connection,
IJobManager jobManager,
List<QueuedDocument> deleteList,
IIncrementalIngester ingester,
Long jobID,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
int hopcountMethod,
IReprioritizationTracker rt,
long currentTime)
Clear specified documents out of the job queue and from the appliance.
|
protected static void |
WorkerThread.processHopcountRemovalLists(IPipelineConnections pipelineConnections,
IRepositoryConnector connector,
IRepositoryConnection connection,
IJobManager jobManager,
List<QueuedDocument> hopcountremoveList,
IIncrementalIngester ingester,
Long jobID,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
int hopcountMethod,
IReprioritizationTracker rt,
long currentTime)
Mark specified documents as 'hopcount removed', and remove them from the
index.
|
protected static List<QueuedDocument> |
WorkerThread.removeFromIndex(IPipelineConnections pipelineConnections,
String connectionName,
IJobManager jobManager,
List<QueuedDocument> deleteList,
IIncrementalIngester ingester,
WorkerThread.OutputActivity ingestLogger)
Remove a specified set of documents from the index.
|
Constructor and Description |
---|
PipelineSpecification(IPipelineConnections connections,
IJobDescription job,
IIncrementalIngester ingester) |
WorkerThread.ProcessActivity(Long jobID,
String processID,
IReprioritizationTracker rt,
IJobManager jobManager,
IIncrementalIngester ingester,
String connectionName,
IPipelineSpecification pipelineSpecification,
Map<String,QueuedDocument> previousDocuments,
long currentTime,
Long expireInterval,
Map<String,Set<String>> forcedMetadata,
Long recrawlInterval,
Long maxInterval,
int hopcountMode,
IRepositoryConnection connection,
IRepositoryConnector connector,
IRepositoryConnectionManager connMgr,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
String parameterVersion)
Constructor.
|