org.openimaj.web.scraping

Class HTMLScrapingSiteSpecificConsumer

java.lang.Object

org.openimaj.web.scraping.HTMLScrapingSiteSpecificConsumer

All Implemented Interfaces:

SiteSpecificConsumer

Direct Known Subclasses:

SimpleHTMLScrapingConsumer, TwipleConsumer

public abstract class HTMLScrapingSiteSpecificConsumer
extends Object
implements SiteSpecificConsumer

Abstract base for scraping data from elements in web pages

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Constructor Summary

Constructors

Constructor and Description
HTMLScrapingSiteSpecificConsumer()

Method Summary

Methods

Modifier and Type	Method and Description
List<URL>	consume(URL url) Get the data urls at the given URL.
abstract String	cssSelect()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.openimaj.web.scraping.SiteSpecificConsumer

canConsume

Constructor Detail

HTMLScrapingSiteSpecificConsumer

public HTMLScrapingSiteSpecificConsumer()

Method Detail

consume

public List<URL> consume(URL url)

Description copied from interface: SiteSpecificConsumer

Get the data urls at the given URL.

Specified by:

consume in interface SiteSpecificConsumer

Parameters:

url - the url to test

Returns:

A list of URLs to data items at the given URL

cssSelect

public abstract String cssSelect()

Returns:

the css selection from which to find the img to scrape