Splits the words from a text by whitespace characters. More...

Inheritance diagram for WhitespaceTok:

Collaboration diagram for WhitespaceTok:

Public Member Functions
	tokenise (&$text)

Detailed Description

Splits the words from a text by whitespace characters.

Punctuation marks are also split from accompanying words.

Definition at line 47 of file WhitespaceTok.php.

Member Function Documentation

WhitespaceTok::tokenise ( &$ text )

Implements Tokeniser.

Definition at line 52 of file WhitespaceTok.php.

The documentation for this class was generated from the following file: