Package EasyExtend :: Package trail :: Module nfaparser :: Class TokenStream

Class TokenStream

         object --+    
                  |    
AbstractTokenStream --+
                      |
                     TokenStream

Instance Methods

[hide private]

__init__(self, stream, ignored=[])
x.__init__(...) initializes x; see x.__class__.__doc__ for signature

__iter__(self)

__getitem__(self, idx)

is_ignored(self, tok)
Returns True when input token is in ignore list otherwise False

shift_read_position(self)
Shifts read position of token stream without returning token.

next(self)
returns next token in token stream.

__len__(self)

Inherited from object: __delattr__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __str__

Properties

[hide private]

Inherited from object: __class__

Method Details

[hide private]

init(self, stream, ignored=`[]`)
(Constructor)

x.__init__(...) initializes x; see x.__class__.__doc__ for signature

Overrides: object.__init__: (inherited documentation)

iter(self)

Overrides: AbstractTokenStream.__iter__

getitem(self, idx)
(Indexing operator)

Overrides: AbstractTokenStream.__getitem__

is_ignored(self, tok)

Returns True when input token is in ignore list otherwise False

Overrides: AbstractTokenStream.is_ignored: (inherited documentation)

shift_read_position(self)

Shifts read position of token stream without returning token.

Overrides: AbstractTokenStream.shift_read_position: (inherited documentation)

next(self)

returns next token in token stream. Using a previous shift_read_position it is actually the current token. Raises StopIteration when the token stream is exhausted.

Overrides: AbstractTokenStream.next: (inherited documentation)

len(self)
(Length operator)

Overrides: AbstractTokenStream.__len__

Class TokenStream

__init__(self, stream, ignored=[]) (Constructor)

__iter__(self)

__getitem__(self, idx) (Indexing operator)

is_ignored(self, tok)

shift_read_position(self)

next(self)

__len__(self) (Length operator)

init(self, stream, ignored=`[]`)
(Constructor)

iter(self)

getitem(self, idx)
(Indexing operator)

len(self)
(Length operator)