Package EasyExtend :: Module eetokenizer
[hide private]
[frames] | no frames]

Module eetokenizer



eetokenize merges the stdlibs tokenize.py module with the modules parser/StdTokenizer.py and parser/TokenUtils.py

Classes [hide private]
  StopTokenizing
  LineList
Class LineList Implements a readline-style interface to a string.
  StdTokenizer
Functions [hide private]
 
printtoken(type, token, (srow, scol), (erow, ecol), line)