Package EasyExtend :: Module eetokpattern
[hide private]
[frames] | no frames]

Module eetokpattern



Module used to define compiled token for the eetokenizer. This module is based on definitions made in std-libs tokenize.py

Functions [hide private]
 
quote_single(prefix)
For some string s this method defines: s -> s'
 
quote_triple(prefix)
For some string s this method defines: s -> s'''
 
gettoken(fibertoken)
Creates compiled token values used by the tokenizer.
Function Details [hide private]

gettoken(fibertoken)

 
Creates compiled token values used by the tokenizer. These token values depend on specific FiberToken classes defined for fibers.
Parameters:
  • fibertoken - token module instance of fiber.