BiBTeXTokenizer (open)

Constructor

• MACRO NEW(STRING value, BOOLEAN verbose, BOOLEAN reportnonalpha, BOOLEAN reproduce)
  

  Create a new BiBTeX tokenizer

Variables

• INTEGER blockdepth
  

  Current block depth

• INTEGER line
  

  Current line number

• INTEGER linestart
  

  Position of the start of the current line within the parsed document

• MONEY numbervalue
  

  Number value (currently always 0)

• INTEGER startpos
  

  Position within the parsed document

• STRING token
  

  Current token

• STRING type
  

  Type of the token

• STRING value
  

  Associated value (eg comment string for a comment)

Functions

• MACRO ConsumeToken()
  

  Parse the next token

• RECORD FUNCTION GetToken()
  

  Returns the current token