Real Lexical Rules

Real lexical rules

Blanks

" \u000C\r\n\t"

Comments

when 'no state' '#' comment '\n'

Token type

Value token

• TRUE keyword true
• FALSE keyword false
• NIL keyword nil
• STRING value " data "

String syntax sugar:

• "Left${expression}Right" Left +:add (:lparen expression tokens ):rparen +:add Right
• "Left$label Right" Left + identifier(label) + Right

end

• QUOTE value ' data '