---input---
a=1
b=2 # comment

---tokens---
'a'           Name.Variable
'='           Operator
'1'           Literal.Number
'\n'          Text.Whitespace

'b'           Name.Variable
'='           Operator
'2'           Literal.Number
' '           Text.Whitespace
'# comment\n' Comment.Single