tokenizer: fix a bug and regenerate the code \w latest Go

See https://github.com/bzz/enry/pull/4 for details.

Test Plan:
 - go test ./...
This commit is contained in:
Alexander Bezzubov
2020-03-19 19:08:21 +01:00
parent e08125d7ee
commit e32a70a784
5 changed files with 192457 additions and 194383 deletions

File diff suppressed because it is too large Load Diff