tartrazine/internal/tokenizer
Alexander Bezzubov e32a70a784
tokenizer: fix a bug and regenerate the code \w latest Go
See https://github.com/bzz/enry/pull/4 for details.

Test Plan:
 - go test ./...
2020-03-19 19:08:21 +01:00
..
flex address review feedback 2019-04-16 19:38:48 +02:00
common.go address review feedback 2019-04-16 19:38:48 +02:00
tokenize_c.go *: module rename to go-enry/go-enry/v4 2020-03-19 17:31:29 +01:00
tokenize_test.go tokenizer: fix a bug and regenerate the code \w latest Go 2020-03-19 19:08:21 +01:00
tokenize.go tokenizer: fix a bug and regenerate the code \w latest Go 2020-03-19 19:08:21 +01:00