ralsina/tartrazine
1
0
Fork 0
mirror of https://github.com/ralsina/tartrazine.git synced 2024-09-20 15:31:21 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
6be1ebe9d6
tartrazine/internal/tokenizer/flex
History
Alexander Bezzubov 78d8f43a88
tokenizer: hide flex-based impl, avoid build failures on win 
TestPlan:
 - go test -run TestTokenize ./internal/tokenizer
 - go test -tags flex -run TestTokenize ./internal/tokenizer
   (shold fail as default fixtures are from regex-based tokenizer)
2020-03-19 19:58:48 +01:00
..
lex.linguist_yy.c refactor to build tags 2019-04-14 21:38:16 +02:00
lex.linguist_yy.h refactor to build tags 2019-04-14 21:38:16 +02:00
linguist.h tokenizer: cleanup & attributions 2019-04-14 21:38:16 +02:00
tokenize_c.go tokenizer: hide flex-based impl, avoid build failures on win 2020-03-19 19:58:48 +01:00