ralsina/tartrazine
1
0
Fork 0
mirror of https://github.com/ralsina/tartrazine.git synced 2025-06-19 14:43:05 -03:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

tokenizer: hide flex-based impl, avoid build failures on win

Browse Source 
TestPlan:
 - go test -run TestTokenize ./internal/tokenizer
 - go test -tags flex -run TestTokenize ./internal/tokenizer
   (shold fail as default fixtures are from regex-based tokenizer)
This commit is contained in:
Alexander Bezzubov
2020-03-19 19:58:48 +01:00
parent 1ab8148c10
commit 78d8f43a88
2 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
internal/tokenizer/flex/tokenize_c.go
View File

@ -1,3 +1,5 @@
// +build flex
package flex
// #include <stdlib.h>