ralsina/tartrazine
1
0
Fork 0
mirror of https://github.com/ralsina/tartrazine.git synced 2025-06-27 22:57:50 -03:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Merge commit 'f955c625aded244864e83a872b396868a490dbc5' as 'go-enry'

Browse Source
This commit is contained in:
Roberto Alsina
2024-09-04 16:33:41 -03:00
parent 6a38f2f5fb f955c625ad
commit e44f64a7df
192 changed files with 528500 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
go-enry/internal/tokenizer/flex/linguist.h Normal file
View File

@ -0,0 +1,15 @@
// https://github.com/github/linguist/blob/f72f2a21dfe80ebd16af3bc6216da75cd983a4f6/ext/linguist/linguist.h#L1
enum tokenizer_type {
NO_ACTION,
REGULAR_TOKEN,
SHEBANG_TOKEN,
SGML_TOKEN,
};
struct tokenizer_extra {
char *token;
enum tokenizer_type type;
};
// TODO(bzz) port Win support from
// https://github.com/github/linguist/commit/8e912b4d8bf2aef7948de59eba48b75cfcbc97e0