Alexander Bezzubov
f3ceaa6330
token: refactor & simplify test fixtures
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 22:17:32 +02:00
Alexander Bezzubov
9a7b370b17
regex: in oniguruma profile, switch to ASCII matching
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 15:31:55 +02:00
Alexander Bezzubov
fb267d3aff
bump src-d/go-onigoruma to v1.1.0
...
A result of:
```
go get github.com/src-d/go-onigoruma
go mod tidy
```
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 15:29:36 +02:00
Alexander Bezzubov
48fc84a555
ci: bump oniguruma version v5.x -> v6.9.1
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 15:26:22 +02:00
Alexander Bezzubov
a724a2f841
token: test case for regexp + non-valid UTF8
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-07 13:46:36 +02:00
Alexander Bezzubov
8bdc830833
token: new test case with Unicode replacement
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-17 19:28:06 +02:00
Alexander Bezzubov
278eaf1c22
tokenizer: move flex-based to modules
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-17 13:54:34 +02:00
Alexander
ae43e1a91f
Merge pull request #219 from bzz/go-mod
...
Introduce Go modules
2019-04-17 13:39:55 +02:00
Alexander
b6daf5c079
Merge pull request #218 from bzz/tokenizer-flex-cgo
...
New, optional flex-based tokenizer
2019-04-17 13:38:34 +02:00
Alexander Bezzubov
7e136bade8
test: don't export tokenizer fixtures
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-16 19:38:48 +02:00
Alexander Bezzubov
6c7b91cb91
doc: improve API doc on review feedback
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-16 19:38:48 +02:00
Alexander Bezzubov
ada6f15c93
address review feedback
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-16 19:38:48 +02:00
Alexander Bezzubov
7929933eb5
tokenizer: cleanup & attributions
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:38:16 +02:00
Alexander Bezzubov
8756fbdcb4
refactor to build tags
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:38:16 +02:00
Alexander Bezzubov
553399ed76
tokenizer: port flex-based C impl from linguist
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:38:16 +02:00
Alexander Bezzubov
6a5f37e9e2
modules: prepare for v2 release
...
- update go.mod \w v2
- update all import paths
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:28:12 +02:00
Alexander Bezzubov
453caf7d19
ci: simplify go & add maintainer to java pom
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 19:28:51 +02:00
Alexander Bezzubov
cb765d1243
ci: GOPATH-independent simplifications
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 12:16:38 +02:00
Alexander Bezzubov
9a46d6bc8d
ci: test on 2 latest Go version \w modules
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 11:51:24 +02:00
Alexander Bezzubov
20c6d2845a
build: gopkg.in -> github.com imports
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 11:49:16 +02:00
Alexander Bezzubov
a4a2b1d68a
build: go module defention and deps
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 11:47:37 +02:00
Alexander
ab3c26b46d
Merge pull request #224 from bzz/ci-fix-linux-shared-release
...
HOTFIX: enable cgo for linux native lib release on CI
2019-04-12 00:14:58 +02:00
Alexander Bezzubov
ade47c0a22
ci: enable cgo for linux native lib release
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 23:25:27 +02:00
Alexander
8c5e0ceaca
Merge pull request #222 from bzz/ci-workaround
...
CI: workaround for incompatible compiler release binary
2019-04-11 23:02:24 +02:00
Alexander Bezzubov
85d5906b2b
address review feedback - tixing a fypo
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 21:36:29 +02:00
Alexander Bezzubov
85de120c17
ci: export env vars
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 21:35:49 +02:00
Alexander Bezzubov
41478262f3
fix verb mismatch in a format string
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:28:49 +02:00
Alexander Bezzubov
110822b014
ci: remove 'sudo: false' as it's deprecated on Travis
...
See https://docs.travis-ci.com/user/reference/trusty/#container-based-infrastructure
and https://blog.travis-ci.com/2018-11-19-required-linux-infrastructure-migration#timeline---its-happening-fast
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:10:56 +02:00
Alexander Bezzubov
5fab94b5b9
ci: disable cgo by default
...
With go1.11 `go test` in GOPATH mode somehow
seems to depend on GCC. See https://github.com/golang/go/issues/28065
This change only enables cgo for CI profiles that
need it. Those are the ones that seem to fail
on TravisCI now, presumably due to some compiler
version missmatch.
That is a workaround and does not happen in GO11MODULE mode.
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:10:43 +02:00
Alexander Bezzubov
58a81694f6
ci: fix bug that enabled oniguruma for all profiles
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:09:47 +02:00
Alexander Bezzubov
d73725709b
ci: fix versions to workaround compiler release 🐛
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:08:32 +02:00
Alexander
59289bd4f5
Merge pull request #220 from bzz/skip-jar-upload
...
Skip uploading useless jar as part of Github release
2019-04-09 18:39:55 +02:00
Alexander Bezzubov
82f784d2f7
release: skip uploading useless jar; fixes #208
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-09 18:27:07 +02:00
Alexander
7a6e8ca783
Merge pull request #214 from bzz/fix-cli-accuracy
...
CLI: sync report logic \w Linguist
2019-04-09 16:32:52 +02:00
M. J. Fromberger
bad147cb72
Update README.md
...
Co-Authored-By: bzz <bzz@users.noreply.github.com>
2019-04-08 18:00:43 +02:00
Alexander Bezzubov
bdb5603f28
Address code review feedback
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-08 16:07:10 +02:00
Alexander Bezzubov
416afb45fc
doc: better wording in 'divergences from linguist' section
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-08 15:58:46 +02:00
Alexander
db6073efa6
Merge pull request #217 from bzz/single-file-add-vendor
...
CLI: always report vendoring for a single file
2019-04-08 11:41:05 +02:00
Alexander Bezzubov
b6027d6d0c
cli: mode=byte by default + fix file reading
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-04 22:02:30 +02:00
Alexander Bezzubov
ace8af223f
cli: report vendoring for single file
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-04 17:04:16 +02:00
Alexander
33cc83f473
Merge pull request #211 from SuhaibMujahid/patch-1
...
Update README.md
2019-04-04 15:32:13 +02:00
Alexander Bezzubov
94e8598d3d
doc: update TravisCI links
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-04 15:27:12 +02:00
Alexander
32336ac554
Update README.md
...
Co-Authored-By: SuhaibMujahid <suhaibmujahid@gmail.com>
Signed-off-by: Suhaib Mujahid <suhaibmujahid@gmail.com>
2019-04-03 14:59:31 -04:00
Alexander Bezzubov
c9f1793a78
doc: update godoc and README \w supported features
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 18:51:54 +02:00
Alexander Bezzubov
88810fed12
cli: mimic linguist output by default
...
This includes next main changes:
- default: print only Programming and Markup types
as Linguist does
- `-prog` option replaced with `-all`, to allow for
previous behavior
- always use GetLanguage as main source of truth
that fixes #204 and perf will be restored under #212
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 16:21:10 +02:00
Alexander Bezzubov
df01124e18
doc: better wording in API godoc
...
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 16:07:14 +02:00
Alexander Bezzubov
b2b61c2a8c
gen: refactoring, renaming vars for readability
...
This does not change the logic of the generatro
but only renames/moves some vars for readability
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 15:40:23 +02:00
Suhaib Mujahid
badbfd06e5
Update README.md
...
Signed-off-by: Suhaib Mujahid <suhaibmujahid@gmail.com>
2019-04-01 18:49:01 -04:00
Alexander
6526da77b3
Merge pull request #205 from kuba--/fix-langs
...
Do not return empty lang.
2019-03-15 18:51:55 +01:00
Alexander
56214e3289
Merge pull request #206 from kuba--/go-mod
...
Replace archived rubex by src-d/go-oniguruma
2019-03-15 16:19:38 +01:00