Commit Graph

402 Commits

Author SHA1 Message Date
9a7b370b17 regex: in oniguruma profile, switch to ASCII matching
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 15:31:55 +02:00
fb267d3aff bump src-d/go-onigoruma to v1.1.0
A result of:
```
go get github.com/src-d/go-onigoruma
go mod tidy
```

Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 15:29:36 +02:00
48fc84a555 ci: bump oniguruma version v5.x -> v6.9.1
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-08 15:26:22 +02:00
a724a2f841 token: test case for regexp + non-valid UTF8
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-05-07 13:46:36 +02:00
8bdc830833 token: new test case with Unicode replacement
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-17 19:28:06 +02:00
278eaf1c22 tokenizer: move flex-based to modules
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-17 13:54:34 +02:00
ae43e1a91f Merge pull request #219 from bzz/go-mod
Introduce Go modules
2019-04-17 13:39:55 +02:00
b6daf5c079 Merge pull request #218 from bzz/tokenizer-flex-cgo
New, optional flex-based tokenizer
2019-04-17 13:38:34 +02:00
7e136bade8 test: don't export tokenizer fixtures
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-16 19:38:48 +02:00
6c7b91cb91 doc: improve API doc on review feedback
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-16 19:38:48 +02:00
ada6f15c93 address review feedback
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-16 19:38:48 +02:00
7929933eb5 tokenizer: cleanup & attributions
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:38:16 +02:00
8756fbdcb4 refactor to build tags
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:38:16 +02:00
553399ed76 tokenizer: port flex-based C impl from linguist
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:38:16 +02:00
6a5f37e9e2 modules: prepare for v2 release
- update go.mod \w v2
 - update all import paths

Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 21:28:12 +02:00
453caf7d19 ci: simplify go & add maintainer to java pom
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-14 19:28:51 +02:00
cb765d1243 ci: GOPATH-independent simplifications
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 12:16:38 +02:00
9a46d6bc8d ci: test on 2 latest Go version \w modules
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 11:51:24 +02:00
20c6d2845a build: gopkg.in -> github.com imports
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 11:49:16 +02:00
a4a2b1d68a build: go module defention and deps
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-12 11:47:37 +02:00
ab3c26b46d Merge pull request #224 from bzz/ci-fix-linux-shared-release
HOTFIX: enable cgo for linux native lib release on CI
2019-04-12 00:14:58 +02:00
ade47c0a22 ci: enable cgo for linux native lib release
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 23:25:27 +02:00
8c5e0ceaca Merge pull request #222 from bzz/ci-workaround
CI: workaround for incompatible compiler release binary
2019-04-11 23:02:24 +02:00
85d5906b2b address review feedback - tixing a fypo
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 21:36:29 +02:00
85de120c17 ci: export env vars
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 21:35:49 +02:00
41478262f3 fix verb mismatch in a format string
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:28:49 +02:00
110822b014 ci: remove 'sudo: false' as it's deprecated on Travis
See https://docs.travis-ci.com/user/reference/trusty/#container-based-infrastructure
and https://blog.travis-ci.com/2018-11-19-required-linux-infrastructure-migration#timeline---its-happening-fast

Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:10:56 +02:00
5fab94b5b9 ci: disable cgo by default
With go1.11 `go test` in GOPATH mode somehow
seems to depend on GCC. See https://github.com/golang/go/issues/28065

This change only enables cgo for CI profiles that
need it. Those are the ones that seem to fail
on TravisCI now, presumably due to some compiler
version missmatch.

That is a workaround and does not happen in GO11MODULE mode.

Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:10:43 +02:00
58a81694f6 ci: fix bug that enabled oniguruma for all profiles
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:09:47 +02:00
d73725709b ci: fix versions to workaround compiler release 🐛
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-11 15:08:32 +02:00
59289bd4f5 Merge pull request #220 from bzz/skip-jar-upload
Skip uploading useless jar as part of Github release
2019-04-09 18:39:55 +02:00
82f784d2f7 release: skip uploading useless jar; fixes #208
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-09 18:27:07 +02:00
7a6e8ca783 Merge pull request #214 from bzz/fix-cli-accuracy
CLI: sync report logic \w Linguist
2019-04-09 16:32:52 +02:00
bad147cb72 Update README.md
Co-Authored-By: bzz <bzz@users.noreply.github.com>
2019-04-08 18:00:43 +02:00
bdb5603f28 Address code review feedback
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-08 16:07:10 +02:00
416afb45fc doc: better wording in 'divergences from linguist' section
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-08 15:58:46 +02:00
db6073efa6 Merge pull request #217 from bzz/single-file-add-vendor
CLI: always report vendoring for a single file
2019-04-08 11:41:05 +02:00
b6027d6d0c cli: mode=byte by default + fix file reading
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-04 22:02:30 +02:00
ace8af223f cli: report vendoring for single file
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-04 17:04:16 +02:00
33cc83f473 Merge pull request #211 from SuhaibMujahid/patch-1
Update README.md
2019-04-04 15:32:13 +02:00
94e8598d3d doc: update TravisCI links
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-04 15:27:12 +02:00
32336ac554 Update README.md
Co-Authored-By: SuhaibMujahid <suhaibmujahid@gmail.com>
Signed-off-by: Suhaib Mujahid <suhaibmujahid@gmail.com>
2019-04-03 14:59:31 -04:00
c9f1793a78 doc: update godoc and README \w supported features
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 18:51:54 +02:00
88810fed12 cli: mimic linguist output by default
This includes next main changes:

 - default: print only Programming and Markup types
   as Linguist does
 - `-prog` option replaced with `-all`, to allow for
   previous behavior
 - always use GetLanguage as main source of truth
   that fixes #204 and perf will be restored under #212

Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 16:21:10 +02:00
df01124e18 doc: better wording in API godoc
Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 16:07:14 +02:00
b2b61c2a8c gen: refactoring, renaming vars for readability
This does not change the logic of the generatro
but only renames/moves some vars for readability

Signed-off-by: Alexander Bezzubov <bzz@apache.org>
2019-04-03 15:40:23 +02:00
badbfd06e5 Update README.md
Signed-off-by: Suhaib Mujahid <suhaibmujahid@gmail.com>
2019-04-01 18:49:01 -04:00
6526da77b3 Merge pull request #205 from kuba--/fix-langs
Do not return empty lang.
2019-03-15 18:51:55 +01:00
56214e3289 Merge pull request #206 from kuba--/go-mod
Replace archived rubex by src-d/go-oniguruma
2019-03-15 16:19:38 +01:00
14281d1785 Replace archived rubex by src-d/go-oniguruma
Signed-off-by: kuba-- <kuba@sourced.tech>
2019-03-14 16:09:25 +01:00