Handle cut-off UTF-8 sequences when reading files

Read additional bytes from the file to complete the UTF-8 sequence so the bytes
in it don't get converted to U+FFFD replacement characters.
This commit is contained in:
William Langford committed 2017-01-27 21:04:26 -05:00
1 parent fd4ae8304e
commit e84d17196c
7 files changed
+54 -5

No files matched your search

+1 -1
View File
@@ -115,7 +115,7 @@ endif
### Tests (make check)
TESTS = tests/optionaltest tests/mantest tests/jqtest tests/onigtest tests/shtest
TESTS = tests/optionaltest tests/mantest tests/jqtest tests/onigtest tests/shtest tests/utf8test
TESTS_ENVIRONMENT = NO_VALGRIND=$(NO_VALGRIND)