Sign upLogin

nlpodyssey/gotokenizers

View on GitHub
Star
pretokenizers/bytelevelpretokenizer/bytelevelpretokenizer.go

Summary

Maintainability
A
40 mins
Test Coverage

Consider simplifying this complex logical expression.
Open

        if (i >= '!' && i <= '~') || (i >= 0xA1 && i <= 0xAC) || (i >= 0xAE && i <= 0xFF) {
Severity: Major
Found in pretokenizers/bytelevelpretokenizer/bytelevelpretokenizer.go - About 40 mins to fix

    There are no issues that match your filters.

    Category
    Status