pretokenizers/whitespacepretokenizer/whitespacepretokenizer.go
comment on exported var DefaultWordRegexp should be of the form "DefaultWordRegexp ..." Open
Open
// (readonly)
- Exclude checks
exported function NewDefault should have comment or be unexported Open
Open
func NewDefault() *WhiteSpacePreTokenizer {
- Exclude checks