parse method

List<TokenNode> parse(
  1. String input
)

Parses the given text using mecab and returns parsed TokenNodes

Note: This method may fail if you use certain options. In that case, use rawParse instead, which returns the raw string output from mecab, and parse it manually.

Implementation

List<TokenNode> parse(String input) {

  String rawOutput = rawParse(input);

  List<String> items;
  if (rawOutput.contains('\n')) {
    items = rawOutput.split('\n');
  }
  else {
    items = rawOutput.split(' ');
  }

  List<TokenNode> tokens = [];
  for (var item in items) {
    if (item.isNotEmpty) {
      tokens.add(TokenNode(item));
    }
  }
  return tokens;

}