parse method

List<TokenNode> parse(
  1. String input
)
inherited

Parses the given text using mecab and returns mecab's output

Implementation

List<TokenNode> parse(String input) {

  var resultStr = "";

  resultStr =
    (mecabDartFfi.parseFfi(mecabDartFfi.mecabPtr!, input.toNativeUtf8()))
    .toDartString().trim();

  List<String> items;
  if (resultStr.contains('\n')) {
    items = resultStr.split('\n');
  } else {
    items = resultStr.split(' ');
  }

  List<TokenNode> tokens = [];
  for (var item in items) {
    tokens.add(TokenNode(item));
  }
  return tokens;

}