coda-d v0.0.3 (2017-03-29T07:44:02Z)
Dub
Repo
Tokenizer
coda
Undocumented in source.
class
Tokenizer {
this
(Tools.Language language);
~this
();
TokensStorage
tokenize
(Tstring lineToSplit);
}
Constructors
this
this
(Tools.Language language)
Undocumented in source.
Destructor
~this
~this
()
Undocumented in source.
Members
Functions
tokenize
TokensStorage
tokenize
(Tstring lineToSplit)
Undocumented in source. Be warned that the author may not have intended to support it.
Meta
Source
See Implementation
coda
classes
DisambiguatedDataStorage
Disambiguator
SentenceSplitter
SyntaxParser
SyntaxTree
Tokenizer
TokensStorage
enums
Language
structs
SyntaxNode