returns the tokens of a character string.
T=tokens(str [,delimiter])
:str A character string. The string where to search the tokens. : :delimiter (optional) a character or a vector of characters. The
tokens delimeters.
: :T column vector of found tokens :
T=tokens(str [,delimiter]) searches the tokens included in the string str. The delimiter default value is [” ”,<Tab>] where <Tab> stands for ascii(9).
tokens('This is a character string')
tokens('SCI/demos/scicos','/')
tokens('y=a+b*2',['=','+','*'])