Tokenize ( Text ; Separator )

Returns value list of all words from Text

Average rating: 3.9 (39 votes) Log in to vote

Ilya Shuvalov
SUI Solutions
http://filemaker.suisolutions.com

Sample input:

Tokenize ( “john_smith*marysmith*family’s friend” , ”*”)

Sample output:

john_smith
marysmith
family’s friend

Function definition: (Copy & paste into FileMaker's Edit Custom Function window)

Let([
spaсe = " ";
spaсedText =If( $Already_Sub="yes";Text; Substitute ( text ; "." ; spaсe ));
spaсedText = If( $Already_Sub="yes";spaсedText; Substitute ( spaсedText ; "," ; spaсe ));
$Already_Sub = "yes";
flag = If (IsEmpty(separator);0;1);
adjustedText = If(flag; text; spaсedText );
count = PatternCount(adjustedText;If(flag; Separator; spaсe));
first = Position(adjustedText; If(flag; Separator; spaсe) ; 1 ; 1 );
word = Left( adjustedText ; If(first = 0 ;Length ( adjustedText ); first-1));
adjustedText = Right (adjustedText; Length ( adjustedText ) - first);
$Result = If ( IsEmpty(word) ; $Result ; $Result&word&¶  )
];
If(count   ≠  0; Tokenize(adjustedText; Separator);Left($Result; Length ($Result )-1)))

Splits the Text on single words/phrases using the Separator.

If the empty Separator is used ("") then space (" "), dot ("."), and colon (",") are used as a word separator simultaneously

The words are returned as a value list with carriage returns

Comments

		markv, england Jan 20, 2014
$Result variable doesn't clear itself after use of function means any subsequent use of function adds to exiting $Result variable (builds longer and longer list ;-)

Note: these functions are not guaranteed or supported by BrianDunning.com. Please contact the individual developer with any questions or problems.

Tokenize ( Text ; Separator )

Comments

Support this website.

Support this website.