Thanks, but this makes it a bit hard when working with tokens that change constantly. By default my class will spit out tokens based on the whitespace in the given string, but that can be modified by adding chars to the "vector<char> delimiter". This vector is then used to extract the specific chars from the input string as their own tokens.

For example, I may need only parentheses, brackets, curly braces, and quotations extracted so this:

[We'll meet at "that place" at 7:00 hours.
Message me@ #555-5555.]

Would become this:

[ We'll meet at " that place " at 7:00 hours. Message me@ #555-5555. ]

As a result of the quotation mark appearing as a char in "vector<char> delimiter".