c++ get tokens from a string with \t \n and empty space

Question

suppose I have a string

string text = "There are       many empty   space   and  tabs inside      ";

The empty space in this string might be \t or " ", and uncertain how many spaces or tabs between two tokens. How can I get tokens from that string? Which is a better method, 'strtok' or 'substring'?

Answer 1

Use an std::istringstream:

std::istringstream in (text);
std::vector<std::string> tokens;

for (std::string temp; in >> temp; )
    tokens.push_back(temp);