Split a string using a whitespace and CRLF as delimiters C++

Asked Jan 28 '16 at 15:18

Active Jan 28 '16 at 16:10

Viewed 615 times

I have a piece of code that currently splits a string using a whitespace as a delimiter. Each token is stored collectively in a vector of strings.The split function is show below:

vector<string> split(const string &s, char delim) {
    stringstream ss(s);
    string item;
    vector<string> tokens;
    while (getline(ss, item, delim)) {
        tokens.push_back(item);
    }
    return tokens;
}

The vector is defined as such:

vector<string> mocapVector = split(buffer.str(), ' ');

Example output of the vector can be seen here, where an item of the vector is outputted, and the console is shown alongside the original data file (the entire string before it is split.

To reiterate:

a b c
d e f
g h i

gets outputted as:

a

b

c
d

e

f
g

h

i

In the example, only the whitespace is a delimiter, and not CRLF (end of line). My question is, how can I use both whitespace AND CRLF as delimiters simultaneously, so that each string in the vector is a single token, and not clumps of tokens together?

Ideally would like to avoid using external libraries if at all possible.

Thank you!

EDIT: Solution has been found thanks to @mindriot and @πάνταῥεῖ .

The solution is:

vector<string> split(const string &s, char delim) {
        stringstream ss(s);
        string item;
        vector<string> tokens;
        while (ss >> item) {
            tokens.push_back(item);
        }
        return tokens;
    }

Thanks to all who responded!

edited Jan 28 '16 at 16:10

asked Jan 28 '16 at 15:18

User499

Check [this](http://stackoverflow.com/questions/29380897/how-to-split-a-sentence-with-an-escaped-whitespace) answer. – Bogdan Bogdanov Jan 28 '16 at 15:23
replace first all CRLF with space – Jan 28 '16 at 15:37
1

You can simply use `ss >> item;`. – πάντα ῥεῖ Jan 28 '16 at 15:40
`'\n'` is end of line. CRLF is Microsoft's notion of how to delimit lines in a text file. In general, you don't have to worry about this detail. – Pete Becker Jan 28 '16 at 15:40
@BogdanBogdanov I couldn't get the handwritten parser in the answer you provided to work. – User499 Jan 28 '16 at 15:54
@Holonout what do you mean? – User499 Jan 28 '16 at 15:54
@πάντα ῥεῖ what do you mean? – User499 Jan 28 '16 at 15:54
@PeteBecker how can I incorporate this into the solution? – User499 Jan 28 '16 at 15:55
@J.Stopher If you are only after `' '` and `'\n'` delimiters that statement I mentioned already does it correctly. – πάντα ῥεῖ Jan 28 '16 at 15:57
@πάνταῥεῖ That is exactly what I'm after. Where do I put that statement? – User499 Jan 28 '16 at 15:58
@J.Stopher it should replace your `getline` call. – mindriot Jan 28 '16 at 16:03
@mindriot and πάνταῥεῖ Thank you, it works!! – User499 Jan 28 '16 at 16:06

Split a string using a whitespace and CRLF as delimiters C++

0 Answers0