I'm working with a txt or htm file. And currently I'm looking up the document char by char, using for loop, but I need to look up the text word by word, and then inside the word char by char. How can I do this?
for (int i = 0; i < text.Length; i++)
{}
A simple approach is using string.Split without argument(splits by white-space characters):
using (StreamReader sr = new StreamReader(path))
{
while (sr.Peek() >= 0)
{
string line = sr.ReadLine();
string[] words = line.Split();
foreach(string word in words)
{
foreach(Char c in word)
{
// ...
}
}
}
}
I've used StreamReader.ReadLine to read the entire line.
To parse HTML i would use a robust library like HtmlAgilityPack.
You can split the string on whitespace, but you will have to deal with punctuation and HTML markup (you said you were working with txt and htm files).
string[] tokens = text.split(); // default for split() will split on white space
foreach(string tok in tokens)
{
// process tok string here
}
Here's my implementation of lazy extension to StreamReader. The idea is not to load the entire file into memory especially if your file is a single long line.
public static string ReadWord(this StreamReader stream, Encoding encoding)
{
string word = "";
// read single character at a time building a word
// until reaching whitespace or (-1)
while(stream.Read()
.With(c => { // with each character . . .
// convert read bytes to char
var chr = encoding.GetChars(BitConverter.GetBytes(c)).First();
if (c == -1 || Char.IsWhiteSpace(chr))
return -1; //signal end of word
else
word = word + chr; //append the char to our word
return c;
}) > -1); // end while(stream.Read() if char returned is -1
return word;
}
public static T With<T>(this T obj, Func<T,T> f)
{
return f(obj);
}
to use simply:
using (var s = File.OpenText(file))
{
while(!s.EndOfStream)
s.ReadWord(Encoding.Default).ToCharArray().DoSomething();
}
use text.Split(' ') to split it by space into an array of words then iterate through that.
So
foreach(String word in text.Split(' '))
foreach(Char c in word)
Console.WriteLine(c);
You could split on whitespaces:
string[] words = text.split(' ')
will give you an array of words, then you can iterate across them.
foreach(string word in words)
{
word // do something with each word
}
I think you can use split
var words = reader.ReadToEnd().Split(' ');
or use
foreach(String words in text.Split(' '))
foreach(Char char in words )
You can get all the text from some HTML with the HTMLAgilityPack. If you think this is overkill look here.
HtmlDocument doc = new HtmlDocument();
doc.LoadHtml(text);
foreach(HtmlNode node in doc.DocumentNode.SelectNodes("//text()"))
{
var nodeText = node.InnerText;
}
then you can split each nodes text contents into words, once you define what a word is.
Maybe like this,
using HtmlAgilityPack;
static IEnumerable<string> WordsInHtml(string text)
{
var splitter = new Regex(@"[^\p{L}]*\p{Z}[^\p{L}]*");
HtmlDocument doc = new HtmlDocument();
doc.LoadHtml(text);
foreach(HtmlNode node in doc.DocumentNode.SelectNodes("//text()"))
{
foreach(var word in splitter.Split(node.InnerText)
{
yield return word;
}
}
}
Then, to examine the chars in each word
foreach(var word in WordsInHtml(text))
{
foreach(var c in word)
{
// a enumeration by word then char.
}
}
What's about regexps?
using System;
using System.Linq;
using System.Text.RegularExpressions;
namespace ConsoleApplication58
{
class Program
{
static void Main()
{
string input =
@"I'm working with a txt or htm file. And currently I'm looking up the document char by char, using for loop, but I need to look up the text word by word, and then inside the word char by char. How can I do this?";
var list = from Match match in Regex.Matches(input, @"\b\S+\b")
select match.Value; //Get IEnumerable of words
foreach (string s in list)
Console.WriteLine(s); //doing something with it
Console.ReadKey();
}
}
}
it works with any delimeters and it's the fastest way to do it afaik.
