How to read all requested data using NetworkStream.BeginRead?

Question

There is a code of async server. Client sends Header - size of Data Block + Data Block.

Server reads asynchronously first Header and then Data Block.

I need, after I read Data Block run the BeginRead for Header reading part, to make threads async.

PROBLEM:

When I got DataCallBack, in line:

int bytesRead = ns.EndRead(result);

I get not all buffer i asked to read in

mc.Client.GetStream().BeginRead(mc.DataBuffer, 0, size, new AsyncCallback(DataCallBack), mc);

If client send 1MB of Data I can get different number of "bytesRead".

QUESTION:

How to force "BeginRead" to read all data from connection. It should cause the new loop of Header - Data.

MyClient - simply wrapper over TcpClient;

CODE:

    public  void DoAcceptTcpClientCallback(IAsyncResult ar)
    {
        TcpListener listener = (TcpListener)ar.AsyncState;
        TcpClient client = listener.EndAcceptTcpClient(ar);
        client.NoDelay = false;
       // client.ReceiveBufferSize = 1024*1024;
        listener.BeginAcceptTcpClient(new AsyncCallback(DoAcceptTcpClientCallback), listener);
        MyClient mc = new MyClient(client);
        ContinueRead(0,mc);
    }

    public void ContinueRead(int size, MyClient mc)
    {
        if (size != 0)
        {
            mc.DataBuffer = new byte[size];
            mc.Client.GetStream().BeginRead(mc.DataBuffer, 0, size, new AsyncCallback(DataCallBack), mc);
        }
        mc.Client.GetStream().BeginRead(mc.HeaderBuffer, 0, 4, new AsyncCallback(HeaderCallBack), mc);

    }

    private void HeaderCallBack(IAsyncResult result)
    {
        MyClient mc = (MyClient)result.AsyncState;
        NetworkStream ns = mc.Stream;
        int bytesRead = ns.EndRead(result);
        if (bytesRead == 0)
            throw new Exception();
        mc.TotalLengs =  BitConverter.ToInt32(mc.HeaderBuffer, 0);
        ContinueRead(mc.TotalLengs, mc);

    }
    private void DataCallBack(IAsyncResult result)
    {
        MyClient mc = (MyClient)result.AsyncState;
        NetworkStream ns = mc.Stream;
        int bytesRead = ns.EndRead(result);
        if (bytesRead == 0)
            throw new Exception();

BAD CODE - MAKES ASYNC READING - SYNC

        while (bytesRead < mc.TotalLengs)
        {
            bytesRead += ns.Read(mc.DataBuffer, bytesRead, mc.TotalLengs - bytesRead);
        }

END BAD CODE

        ContinueRead(0, mc);
        ProcessPacket(mc.DataBuffer, mc.IP);
    }

score 4 · Answer 1 · answered May 13 '13 at 14:11

4

"If client send 1MB of Data I can get different number of "bytesRead"."

Yes...this is simply how TCP works under the hood. You can't change this. TCP guarantees the order of packets, not how they are grouped. The hardware and traffic conditions along the route the packets travel determine how that data is grouped (or un-grouped).

"How to force "BeginRead" to read all data from connection."

TCP has no idea how much data is being sent. As far as it is concerned, the connection is simply an endless stream of bytes; therefore it cannot read "all data" since there is no end to the data (from its perspective). TCP also has no notion of what a "complete message" is with respect to your application. It is up to you, the programmer, to develop a protocol that allows your application to know when all data has been sent.

If you are expecting a certain number of bytes, then keep a running sum of the values returned by EndRead() and stop when that magic number is hit.

answered May 13 '13 at 14:11

Idle_Mind

38,363
3
29
40

There is analog for what I want to do in C++. Socket's "recv" has an option like "msg_waitall". It simply reads number of bytes that you told to read. And until it reads it will not return control. – user2377299 May 13 '13 at 14:26
Cool. Everything I said still applies; even to the C++ recv() function. Like I said, you can track the total number of bytes received by the return value of EndRead() (or its synchronous equivalent). With that in mind, you could write your own .Net version of recv(). If you want "built-in" higher level network functions, then buy a **Library** from a third-party company. – Idle_Mind May 13 '13 at 14:35
Heh. I need the highest performance. But calling BeginRead each time makes it no effectiv, because I need to swich each time from System Core thread to my prog thread - it takes time... So in C++ I do one BeginRead, in C# as lot as need... – user2377299 May 13 '13 at 15:06
Another option is to use the synchronous Read(), which blocks until data comes in. Place that in its own thread that simply loops around and puts the currently received data into some kind of buffer. – Idle_Mind May 13 '13 at 15:10

How to read all requested data using NetworkStream.BeginRead?

1 Answers1