Catching Network Traffic With Selenium C#

Question

I al looking to capture network traffic and log responses/headers however I cannot seem to find any resources for achieving this in c#. Most if not all of the guides have been for JS or Python. I read that this functionality was not added into the c# version as of 2019 but no new news has been posted. Does anyone know how to get network logs from a ChromeDriver?

Answer 1

If you want to do use a simular version like that one from Jeppe Holt, for Selenium 4+ without being version and browser specific try that one: (Works on Chrome and Edge with Selenium 4.8)

public void SetupNetworkLogging(IWebDriver driver)
{
    NetworkManager manager = new NetworkManager(driver);
    manager.NetworkResponseReceived += ResponseHandler;
    manager.StartMonitoring();
}

private void ResponseHandler(object sender, NetworkResponseReceivedEventArgs e)
{
    Console.WriteLine($"Http status: {e.ResponseStatusCode} : {e.ResponseBody} | Url: {e.ResponseUrl} ");
}

You can also experiment with a devtools session:

IDevTools devTools = driver as IDevTools;
var session = devTools.GetDevToolsSession();
var network = session.Domains.Network;

network.EnableNetwork();
network.EnableNetworkCaching();

Answer 2

Wrong, in selenium 4 you can do that but it is still in beta

Answer 3

Through much effort and googling around I have created something in C# that seems to do what you want. My answer is an adaption of some C# and Java implementations found on the internet which I could not get to work on individually, but did provide some needed insight.

using OpenQA.Selenium.Chrome;
using OpenQA.Selenium.DevTools;
using Network = OpenQA.Selenium.DevTools.V108.Network;
using DevToolsSessionDomains = OpenQA.Selenium.DevTools.V108.DevToolsSessionDomains;

    internal class Program
    {
        private static async Task Main(string[] args)
        {
            string url = "https://stackoverflow.com/questions/68582545/catching-network-traffic-with-selenium-c-sharp";
            Uri uri = new Uri(url);
            var driver = new ChromeDriver();
            var devTools = (IDevTools)driver;
            IDevToolsSession session = devTools.GetDevToolsSession();
            var domains = session.GetVersionSpecificDomains<DevToolsSessionDomains>();
            domains.Network.ResponseReceived += ResponseReceivedHandler;
            Task task = domains.Network.Enable(new Network.EnableCommandSettings());
            task.Wait();

            driver.Navigate().GoToUrl(uri);
            var name = Console.ReadLine();
            Console.WriteLine("finished");
            driver.Dispose();

            void ResponseReceivedHandler(object sender,Network.ResponseReceivedEventArgs e)
            {
                Console.WriteLine("New Work Response received");
                Console.WriteLine($"Response Status: {e.Response.Status}");
                Console.WriteLine($"Status Text: {e.Response.StatusText}");
                Console.WriteLine($"Response MimeType: {e.Response.MimeType}");
                Console.WriteLine($"Response Url: {e.Response.Url}");
            }
        }
    }

I hope this answer answers your question or at least helps someone in a similar situation.

Answer 4

You can use this approach in any selenium version and not wait for the Selenium 4 release.

https://www.automatetheplanet.com/webdriver-capture-modify-http-traffic/