Regex to parse FTP server list C#

Question

I'm using Regex list to parse FTP server listing. I'm not good with Regex at all, this is list of regex I collected online to parse various server FTP outputs:

private static readonly string[] DirectoryParseFormats = 
        {
            "(?<dir>[\\-d])(?<permission>([\\-r][\\-w][\\-xs]){3})\\s+\\d+\\s+\\w+\\s+\\w+\\s+(?<size>\\d+)\\s+(?<timestamp>\\w+\\s+\\d+\\s+\\d{4})\\s+(?<name>.+)",
            "(?<dir>[\\-d])(?<permission>([\\-r][\\-w][\\-xs]){3})\\s+\\d+\\s+\\d+\\s+(?<size>\\d+)\\s+(?<timestamp>\\w+\\s+\\d+\\s+\\d{4})\\s+(?<name>.+)",
            "(?<dir>[\\-d])(?<permission>([\\-r][\\-w][\\-xs]){3})\\s+\\d+\\s+\\d+\\s+(?<size>\\d+)\\s+(?<timestamp>\\w+\\s+\\d+\\s+\\d{1,2}:\\d{2})\\s+(?<name>.+)",
            "(?<dir>[\\-d])(?<permission>([\\-r][\\-w][\\-xs]){3})\\s+\\d+\\s+\\w+\\s+\\w+\\s+(?<size>\\d+)\\s+(?<timestamp>\\w+\\s+\\d+\\s+\\d{1,2}:\\d{2})\\s+(?<name>.+)",
            "(?<dir>[\\-d])(?<permission>([\\-r][\\-w][\\-xs]){3})(\\s+)(?<size>(\\d+))(\\s+)(?<ctbit>(\\w+\\s\\w+))(\\s+)(?<size2>(\\d+))\\s+(?<timestamp>\\w+\\s+\\d+\\s+\\d{2}:\\d{2})\\s+(?<name>.+)",
            "(?<timestamp>\\d{2}\\-\\d{2}\\-\\d{2}\\s+\\d{2}:\\d{2}[Aa|Pp][mM])\\s+(?<dir>\\<\\w+\\>){0,1}(?<size>\\d+){0,1}\\s+(?<name>.+)"
        };

Now I stumbled upon following output from odd FTP server. What's weird is that server outputs file name together with folder name for some reason.

Anyway, I'd like to have similar RegEx for this string, ideally introduce folder name to separate it out, String returned by server is what's inside pipes |

|-rw-rw-rw- 1 generic 235 Mar 22 11:21 fromDoder/DOD997ABCD.20170322112114159.1961812284.txt|

EDIT:

Here is C# code I use to iterate through regex expressions to pick one that matches FTP server output. Then I use it to parse out file name and type

// Use our regex library to parse
match = DirectoryParseFormats.Select(dpf => new Regex(dpf).Match(raw)).FirstOrDefault(m => m.Success); 

if (match == null) throw new Exception($"Can't parse FTP directory list item. raw item: |{raw}|, whole response: |{response}|");

// If not directory - this is file
var dir = match.Groups["dir"].Value;
if (dir == string.Empty || dir == "-") list.Add(match.Groups["name"].Value);

EDIT 2:

total 0
drw-rw-rw-   1 user     group           0 Apr 23  2016 .
drw-rw-rw-   1 user     group           0 Apr 23  2016 ..

EDIT 3:

var hintRegex = @"^
(?<dir>[-d])
(?<permission>(?:[-r][-w][-xs]){3})
\s+\d+
\s+\w+
(?:\s+\w+)?
\s+(?<size>\d+)
\s+(?<timestamp>\w+\s+\d+(?:\s+\d+(?::\d+)?))
\s+(?!(?:\.|\.\.)\s*$)(?<name>.+?)\s*
$";

            Match match = new Regex(hintRegex).Match("-rw-r--r-- 1 ftp ftp           1079 Apr 06  2017 LEANCOR_040617084839.txt");

            if (!match.Success) Debug.WriteLine("Doesn't match");

Answer 1

The regex for the given string input goes as under:

(?<permission>([\\-rwxs]+){3})\\s+\\d+\\s+\\w+\\s+(?<size>\\d+)\\s+(?<timestamp>\\w+\\s+\\d+\\s+\\d{1,2}:\\d{1,2})\\s+(?<folder>\\w+\\/)?(?<name>.+)

The online regex test including regex pattern and the given input string is shown in the image below.

Answer 2

Since your pattern looks like you're trying to match the output of ls -l, as well as you mentioning it's a list command. I'm assuming it is so.

The main problem I could gather from your code is that you're missing the multiline flag (RegexOptions.Multiline).

Your regex overall seems correct, I only did a few changes. Here's it layed out with a bit of spacing (which still works if you use the extended flag).

^
(?<dir>[-d])
(?<permission>(?:[-r][-w][-xs]){3})
\s+\d+
\s+\w+
(?:\s+\w+)?
\s+(?<size>\d+)
\s+(?<timestamp>\w+\s+\d+(?:\s+\d+(?::\d+)?))
\s+(?!(?:\.|\.\.)\s*$)(?<name>.+?)\s*
$

Here's a live preview.

You can test it by doing:

string pattern = @"^(?<dir>[-d])(?<permission>(?:[-r][-w][-xs]){3})\s+\d+\s+\w+(?:\s+\w+)?\s+(?<size>\d+)\s+(?<timestamp>\w+\s+\d+(?:\s+\d+(?::\d+)?))\s+(?!(?:\.|\.\.)\s*$)(?<name>.+?)\s*$";
Regex re = new Regex(pattern, RegexOptions.Multiline);

string source = @"
-rwxr-xr-x 1 root  46789 Feb  7 23:15 certbot-auto
drwxr-xr-x 2 root   4096 Mar 22 16:29 test dir
drwxr-xr-x 4 root   4096 Feb 10 15:50 www
-rw-rw-rw- 1 generic 235 Mar 22 11:21 fromDoder/DOD997ABCD.20170322112114159.1961812284.txt
-rw-rw-rw- 1 cmuser cmuser 904 Mar 23 15:04 20170323110427785_3741647.edi
drw-rw-rw- 1 user   group    0 Apr 23  2016 .
drw-rw-rw- 1 user   group    0 Apr 23  2016 ..
drw-rw-rw- 1 user   group    0 Apr 23  2016 .cache
drw-rw-rw- 1 user   group    0 Apr 23  2016 .bashrc
";

MatchCollection matches = re.Matches(source);

Console.WriteLine(matches.Count);

foreach (Match match in matches)
{
    Console.WriteLine(match.Groups["dir"]);
    Console.WriteLine(match.Groups["permission"]);
    Console.WriteLine(match.Groups["size"]);
    Console.WriteLine(match.Groups["timestamp"]);
    Console.WriteLine(match.Groups["name"]);
    Console.WriteLine();
}

Note that the content of source is just an edited version of the output of ls -l on my server (with the addition of your example). So if my assumptions are correct, it should look familiar to you.

Edit: Based on your comment, you simply need to remove one of the \s+\w+ (I've updated all the above to reflect that).