How can I use a comma in a string argument to a rake task?

Question

I have the following Rakefile:

task :test_commas, :arg1 do |t, args|
  puts args[:arg1]
end

And want to call it with a single string argument containing commas. Here's what I get:

%rake 'test_commas[foo, bar]'
foo

%rake 'test_commas["foo, bar"]'
"foo

%rake "test_commas['foo, bar']"
'foo

%rake "test_commas['foo,bar']"
'foo

%rake "test_commas[foo\,bar]"
foo\

I'm currently using the workaround proposed in this pull request to rake, but is there a way to accomplish this without patching rake?

score 10 · Answer 1 · answered Jul 18 '12 at 12:04

Changing rake is quite a dirty fix. Try using OptionParser instead. The syntax is following

$ rake mytask -- -s 'some,comma,sepparated,string'

the -- is necessary to skip the rake way of parsing the arguments

and here's the ruby code:

task :mytask do
  options = {}

  optparse = OptionParser.new do |opts|
    opts.on('-s', '--string ARG', 'desc of my argument') do |str|
      options[:str] = str
    end

    opts.on('-h', '--help', 'Display this screen') do     
      puts opts                                                          
      exit                                                                      
    end 
  end

  begin 
    optparse.parse!
    mandatory = [:str]
    missing = mandatory.select{ |param| options[param].nil? }
    if not missing.empty?
      puts "Missing options: #{missing.join(', ')}"
      puts optparse
      exit
    end

  rescue OptionParser::InvalidOption, OptionParser::MissingArgument
    puts $!.to_s
    puts optparse
    exit  
  end

  puts "Performing task with options: #{options.inspect}"
  # @TODO add task's code
end

This is a really clean approach from an implementation standpoint. From a usability standpoint, I'm used to using -- to separate options from arguments, especially with git, so it feels weird to have to use -- and then treat the arguments as options. But then again if I cared about usability, I'd probably just go with a custom CLI or use thor :) — Ben Taitelbaum, Jul 18 '12 at 16:05

score 9 · Accepted Answer · edited Jul 10 '14 at 14:17

9

I'm not sure it's possible. Looking at lib/rake/application.rb, the method for parsing the task string is:

def parse_task_string(string)
  if string =~ /^([^\[]+)(\[(.*)\])$/
    name = $1
    args = $3.split(/\s*,\s*/)
  else
    name = string
    args = []
  end 
  [name, args]
end

It appears that the arguments string is split by commas, so you cannot have an argument that contains a comma, at least not in the current rake-0.9.2.

edited Jul 10 '14 at 14:17

jbr

6,198
3
30
42

answered Aug 31 '11 at 15:29

eugen

8,916
11
57
65

4

This is no longer the case. Commas can now be escaped with a \ – neanderslob Oct 08 '18 at 15:19

score 4 · Answer 3 · edited Jan 27 '16 at 12:20

4

Have you tried escaping the , with a \?

edited Jan 27 '16 at 12:20

Vasfed

18,013
10
47
53

answered Aug 31 '11 at 14:12

Ben

13,297
4
47
68

yes, and that doesn't work for me either (in any of the cases above). I'll update the question with an example of that. – Ben Taitelbaum Aug 31 '11 at 14:18
Worked like a charm! – Elmor Mar 18 '16 at 13:05

score 4 · Answer 4 · edited May 23 '17 at 12:24

4

Eugen already answered, why it doesn't work.

But perhaps the following workaround may help you:

task :test_commas, :arg1, :arg2 do |t, args|
  arg = args.to_hash.values.join(',')
  puts "Argument is #{arg.inspect}"
end

It takes two arguments, but joins them to get the 'real' one.

If you have more then one comma, you need more arguments.

I did some deeper research and found one (or two) solution. I don't think it's a perfect solution, but it seems it works.

require 'rake'
module Rake
  class Application
    #usage: 
    #   rake test_commas[1\,2\,3]
    def parse_task_string_masked_commas(string)
      if string =~ /^([^\[]+)(\[(.*)\])$/
        name = $1
        args = $3.split(/\s*(?<!\\),\s*/).map{|x|x.gsub(/\\,/,',')}
      else
        name = string
        args = []
      end 
      [name, args]
    end   

    #Usage: 
    #   rake test_commas[\"1,2\",3]
    #" and ' must be masked
    def parse_task_string_combined(string)
      if string =~ /^([^\[]+)(\[(.*)\])$/
        name = $1
        args = $3.split(/(['"].+?["'])?,(["'].+?["'])?/).map{|ts| ts.gsub(/\A["']|["']\Z/,'') }
        args.shift if args.first.empty?
      else
        name = string
        args = []
      end 
      [name, args]
    end   

    #~ alias :parse_task_string :parse_task_string_masked_commas
    alias :parse_task_string :parse_task_string_combined

  end

end
desc 'Test comma separated arguments'
task :test_commas, :arg1  do |t, args|
  puts '---'
  puts "Argument is #{args.inspect}"
end

The version parse_task_string_masked_commasallows calls with masked commas:

rake test_commas[1\,2\,3]

The version parse_task_string_combined allows:

rake test_commas[\"1,2,3\"]

At least under windows, the " (or ') must be masked. If not, they are already deleted until the string reached Rake::Aplication (probably shell substitution)

edited May 23 '17 at 12:24

Community

1
1

answered Aug 31 '11 at 19:10

knut

27,320
6
84
112

That's a good workaround if I know the input format beforehand, but in that case I could just name the arguments so `rake -T` would be more descriptive. – Ben Taitelbaum Aug 31 '11 at 20:00
I added a new version - it's a bit nearer your proposals. – knut Aug 31 '11 at 22:17
This would be worth submitting as an upstream patch, so that you can include commas in strings. What about using a regex with negative lookbehind (matching a comma that isn't preceded by a slash) instead of using MYSEP? – Ben Taitelbaum Sep 01 '11 at 01:36
I made some experiments with regexps, but I didn't have success. Then I was too tired to continue... I will take a 2nd look for it. – knut Sep 01 '11 at 18:12
I replaced MYSEP at least for the maked comma version. For parameters in " I have actual no better idea. – knut Sep 01 '11 at 19:13
I have now a solution without the MYSEP-replacements. – knut Sep 02 '11 at 22:40
I like the version with escaping the quotes the best, although it's still not ideal, as escaping quotes usually means I want a literal quote, where here it's just a workaround to get the quotes far enough into the parsing so we can deal with them. When I try running this (on osx) using ruby-1.9.2-p290 I can't get it to output commas in the string. The output is `Argument is {:arg1=>"1"}` even when I escape the quotes. – Ben Taitelbaum Sep 08 '11 at 04:04
Use `args.to_a` instead of `args.to_hash.values`. Hash data structures don't preserve order. – Free Bullets Dec 06 '18 at 22:33

score 3 · Answer 5 · answered Jul 22 '15 at 16:57

3

Rake task variables are not very convenient generally, instead use environment variables:

task :my_task do
  ENV["MY_ARGUMENT"].split(",").each_with_index do |arg, i|
    puts "Argument #{i}: #{arg}"
  end
end

Then you can invoke with

MY_ARGUMENT=foo,bar rake my_task

Or if you prefer

rake my_task MY_ARGUMENT=foo,bar

answered Jul 22 '15 at 16:57

Gabe Kopley

16,281
5
47
60

Thanks! All the options presented here are a bit dirty and/or ugly, but this was by far the quickest. – naudster Jul 27 '15 at 01:57

score 3 · Answer 6 · answered Sep 18 '19 at 17:49

3

For rake version 12.3.2,

rake test_commas["foo\,bar"]

works well

answered Sep 18 '19 at 17:49

user796658

43
1
6

score 2 · Answer 7 · answered May 20 '14 at 16:49

Another simple workaround is to use a different delimiter in your arguments.

It's pretty simple to swap to a pipe | character (or another) instead of your comma separated args. Rake parses your arguments correctly in this case and allows you to split the first for an array.

desc 'Test pipe separated arguments'
task :test_pipes, :arg1, :arg2  do |t, args|
  puts ":arg1 is: #{ args[:arg1] }"
  puts ":arg2 still works: #{ args[:arg2] }"
  puts "Split :arg1 is: #{ args[:arg1].split('|') }"
end

Call it with:

rake test_pipes["foo|bar",baz]

score 2 · Answer 8 · answered Jun 13 '17 at 14:49

2

# rake -v 10.5

rake test_commas\['foo\,bar'\]

works like a charm.

answered Jun 13 '17 at 14:49

Vlad

3,866
1
24
20

score 0 · Answer 9 · answered Dec 09 '16 at 07:13

0

We can convert each string to symbol, As,

task :create do   
ARGV.each { |a| task a.to_sym do ; end }
 puts ARGV[1]
 puts ARGV[2]
 puts ARGV[3]
 puts ARGV[4]     
end
end

run as,

rake create '1,s' '2' 'ww ww' 'w,w'

answered Dec 09 '16 at 07:13

Veeresh R Y

1

How can I use a comma in a string argument to a rake task?

9 Answers9