119

As the title explains I have a very fundamental programming question which I have just not been able to grok yet. Filtering out all of the (extremely clever) "In order to understand recursion, you must first understand recursion." replies from various online threads I still am not quite getting it.

Understanding that when faced with not knowing what we don't know, we can tend to ask the wrong questions or ask the right questions incorrectly I will share what I "think" my question is in hopes that someone with a similar outlook can share some bit of knowledge that will help turn on the recursive light bulb for me!

Here is the function (the syntax is written in Swift):

func sumInts(a: Int, b: Int) -> Int {
    if (a > b) {
        return 0
    } else {
        return a + sumInts(a: a + 1, b: b)
    }
}

We'll use 2 and 5 as our arguments:

println(sumInts(a: 2, b: 5))

Obviously the answer is 14. But I'm not clear on how that value is achieved.

These are my 2 hangups:

  1. The function is called recursively until a condition is met. That condition is a > b. When this condition is met, return 0. At first glance, I would expect the return value to be 0 which is obviously incorrect.

  2. Printing out the value of 'a' on each iteration yields a value which I would expect: 2, 3, 4, 5 (at which point 5+1 > b which meets the first condition: a > b) but I still don't see how the value of 14 is achieved.

My first thought is that something similar to the following is happening magically:

var answer = a;
answer += a+1 until a > b;
return answer;   

So ruling out magic, I'm just not getting something. I would love to understand what's happening more than just implicitly.

If someone could kindly explain what technically happens during this kind of function and why the result isn't 0 and how, eventually, a + sumInts(a: a + 1, b: b) = 14, I would be forever in your debt.

John Kugelman
  • 349,597
  • 67
  • 533
  • 578
Jason Elwood
  • 1,315
  • 2
  • 10
  • 12
  • 8
    Recursion is one of those programming concepts which are much easier to understand in mathematical terms than in code; there's a good definition [here](http://mathworld.wolfram.com/RecursiveFunction.html) – blgt Sep 05 '14 at 11:08
  • Side note: Recursion isn't required for this calculation. Unless I miss my guess, you can use `a + (a + 1) * (b - a + 1)`. – Clockwork-Muse Sep 05 '14 at 13:46
  • I strongly recommend finding 2-3 simple recursive functions online, and later writing 2-3 of your own. Trace through each function, writing out the values of each variable at each step, and draw out the recursion tree by hand. I used to have trouble with recursion too, but now it is like second nature and I use it in real world problem solving. My success came from using that strategy, and I still do it sometimes when I encounter recursion. You have to get to the point where you not only "grok" it, but also simply just brute force memorize the way that such programs move about and work. – Musicode Sep 05 '14 at 13:47
  • To expand on the above, the last sentence is really quite important. For me, at least, it helped very very much to get to the point where, when reading or developing, I no longer have to "grok" a recursive program, I simply know how it will move around and work by putting the lines of code in the right order and structure. Many recursive programs have a similar structure. Try to memorize the structure. That being said, tracing through as I described above should obviously heavily come first, it takes a lot of practice for some people (myself included). I hope this all makes sense. – Musicode Sep 05 '14 at 13:53
  • 6
    [**`LearnYouARecursion`**](http://www.cis.upenn.edu/~cis39903/lectures.html), complete problem sets from world-class professor! – recursion.ninja Sep 05 '14 at 18:47
  • 15
    I just _have_ to urge you to type "Recursion" in the Google search box. One of those Easter eggs. I won't spoil the surprise for you. – Floris Sep 06 '14 at 02:25
  • If it helps at all, recursion is essentially calculation-by-induction -- the same concepts as proof-by-induction apply. – keshlam Sep 06 '14 at 08:06
  • 7
    Possible duplicate of http://stackoverflow.com/questions/25676961/understanding-how-recursive-functions-work – Neil McGuigan Sep 06 '14 at 19:44
  • Thinking of recursion as a tree really helps. In this case it is tree with single branch (a->a+1->a+2->a+3......a+n->0). Each of the arrow means (add +). When you get more complex recursion like double recursion (most sorting algos, fibonacci etc) visualizing in terms of recursion tree is very useful. – specialscope Sep 07 '14 at 03:35
  • [What on Earth is Recursion?](https://www.youtube.com/watch?v=Mv9NEXX1VHc) explains it very nicely, imho. – fredoverflow Sep 07 '14 at 08:27
  • 1
    possible duplicate of [What is recursion and when should I use it?](http://stackoverflow.com/questions/3021/what-is-recursion-and-when-should-i-use-it) – dirkk Sep 07 '14 at 16:53
  • 1
    I am seriously confused that this question has gotten so much attention. SO is a Q&A site and I thought we try to avoid answering the same question over and over again. I see nothing more in this question than basically "How does recursion work?" and this was certainly asked before. Btw, this is not meant as criticism of the OP, as I understand that recursion is difficult to grasp as a beginner. Imho, this question should be closed. – dirkk Sep 07 '14 at 16:57
  • These are seriously some good answers to this question, preferably the second answer but the first answer is also fruitful. – Daniel Viglione Mar 16 '17 at 21:30

18 Answers18

133

1.The function is called recursively until a condition is met. That condition is a > b. When this condition is met, return 0. At first glance, I would expect the return value to be 0 which is obviously incorrect.

Here is what the computer computing sumInts(2,5) would think if it were able to:

I want to compute sumInts(2, 5)
for this, I need to compute sumInts(3, 5)
and add 2 to the result.
  I want to compute sumInts(3, 5)
  for this, I need to compute sumInts(4, 5)
  and add 3 to the result.
    I want to compute sumInts(4, 5)
    for this, I need to compute sumInts(5, 5)
    and add 4 to the result.
      I want to compute sumInts(5, 5)
      for this, I need to compute sumInts(6, 5)
      and add 5 to the result.
        I want to compute sumInts(6, 5)
        since 6 > 5, this is zero.
      The computation yielded 0, therefore I shall return 5 = 5 + 0.
    The computation yielded 5, therefore I shall return 9 = 4 + 5.
  The computation yielded 9, therefore I shall return 12 = 3 + 9.
The computation yielded 12, therefore I shall return 14 = 2 + 12.

As you see, some call to the function sumInts actually returns 0 however this not the final value because the computer still has to add 5 to that 0, then 4 to the result, then 3, then 2, as described by the four last sentences of the thoughts of our computer. Note that in the recursion, the computer does not only have to compute the recursive call, it also has to remember what to do with the value returned by the recursive call. There is a special area of computer's memory called the stack where this kind of information is saved, this space is limited and functions that are too recursive can exhaust the stack: this is the stack overflow giving its name to our most loved website.

Your statement seems to make the implicit assumption that the computer forgets what it were at when doing a recursive call, but it does not, this is why your conclusion does not match your observation.

2.Printing out the value of 'a' on each iteration yields a value which I would expect: 2, 3, 4, 5 (at which point 5+1 > b which meets the first condition: a > b) but I still don't see how the value of 14 is achieved.

This is because the return value is not an a itself but the sum of the value of a and the value returned by the recursive call.

Michaël Le Barbier
  • 6,103
  • 5
  • 28
  • 57
  • 3
    Thanks for taking time to write up this great answer Michael! +1! – Jason Elwood Sep 05 '14 at 01:29
  • 10
    @JasonElwood Maybe it is helpful if you modify `sumInts` so that it actually writes down the “computer thoughts”. Once you have written a hand of such functions, you will probably have “got it”! – Michaël Le Barbier Sep 05 '14 at 01:33
  • Now it's even closer... 55:28 – Floris Sep 06 '14 at 02:26
  • 4
    This is a good answer, though I note that there is no *requirement* that function activation take place on a data structure called "the stack". Recursion could be implemented by continuation passing style, in which case there is no stack at all. The stack is just one -- particularly efficient, and therefore in common usage -- reification of the notion of continuation. – Eric Lippert Sep 06 '14 at 14:07
  • @EricLippert You don't have much love for the stack, do you? ;) – fredoverflow Sep 07 '14 at 08:31
  • 1
    @EricLippert While techniques used to implement recursivity is an interesting topic *per se*, I am not sure if it would be useful for the OP—who wants to understand “how it works”—to be exposed to the variety of mechanisms used. While continuation passing style or expansion based languages (e.g. TeX and m4) are not intrinsically harder than more common programming paradigms, I will not offence anybody by labelling these “exotic” and a little *white lie* like “it always happens on *the* stack” should help the OP to understand the concept. (And a kind of stack is always involved.) – Michaël Le Barbier Sep 07 '14 at 10:47
  • 1
    There has to be some way for the software to remember what it was doing, call the function recursively, and then return to that original state when it returns. This mechanism acts stack-like, so it's convenient to call it a stack, even if some other data structure is used. – Barmar Sep 09 '14 at 20:49
111

I think the confusion is stemming from thinking of it as "the same function" being called many times. If you think of it as "many copies of the same function being called", then it may be clearer:

Only one copy of the function ever returns 0, and it's not the first one (it's the last one). So the result of calling the first one is not 0.

For the second bit of confusion, I think it will be easier to spell out the recursion in English. Read this line:

return a + sumInts(a + 1, b: b)

as "return the value of 'a' plus (the return value of another copy of the function, which is the copy's value of 'a' plus (the return value of another copy of the function, which is the second copy's value of 'a' plus (...", with each copy of the function spawning a new copy of itself with a increased by 1, until the a > b condition is met.

By the time you reach the the a > b condition being true, you have a (potentially arbitrarily) long stack of copies of the function all in the middle of being run, all waiting on the result of the next copy to find out what they should add to 'a'.

(edit: also, something to be aware of is that the stack of copies of the function I mention is a real thing that takes up real memory, and will crash your program if it gets too large. The compiler can optimize it out in some cases, but exhausting stack space is a significant and unfortunate limitation of recursive functions in many languages)

Catfish_Man
  • 41,261
  • 11
  • 67
  • 84
  • 7
    Catfish_Man: I think you nailed it! Thinking of it as several "copies" of the same function makes total sense. I'm still wrapping my head around it but I think you've sent me off on the right path! Thanks for taking time out of your busy day to help out a fellow programmer! I will mark your answer as the correct answer. Have a great day! – Jason Elwood Sep 05 '14 at 00:51
  • 14
    This is a good analogy - although be careful not to take it too literally as each "copy" is actually the exact same code. What is different for each copy is all the data it is working on. – Tim B Sep 05 '14 at 13:03
  • 2
    I'm not too happy with thinking of it as a copy. I find that a more intuitive explanation is to differentiate the function itself (the code, what it does) and a function invocation (instantiation of that function) to which a stack frame/execution context is associated. The function doesn't own its local variables, they are instantiated as the function is called (invoked). But I guess this will do as an introduction to recursion – Thomas Sep 05 '14 at 13:48
  • Great explanation. @JasonElwood: It may be helpful to write it out on paper as well - on the first line, write sumInts(2,5), and leave space for the expected result next to it. To get that result, you must step into sumInts, so write sumInts(3,5) on the next line, indented a little. Leave some space for the result, and so on and so on until you reach a state where you do not need to write sumInts on the next line. Then, you can finally write 0 for the result for that call, and you can fill in a result for everything above it. – cmv Sep 05 '14 at 14:09
  • 5
    The correct terminology is that there are several *invocations* of the function. Each invocation has its own *instances* of variables `a` and `b`. – Theodore Norvell Sep 05 '14 at 17:36
  • 7
    Yes, there's a significant amount of precision that could be added to this answer. I intentionally left out the distinction between "instances of a function" and "activation records of invocations of a single function", because it was extra conceptual load that doesn't really assist in understanding the problem. It helps in understanding *other* problems, so it's still useful info, just elsewhere. These comments seem like a fine place for it :) – Catfish_Man Sep 05 '14 at 20:03
  • 1
    @TheodoreNorvell: "Invocation" is good; "activation" is also in common usage. – Eric Lippert Sep 06 '14 at 13:06
  • @Thomas: **do** think of it as a copy. See my answer for a detailed explanation of why this is reasonable. – Eric Lippert Sep 06 '14 at 14:05
  • @EricLippert Yes, *activation* is also common. Yes, you can think of invocation in terms of copying the function body. This makes the most sense for eager functional languages. For imperative languages, you need to be sure that each copy has its own local variables, including parameters. – Theodore Norvell Sep 07 '14 at 12:34
  • `sum(a,b) = a + sum(a+1,b) if a <= b otherwise 0` – Khaled.K Sep 10 '14 at 05:36
50

To understand recursion you must think of the problem in a different way. Instead of a large logical sequence of steps that makes sense as a whole you instead take a large problem and break up into smaller problems and solve those, once you have an answer for the sub problems you combine the results of the sub problems to make the solution to the bigger problem. Think of you and your friends needing to count the number of marbles in a huge bucket. You do each take a smaller bucket and go count those individually and when you are done you add the totals together.. Well now if each of you find some friend and split the buckets further, then you just need to wait for these other friends to figure out their totals, bring it back to each of you, you add it up. And so on. The special case is when you only get 1 marble to count then you just return it back and say 1. let the other people above you do the adding you are done.

You must remember every time the function calls itself recursively it creates a new context with a subset of the problem, once that part is resolved it gets returned so that the previous iteration can complete.

Let me show you the steps:

sumInts(a: 2, b: 5) will return: 2 + sumInts(a: 3, b: 5)
sumInts(a: 3, b: 5) will return: 3 + sumInts(a: 4, b: 5)
sumInts(a: 4, b: 5) will return: 4 + sumInts(a: 5, b: 5)
sumInts(a: 5, b: 5) will return: 5 + sumInts(a: 6, b: 5)
sumInts(a: 6, b: 5) will return: 0

once sumInts(a: 6, b: 5) has executed, the results can be computed so going back up the chain with the results you get:

 sumInts(a: 6, b: 5) = 0
 sumInts(a: 5, b: 5) = 5 + 0 = 5
 sumInts(a: 4, b: 5) = 4 + 5 = 9
 sumInts(a: 3, b: 5) = 3 + 9 = 12
 sumInts(a: 2, b: 5) = 2 + 12 = 14.

Another way to represent the structure of the recursion:

 sumInts(a: 2, b: 5) = 2 + sumInts(a: 3, b: 5)
 sumInts(a: 2, b: 5) = 2 + 3 + sumInts(a: 4, b: 5)  
 sumInts(a: 2, b: 5) = 2 + 3 + 4 + sumInts(a: 5, b: 5)  
 sumInts(a: 2, b: 5) = 2 + 3 + 4 + 5 + sumInts(a: 6, b: 5)
 sumInts(a: 2, b: 5) = 2 + 3 + 4 + 5 + 0
 sumInts(a: 2, b: 5) = 14 
Rob
  • 2,618
  • 2
  • 22
  • 29
  • 2
    Very well put, Rob. You've put it in a way that's very clear and easy to understand. Thanks for taking the time! – Jason Elwood Sep 05 '14 at 01:03
  • 3
    This is the clearest representation of what is going on, without going into the theory and technical details of it, shows each step of the execution clearly. – Bryan Sep 05 '14 at 01:17
  • 2
    I am glad. :) it is not always easy to explain these things. Thank you for the compliment. – Rob Sep 05 '14 at 01:18
  • 1
    +1. This is how I would describe it, specifically with your last example of the structure. It's helpful to visually unroll what's happening. – KChaloux Sep 05 '14 at 20:23
42

Recursion is a tricky topic to understand and I don't think I can fully do it justice here. Instead, I'll try to focus on the particular piece of code you have here and try to describe both the intuition for why the solution works and the mechanics of how the code computes its result.

The code you've given here solves the following problem: you want to know the sum of all the integers from a to b, inclusive. For your example, you want the sum of the numbers from 2 to 5, inclusive, which is

2 + 3 + 4 + 5

When trying to solve a problem recursively, one of the first steps should be to figure out how to break the problem down into a smaller problem with the same structure. So suppose that you wanted to sum up the numbers from 2 to 5, inclusive. One way to simplify this is to notice that the above sum can be rewritten as

2 + (3 + 4 + 5)

Here, (3 + 4 + 5) happens to be the sum of all the integers between 3 and 5, inclusive. In other words, if you want to know the sum of all the integers between 2 and 5, start by computing the sum of all the integers between 3 and 5, then add 2.

So how do you compute the sum of all the integers between 3 and 5, inclusive? Well, that sum is

3 + 4 + 5

which can be thought of instead as

3 + (4 + 5)

Here, (4 + 5) is the sum of all the integers between 4 and 5, inclusive. So, if you wanted to compute the sum of all the numbers between 3 and 5, inclusive, you'd compute the sum of all the integers between 4 and 5, then add 3.

There's a pattern here! If you want to compute the sum of the integers between a and b, inclusive, you can do the following. First, compute the sum of the integers between a + 1 and b, inclusive. Next, add a to that total. You'll notice that "compute the sum of the integers between a + 1 and b, inclusive" happens to be pretty much the same sort of problem we're already trying to solve, but with slightly different parameters. Rather than computing from a to b, inclusive, we're computing from a + 1 to b, inclusive. That's the recursive step - to solve the bigger problem ("sum from a to b, inclusive"), we reduce the problem to a smaller version of itself ("sum from a + 1 to b, inclusive.").

If you take a look at the code you have above, you'll notice that there's this step in it:

return a + sumInts(a + 1, b: b)

This code is simply a translation of the above logic - if you want to sum from a to b, inclusive, start by summing a + 1 to b, inclusive (that's the recursive call to sumInts), then add a.

Of course, by itself this approach won't actually work. For example, how would you compute the sum of all the integers between 5 and 5 inclusive? Well, using our current logic, you'd compute the sum of all the integers between 6 and 5, inclusive, then add 5. So how do you compute the sum of all the integers between 6 and 5, inclusive? Well, using our current logic, you'd compute the sum of all the integers between 7 and 5, inclusive, then add 6. You'll notice a problem here - this just keeps on going and going!

In recursive problem solving, there needs to be some way to stop simplifying the problem and instead just go solve it directly. Typically, you'd find a simple case where the answer can be determined immediately, then structure your solution to solve simple cases directly when they arise. This is typically called a base case or a recursive basis.

So what's the base case in this particular problem? When you're summing up integers from a to b, inclusive, if a happens to be bigger than b, then the answer is 0 - there aren't any numbers in the range! Therefore, we'll structure our solution as follows:

  1. If a > b, then the answer is 0.
  2. Otherwise (a ≤ b), get the answer as follows:
    1. Compute the sum of the integers between a + 1 and b.
    2. Add a to get the answer.

Now, compare this pseudocode to your actual code:

func sumInts(a: Int, b: Int) -> Int {
    if (a > b) {
        return 0
    } else {
        return a + sumInts(a + 1, b: b)
    }
}

Notice that there's almost exactly a one-to-one map between the solution outlined in pseudocode and this actual code. The first step is the base case - in the event that you ask for the sum of an empty range of numbers, you get 0. Otherwise, compute the sum between a + 1 and b, then go add a.

So far, I've given just a high-level idea behind the code. But you had two other, very good questions. First, why doesn't this always return 0, given that the function says to return 0 if a > b? Second, where does the 14 actually come from? Let's look at these in turn.

Let's try a very, very simple case. What happens if you call sumInts(6, 5)? In this case, tracing through the code, you see that the function just returns 0. That's the right thing to do, to - there aren't any numbers in the range. Now, try something harder. What happens when you call sumInts(5, 5)? Well, here's what happens:

  1. You call sumInts(5, 5). We fall into the else branch, which return the value of `a + sumInts(6, 5).
  2. In order for sumInts(5, 5) to determine what sumInts(6, 5) is, we need to pause what we're doing and make a call to sumInts(6, 5).
  3. sumInts(6, 5) gets called. It enters the if branch and returns 0. However, this instance of sumInts was called by sumInts(5, 5), so the return value is communicated back to sumInts(5, 5), not to the top-level caller.
  4. sumInts(5, 5) now can compute 5 + sumInts(6, 5) to get back 5. It then returns it to the top-level caller.

Notice how the value 5 was formed here. We started off with one active call to sumInts. That fired off another recursive call, and the value returned by that call communicated the information back to sumInts(5, 5). The call to sumInts(5, 5) then in turn did some computation and returned a value back to the caller.

If you try this with sumInts(4, 5), here's what will happen:

  • sumInts(4, 5) tries to return 4 + sumInts(5, 5). To do that, it calls sumInts(5, 5).
    • sumInts(5, 5) tries to return 5 + sumInts(6, 5). To do that, it calls sumInts(6, 5).
    • sumInts(6, 5) returns 0 back to sumInts(5, 5).</li> <li>sumInts(5, 5)now has a value forsumInts(6, 5), namely 0. It then returns5 + 0 = 5`.
  • sumInts(4, 5) now has a value for sumInts(5, 5), namely 5. It then returns 4 + 5 = 9.

In other words, the value that's returned is formed by summing up values one at a time, each time taking one value returned by a particular recursive call to sumInts and adding on the current value of a. When the recursion bottoms out, the deepest call returns 0. However, that value doesn't immediately exit the recursive call chain; instead, it just hands the value back to the recursive call one layer above it. In that way, each recursive call just adds in one more number and returns it higher up in the chain, culminating with the overall summation. As an exercise, try tracing this out for sumInts(2, 5), which is what you wanted to begin with.

Hope this helps!

templatetypedef
  • 362,284
  • 104
  • 897
  • 1,065
  • 3
    Thanks for taking time out of your busy day to share such a comprehensive answer! There is a ton of great information here which is helping me get my head around recursive functions and will surely help others that stumble upon this post in the future. Thanks again and have a great day! – Jason Elwood Sep 05 '14 at 00:58
23

You've got some good answers here so far, but I'll add one more that takes a different tack.

First off, I have written many articles on simple recursive algorithms that you might find interesting; see

http://ericlippert.com/tag/recursion/

http://blogs.msdn.com/b/ericlippert/archive/tags/recursion/

Those are in newest-on-top order, so start from the bottom.

Second, so far all of the answers have described recursive semantics by considering function activation. That each, each call makes a new activation, and the recursive call executes in the context of this activation. That is a good way to think of it, but there is another, equivalent way: smart text seach-and-replace.

Let me rewrite your function into a slightly more compact form; don't think of this as being in any particular language.

s = (a, b) => a > b ? 0 : a + s(a + 1, b)

I hope that makes sense. If you're not familiar with the conditional operator, it is of the form condition ? consequence : alternative and its meaning will become clear.

Now we wish to evaluate s(2,5) We do so by doing a textual replacing of the call with the function body, then replace a with 2 and b with 5:

s(2, 5) 
---> 2 > 5 ? 0 : 2 + s(2 + 1, 5)

Now evaluate the conditional. We textually replace 2 > 5 with false.

---> false ? 0 : 2 + s(2 + 1, 5)

Now textually replace all false conditionals with the alternative and all true conditionals with the consequence. We have only false conditionals, so we textually replace that expression with the alternative:

---> 2 + s(2 + 1, 5)

Now, to save me having to type all those + signs, textually replace constant arithmetic with its value. (This is a bit of a cheat, but I don't want to have to keep track of all the parentheses!)

---> 2 + s(3, 5)

Now search-and-replace, this time with the body for the call, 3 for a and 5 for b. We'll put the replacement for the call in parentheses:

---> 2 + (3 > 5 ? 0 : 3 + s(3 + 1, 5))

And now we just keep on doing those same textual substitution steps:

---> 2 + (false ? 0 : 3 + s(3 + 1, 5))  
---> 2 + (3 + s(3 + 1, 5))                
---> 2 + (3 + s(4, 5))                     
---> 2 + (3 + (4 > 5 ? 0 : 4 + s(4 + 1, 5)))
---> 2 + (3 + (false ? 0 : 4 + s(4 + 1, 5)))
---> 2 + (3 + (4 + s(4 + 1, 5)))
---> 2 + (3 + (4 + s(5, 5)))
---> 2 + (3 + (4 + (5 > 5 ? 0 : 5 + s(5 + 1, 5))))
---> 2 + (3 + (4 + (false ? 0 : 5 + s(5 + 1, 5))))
---> 2 + (3 + (4 + (5 + s(5 + 1, 5))))
---> 2 + (3 + (4 + (5 + s(6, 5))))
---> 2 + (3 + (4 + (5 + (6 > 5 ? 0 : s(6 + 1, 5)))))
---> 2 + (3 + (4 + (5 + (true ? 0 : s(6 + 1, 5)))))
---> 2 + (3 + (4 + (5 + 0)))
---> 2 + (3 + (4 + 5))
---> 2 + (3 + 9)
---> 2 + 12
---> 14

All we did here was just straightforward textual substitution. Really I shouldn't have substituted "3" for "2+1" and so on until I had to, but pedagogically it would have gotten hard to read.

Function activation is nothing more than replacing the function call with the body of the call, and replacing the formal parameters with their corresponding arguments. You have to be careful about introducing parentheses intelligently, but aside from that, it's just text replacement.

Of course, most languages do not actually implement activation as text replacement, but logically that's what it is.

So what then is an unbounded recursion? A recursion where the textual substitution doesn't stop! Notice how eventually we got to a step where there was no more s to replace, and we could then just apply the rules for arithmetic.

No Refunds No Returns
  • 8,092
  • 4
  • 32
  • 43
Eric Lippert
  • 647,829
  • 179
  • 1,238
  • 2,067
  • Good example but it breaks your heart when you proceed to do more complex computations. Eg. Finding the common ancestor in a Binary Tree. – CodeYogi Oct 28 '15 at 17:26
12

The way that I usually figure out how a recursive function works is by looking at the base case and working backwards. Here's that technique applied to this function.

First the base case:

sumInts(6, 5) = 0

Then the call just above that in the call stack:

sumInts(5, 5) == 5 + sumInts(6, 5)
sumInts(5, 5) == 5 + 0
sumInts(5, 5) == 5

Then the call just above that in the call stack:

sumInts(4, 5) == 4 + sumInts(5, 5)
sumInts(4, 5) == 4 + 5
sumInts(4, 5) == 9

And so on:

sumInts(3, 5) == 3 + sumInts(4, 5)
sumInts(3, 5) == 3 + 9
sumInts(3, 5) == 12

And so on:

sumInts(2, 5) == 2 + sumInts(3, 5)
sumInts(4, 5) == 2 + 12
sumInts(4, 5) == 14

Notice that we've arrived at our original call to the function sumInts(2, 5) == 14

The order in which these calls are executed:

sumInts(2, 5)
sumInts(3, 5)
sumInts(4, 5)
sumInts(5, 5)
sumInts(6, 5)

The order in which these calls return:

sumInts(6, 5)
sumInts(5, 5)
sumInts(4, 5)
sumInts(3, 5)
sumInts(2, 5)

Note that we came to a conclusion about how the function operates by tracing the calls in the order that they return.

OregonTrail
  • 8,594
  • 7
  • 43
  • 58
6

Recursion. In Computer Science recursion is covered in depth under the topic of Finite Automata.

In its simplest form it is a self reference. For example, saying that "my car is a car" is a recursive statement. The problem is that the statement is an infinite recursion in that it will never end. The definition in the statement of a "car" is that it is a "car" so it may be substituted. However, there is no end because in the case of substitution, it still becomes "my car is a car".

This could be different if the statement were "my car is a bentley. my car is blue." In which case the substitution in the second situation for car could be "bentley" resulting in "my bentley is blue". These types of substitutions are mathematically explained in Computer Science through Context-Free Grammars.

The actual substitution is a production rule. Given that the statement is represented by S and that car is a variable which can be a "bentley" this statement can be recursively reconstructed.

S -> "my"S | " "S | CS | "is"S | "blue"S | ε
C -> "bentley"

This can be constructed in multiple ways, as each | means there is a choice. S can be replaced by any one of those choices, and S always starts empty. The ε means to terminate the production. Just as S can be replaced, so can other variables (there is only one and it is C which would represent "bentley").

So starting with S being empty, and replacing it with the first choice "my"S S becomes

"my"S

S can still be substituted as it represents a variable. We could choose "my" again, or ε to end it, but lets continue making our original statement. We choose the space which means S is replaced with " "S

"my "S

Next lets choose C

"my "CS

And C only has one choice for replacement

"my bentley"S

And the space again for S

"my bentley "S

And so on "my bentley is"S, "my bentley is "S, "my bentley is blue"S, "my bentley is blue" (replacing S for ε ends the production) and we have recursively built our statement "my bentley is blue".

Think of recursion as these productions and replacements. Each step in the process replaces its predecessor in order to produce the end result. In the exact example of the recursive sum from 2 to 5, you end up with the production

S -> 2 + A
A -> 3 + B
B -> 4 + C
C -> 5 + D
D -> 0

This becomes

2 + A
2 + 3 + B
2 + 3 + 4 + C
2 + 3 + 4 + 5 + D
2 + 3 + 4 + 5 + 0
14
Travis J
  • 81,153
  • 41
  • 202
  • 273
  • I am not sure that finite state automata or context-free grammars are the best examples which can help one building some first intuition about recursion. They are nice examples, but perhaps a bit unfamiliar to programmers having no previous CS background. – chi Sep 06 '14 at 23:05
6

Think recursion as a multiple clones doing same thing...

You ask to clone[1]: "sum numbers between 2 and 5"

+ clone[1]               it knows that: result is 2 + "sum numbers between 3 and 5". so it asks to clone[2] to return: "sum numbers between 3 and 5"
|   + clone[2]           it knows that: result is 3 + "sum numbers between 4 and 5". so it asks to clone[3] to return: "sum numbers between 4 and 5"
|   |   + clone[3]       it knows that: result is 4 + "sum numbers between 5 and 5". so it asks to clone[4] to return: "sum numbers between 5 and 5"
|   |   |   + clone[4]   it knows that: result is 5 + "sum numbers between 6 and 5". so it asks to clone[5] to return: "sum numbers between 6 and 5"
|   |   |   |   clone[5] it knows that: it can't sum, because 6 is larger than 5. so he returns 0 as result.
|   |   |   + clone[4]   it gets the result from clone[5] (=0)  and sums: 5 + 0,  returning 5
|   |   + clone[3]       it gets the result from clone[4] (=5)  and sums: 4 + 5,  returning 9
|   + clone[2]           it gets the result from clone[3] (=9)  and sums: 3 + 9,  returning 12
+ clone[1]               it gets the result from clone[2] (=12) and sums: 2 + 12, returning 14

and voilá!!

Christian
  • 7,062
  • 9
  • 53
  • 79
  • [yep](https://stackoverflow.com/questions/46612470/could-i-ask-for-physical-analogies-or-metaphors-for-recursion/46613542#46613542). :) copying is key to [understanding function calls](https://stackoverflow.com/search?q=user%3A849891+empty+sheet+paper+) in general, too (each invocation uses the same function recipe with its new fresh invocation frame / sand-box to play in). – Will Ness Apr 01 '21 at 16:40
5

I'll give it a go.

Executing the equation a + sumInts(a+1, b), I will show how the final answer is 14.

//the sumInts function definition
func sumInts(a: Int, b: Int) -> Int {
    if (a > b) {
        return 0
    } else {
        return a + sumInts(a + 1, b)
    }
}

Given: a = 2 and b = 5

1) 2 + sumInts(2+1, 5)

2) sumInts(3, 5) = 12
   i) 3 + sumInts(3+1, 5)
   ii) 4 + sumInts(4+1, 5)
   iii) 5 + sumInts(5+1, 5)
   iv) return 0
   v) return 5 + 0
   vi) return 4 + 5
   vii) return 3 + 9

3) 2 + 12 = 14.

Let us know if you have any further questions.

Here's another example of recursive functions in the following example.

A man has just graduated college.

t is the amount of time in years.

The total actual number of years worked before retiring, can be calculated as follows:

public class DoIReallyWantToKnow 
{
    public int howLongDoIHaveToWork(int currentAge)
    {
      const int DESIRED_RETIREMENT_AGE = 65;
      double collectedMoney = 0.00; //remember, you just graduated college
      double neededMoneyToRetire = 1000000.00

      t = 0;
      return work(t+1);
    }

    public int work(int time)
    {
      collectedMoney = getCollectedMoney();

      if(currentAge >= DESIRED_RETIREMENT_AGE 
          && collectedMoney == neededMoneyToRetire
      {
        return time;
      }

      return work(time + 1);
    }
}

And that should be just enough to depress anyone, lol. ;-P

Bryan
  • 3,629
  • 2
  • 28
  • 27
5

A little bit off-topic, I know, but... try looking up recursion in Google... You'll see by example what it means :-)


Earlier versions of Google returned the following text (cited from memory):

Recursion

See Recursion

On September 10th 2014, the joke about recursion has been updated:

Recursion

Did you mean: Recursion


For another reply, see this answer.

Community
  • 1
  • 1
Pierre Arnaud
  • 10,212
  • 11
  • 77
  • 108
5

One really good tip I came across in learning and really understanding recursion is to spend some time learning a language that doesn't have any form of loop construct other than via recursion. That way you'll get a great feel for how to USE recursion via practice.

I followed http://www.htdp.org/ which, as well as being a Scheme tutorial, is also a great introduction on how to design programs in terms of the architecture and design.

But basically, you need to invest some time. Without a 'firm' grasp of recursion certain algorithms, such as backtracking, will always seem 'hard' or even 'magic' to you. So, persevere. :-D

I hope this helps and Good Luck!

Th3Minstr3l
  • 322
  • 2
  • 7
4

I think the best way to understand recursive functions is realizing that they are made to process recursive data structures. But in your original function sumInts(a: Int, b: Int) that calculates recursively the sum of numbers from a to b, it seems not to be a recursive data structure... Let's try a slightly modified version sumInts(a: Int, n: Int) where n is how many numbers you'll add.

Now, sumInts is recursive over n, a natural number. Still not a recursive data, right? Well, a natural number could be considered a recursive data structre using Peano axioms:

enum Natural = {
    case Zero
    case Successor(Natural)
}

So, 0 = Zero, 1 = Succesor(Zero), 2 = Succesor(Succesor(Zero)), and so on.

Once you have a a recursive data structure, you have the template for the function. For each non recursive case, you can calculate the value directly. For the recursive cases you assume that the recursive function is already working and use it to calculate the case, but deconstructing the argument. In the case of Natural, it means that instead of Succesor(n) we'll use n, or equivalently, instead of n we'll use n - 1.

// sums n numbers beginning from a
func sumInts(a: Int, n: Int) -> Int {
    if (n == 0) {
        // non recursive case
    } else {
        // recursive case. We use sumInts(..., n - 1)
    }
}

Now the recursive function is simpler to program. First, the base case, n=0. What should we return if we want to add no numbers? The answer is, of course 0.

What about the recursive case? If we want to add n numbers beginning with a and we already have a working sumInts function that works for n-1? Well, we need to add a and then invoke sumInts with a + 1, so we end with:

// sums n numbers beginning from a
func sumInts(a: Int, n: Int) -> Int {
    if (n == 0) {
        return 0
    } else {
        return a + sumInts(a + 1, n - 1)
    }
}

The nice thing is that now you shouldn't need to think in the low level of recursion. You just need to verify that:

  • For the base cases of the recursive data, it calculates the answer without using recursion.
  • For the recursive cases of the recursive data, it calculates the answer using recursion over the destructured data.
jdinunzio
  • 1,506
  • 1
  • 11
  • 26
4

You might be interested in Nisan and Schocken's implementation of functions. The linked pdf is part of a free online course. It describes the second part of a virtual machine implementation in which the student should write a virtual-machine-language-to-machine-language compiler. The function implementation they propose is capable of recursion because it is stack-based.

To introduce you to the function implementation: Consider the following virtual machine code:

enter image description here

If Swift compiled to this virtual machine language, then the following block of Swift code:

mult(a: 2, b: 3) - 4

would compile down to

push constant 2  // Line 1
push constant 3  // Line 2
call mult        // Line 3
push constant 4  // Line 4
sub              // Line 5

The virtual machine language is designed around a global stack. push constant n pushes an integer onto this global stack.

After executing lines 1 and 2, the stack looks like:

256:  2  // Argument 0
257:  3  // Argument 1

256 and 257 are memory addresses.

call mult pushes the return line number (3) onto the stack and allocates space for the function's local variables.

256:  2  // argument 0
257:  3  // argument 1
258:  3  // return line number
259:  0  // local 0

...and it goes-to the label function mult. The code inside mult is executed. As a result of executing that code we compute the product of 2 and 3, which is stored in the function's 0th local variable.

256:  2  // argument 0
257:  3  // argument 1
258:  3  // return line number
259:  6  // local 0

Just before returning from mult, you will notice the line:

push local 0  // push result

We will push the product onto the stack.

256:  2  // argument 0
257:  3  // argument 1
258:  3  // return line number
259:  6  // local 0
260:  6  // product

When we return, the following happens:

  • Pop the last value on the stack to the memory address of the 0th argument (256 in this case). This happens to be the most convenient place to put it.
  • Discard everything on the stack up to the address of the 0th argument.
  • Go-to the return line number (3 in this case) and then advance.

After returning we are ready to execute line 4, and our stack looks like this:

256:  6  // product that we just returned

Now we push 4 onto the stack.

256:  6
257:  4

sub is a primitive function of the virtual machine language. It takes two arguments and returns its result in the usual address: that of the 0th argument.

Now we have

256:  2  // 6 - 4 = 2

Now that you know how a function call works, it is relatively simple to understand how recursion works. No magic, just a stack.

I have implemented your sumInts function in this virtual machine language:

function sumInts 0     // `0` means it has no local variables.
  label IF
    push argument 0
    push argument 1
    lte              
    if-goto ELSE_CASE
    push constant 0
    return
  label ELSE_CASE
    push constant 2
    push argument 0
    push constant 1
    add
    push argument 1
    call sumInts       // Line 15
    add                // Line 16
    return             // Line 17
// End of function

Now I will call it:

push constant 2
push constant 5
call sumInts           // Line 21

The code executes and we get all the way to the stopping point where lte returns false. This is what the stack looks like at this point:

// First invocation
256:  2   // argument 0
257:  5   // argument 1
258:  21  // return line number
259:  2   // augend
// Second
260:  3   // argument 0
261:  5   // argument 1
262:  15  // return line number
263:  3   // augend
// Third
264:  4   // argument 0
265:  5   // argument 1
266:  15  // return line number
267:  4   // augend
// Fourth
268:  5   // argument 0
269:  5   // argument 1
270:  15  // return line number
271:  5   // augend
// Fifth
272:  6   // argument 0
273:  5   // argument 1
274:  15  // return line number
275:  0   // return value

Now let's "unwind" our recursion. return 0 and goto line 15 and advance.

271:  5
272:  0

Line 16: add

271:  5

Line 17: return 5 and goto line 15 and advance.

267:  4
268:  5

Line 16: add

267:  9

Line 17: return 9 and goto line 15 and advance.

263:  3
264:  9

Line 16: add

263:  12

Line 17: return 12 and goto line 15 and advance.

259:  2
260:  12

Line 16: add

259:  14

Line 17: return 14 and goto line 21 and advance.

256:  14

There you have it. Recursion: Glorified goto.

Jackson
  • 9,188
  • 6
  • 52
  • 77
4

There are already a lot of good answers. Still I am giving a try.
When called, a function get a memory-space allotted, which is stacked upon the memory-space of the caller function. In this memory-space, the function keeps the parameters passed to it, the variables and their values. This memory-space vanishes along with the ending return call of the function. As the idea of stack goes, the memory-space of the caller function now becomes active.

For recursive calls, the same function gets multiple memory-space stacked one upon another. That's all. The simple idea of how stack works in memory of a computer should get you through the idea of how recursion happens in implementation.

Gulshan
  • 3,611
  • 5
  • 35
  • 46
3

Recursion started making sense to me when I stopped reading what others say about it or seeing it as something I can avoid and just wrote code. I found a problem with a solution and tried to duplicate the solution without looking. I only looked at the solution when I got helplessly stuck. Then I went back at trying to duplicate it. I did this again on multiple problems until I developed my own understanding and sense of how to identify a recursive problem and solve it. When I got to this level, I started making up problems and solving them. That helped me more. Sometimes, things can only be learned by trying it out on your own and struggling; until you “get it”.

Phil
  • 2,143
  • 19
  • 44
2

Many of the answers above are very good. A useful technique for solving recursion though, is to spell out first what we want to do and code as a human would solve it . In the above case, we want to sum up a sequence of consecutive integers (using the numbers from above):

2, 3, 4, 5  //adding these numbers would sum to 14

Now, note that these lines are confusing (not wrong, but confusing).

if (a > b) {
    return 0 
}

Why the test a>b?, and whyreturn 0

Let's change the code to reflect more closely what a human does

func sumInts(a: Int, b: Int) -> Int {
  if (a == b) {
    return b // When 'a equals b' I'm at the most Right integer, return it
  }
  else {
    return a + sumInts(a: a + 1, b: b)
  }
}

Can we do it even more human like? Yes! Usually we sum up from left to right (2+3+...). But the above recursion is summing from right to left (...+4+5). Change the code to reflect it (The - can be a little intimidating, but not much)

func sumInts(a: Int, b: Int) -> Int {
  if (a == b) {
    return b // When I'm at the most Left integer, return it
  }
  else {
    return sumInts(a: a, b: b - 1) + b
  }
}

Some may find this function more confusing since we are starting from the 'far' end, but practicing can make it feel natural (and it is another good 'thinking' technique: Trying 'both' sides when solving a recursion). And again, the function reflects what a human (most?) does: Takes the sum of all left integers and adds the 'next' right integer.

2

I was having hard time to understanding recursion then i found this blog and i already seen this question so i thought i must have to share . You must read this blog i found this extremely helpful it explain with stack and even it explain how two recursion works with stack step by step. I recommend you first understand how stack works which it explain very well here : journey-to-the-stack

then now you will understand how recursion works now take a look of this post : Understand recursion step by step

enter image description here

Its a program :

def hello(x):
    if x==1:
        return "op"
    else:
        u=1
        e=12
        s=hello(x-1)
        e+=1
        print(s)
        print(x)
        u+=1
    return e

hello(3)

enter image description here enter image description here

0

Let me tell you with an example of Fibonacci series, Fibonacci is

t(n) = t(n - 1) + n;

if n = 0 then 1

so let see how recursion works, I just replace n in t(n) with n-1 and so on. it looks:

t(n-1) = t(n - 2) + n+1;

t(n-1) = t(n - 3) + n+1 + n;

t(n-1) = t(n - 4) + n+1 + n+2 + n;

.

.

.

t(n) = t(n-k)+ ... + (n-k-3) + (n-k-2)+ (n-k-1)+ n ;

we know if t(0)=(n-k) equals to 1 then n-k=0 so n=k we replace k with n:

t(n) = t(n-n)+ ... + (n-n+3) + (n-n+2)+ (n-n+1)+ n ;

if we omit n-n then:

t(n)= t(0)+ ... + 3+2+1+(n-1)+n;

so 3+2+1+(n-1)+n is natural number. it calculates as Σ3+2+1+(n-1)+n = n(n+1)/2 => n²+n/2

the result for fib is : O(1 + n²) = O(n²)

This the best way to understand recursive relation

Community
  • 1
  • 1
Alireza Rahmani Khalili
  • 2,727
  • 2
  • 32
  • 33