In Jenkins, how to checkout a project into a specific directory (using GIT)

Question

Sorry for the 'svn' style - we are in a process of migration from SVN to GIT (including our CI Jenkins environment).

What we need is to be able to make Jenkins to checkout (or should I say clone?) the GIT project (repository?) into a specific directory. We've tried some refspecs magic but it wasn't too obvious to understand and use successfully.

Furthermore, if in the same Jenkins project we need to checkout several private GitHub repositories into several separate dirs under a project root, how can we do it please?

We have GitHub plugin installed. Hope we've phrased the things right.

John McGehee · Answer 1 · 2016-12-19T20:07:08.520

In the new Jenkins 2.0 pipeline (previously named the Workflow Plugin), this is done differently for:

The main repository
Other additional repositories

Here I am specifically referring to the Multibranch Pipeline version 2.9.

Main repository

This is the repository that contains your Jenkinsfile.

In the Configure screen for your pipeline project, enter your repository name, etc.

Do not use Additional Behaviors > Check out to a sub-directory. This will put your Jenkinsfile in the sub-directory where Jenkins cannot find it.

In Jenkinsfile, check out the main repository in the subdirectory using dir():

dir('subDir') {
    checkout scm
}

Additional repositories

If you want to check out more repositories, use the Pipeline Syntax generator to automatically generate a Groovy code snippet.

In the Configure screen for your pipeline project:

Select Pipeline Syntax. In the Sample Step drop down menu, choose checkout: General SCM.
Select your SCM system, such as Git. Fill in the usual information about your repository or depot.
Note that in the Multibranch Pipeline, environment variable env.BRANCH_NAME contains the branch name of the main repository.
In the Additional Behaviors drop down menu, select Check out to a sub-directory
Click Generate Groovy. Jenkins will display the Groovy code snippet corresponding to the SCM checkout that you specified.
Copy this code into your pipeline script or Jenkinsfile.

Code snippet here: `checkout([$class: 'GitSCM', branches: [[name: '*/branchname']], doGenerateSubmoduleConfigurations: false, extensions: [[$class: 'RelativeTargetDirectory', relativeTargetDir: 'MyDirectory']], submoduleCfg: [], userRemoteConfigs: [[credentialsId: 'myId', url: 'https://github.com/jenkinsci/jenkins.git']]])` — davegallant, Nov 18 '16 at 14:32
Actually I think the answer by @davey_dev is the right one. If you first step into a subdir with the `dir('subDir')` step then the repo will be cloned into another sub-directory of subDir and you'll get `subDir/[repo name]/[contents]`. I was looking for a way to get `dubDir\[contents]` so using the `relativeTargetDir` was the right way to do it. — Mig82, Jun 02 '17 at 14:47
In addition to this, if you are doing this with the main repository, you may want to also use the `skipDefaultCheckout` option as shown in this post to avoid checking out twice https://devops.stackexchange.com/a/1074 — tvt173, May 21 '18 at 20:41

score 52 · Answer 2 · edited Sep 16 '16 at 22:28

52

I agree with @Łukasz Rżanek that we can use git plugin

But, I use option: checkout to a sub-direction what is enable as follow:
In Source Code Management, tick Git
click add button, choose checkout to a sub-directory

enter image description here

edited Sep 16 '16 at 22:28

rogerdpack

62,887
36
269
388

answered Mar 03 '15 at 09:26

biolinh

2,175
1
24
23

3

But you can't set different folders for different repos. – Pavel Leonov Jun 09 '16 at 12:45
In my case, my Jenkins job only clone code from one repository. I haven't tried to do this case you said. – biolinh Jun 10 '16 at 07:02
What if we dont want it to be a sub directory? can you use "../other_dir" - Answering my own quastion, you can use a relative checkout, and in the build shell change to that directory using "cd ../other_dir" – amleszk Feb 07 '20 at 18:01

score 50 · Accepted Answer · edited Mar 20 '12 at 17:29

The default git plugin for Jenkins does the job quite nicely.

After adding a new git repository (project configuration > Source Code Management > check the GIT option) to the project navigate to the bottom of the plugin settings, just above Repository browser region. There should be an Advanced button. After clicking it a new form should appear, with a value described as Local subdirectory for repo (optional). Setting this to folder will make the plugin to check out the repository into the folder relative to your workspace. This way you can have as many repositories in your project as you need, all in separate locations.

Alternatively, if the project you're using will allow that, you can use GIT sub modules, which are similar to external paths in SVN. In the GIT Book there is a section on that very topic. If that will not be against some policy, submodules are fairly simple to use, giving you powerful way to control the locations, versions/tags/branches that will be imported AND it will be available on your local repository as well giving you better portability.

Obviously the GIT plugin supports checking out submodules, so Jenkins can work with them quite effectively.

There is only one _Local subdirectory for repo_ setting is for all repositories so this is not really suitable for managing multiple repositories. See https://issues.jenkins-ci.org/browse/JENKINS-13086. — ubuntudroid, Jun 04 '13 at 13:15
I don't even see this option using Git plugin 2.4.2. This answer is 4 years old so maybe the option has been removed ? ( I do however see the "Checkout to a sub-directory" as mentioned in another answer by @biolinh, but that is for all repositories. — Zitrax, Mar 09 '16 at 13:11
"Checkout to subdirectory" is in the "Additional Behaviours" section of the git plugin. However, that still limits you to only a single git repository per job. If you need more than one git repository per job, use the Jenkins pipeline. — Mark Waite, Mar 23 '17 at 01:31

score 25 · Answer 4 · answered Oct 07 '16 at 07:45

It's worth investigating the Pipeline plugin. With the plugin you can checkout multiple VCS projects into relative directory paths. Beforehand creating a directory per VCS checkout. Then issue commands to the newly checked out VCS workspace. In my case I am using git. But you should get the idea.

node{
    def exists = fileExists 'foo'
    if (!exists){
        new File('foo').mkdir()
    }
    dir ('foo') {
        git branch: "<ref spec>", changelog: false, poll: false, url: '<clone url>'
        ......
    }
    def exists = fileExists 'bar'
    if (!exists){
        new File('bar').mkdir()
    }
    dir ('bar') {
        git branch: "<ref spec>", changelog: false, poll: false, url: '<clone url>'
        ......
    }
    def exists = fileExists 'baz'
    if (!exists){
        new File('baz').mkdir()
    }
    dir ('baz') {
        git branch: "<ref spec>", changelog: false, poll: false, url: '<clone url>'
        ......
    }
}

This gives the error, `Scripts not permitted to use new java.io.File java.lang.String`, which is true. See my answer for a way to use the pipeline code snippet generator to create the code you need for your pipeline script or Jenkinsfile. — John McGehee, Nov 03 '16 at 01:33
You could use `sh "mkdir -p directory` as a workaround for `Scripts not permitted...` — dernasherbrezon, Dec 29 '17 at 11:12

score 6 · Answer 5 · edited May 23 '17 at 12:18

6

Furthermore, if in the same Jenkins project we need to checkout several private GitHub repositories into several separate dirs under a project root. How can we do it please?

The Jenkin's Multiple SCMs Plugin has solved the several repositories problem for me very nicely. I have just got working a project build that checks out four different git repos under a common folder. (I'm a bit reluctant to use git super-projects as suggested previously by Łukasz Rżanek, as git is complex enough without submodules.)

edited May 23 '17 at 12:18

Community

1
1

answered Feb 21 '13 at 17:46

Alberto

5,021
4
46
69

Multiple SCM doesn't show changes for each build, there is a bug and they already 1.5 year didn't fix it :( – Pavel Leonov Jun 09 '16 at 12:33

score 3 · Answer 6 · answered Jul 12 '21 at 09:57

3

just add "dir wrapper" to the git operation:

dir('subDir') {
    checkout scm
}

answered Jul 12 '21 at 09:57

Illia Sydorenko

31
1

score 2 · Answer 7 · answered Feb 24 '21 at 09:45

Find repoName from the url, and then checkout to the specified directory.

String url = 'https://github.com/foo/bar.git';
String[] res = url.split('/');
String repoName = res[res.length-1];
if (repoName.endsWith('.git')) repoName=repoName.substring(0, repoName.length()-4);

checkout([
  $class: 'GitSCM', 
  branches: [[name: 'refs/heads/'+env.BRANCH_NAME]],
  doGenerateSubmoduleConfigurations: false,
  extensions: [
    [$class: 'RelativeTargetDirectory', relativeTargetDir: repoName],
    [$class: 'GitLFSPull'],
    [$class: 'CheckoutOption', timeout: 20],
    [$class: 'CloneOption',
        depth: 3,
        noTags: false,
        reference: '/other/optional/local/reference/clone',
        shallow: true,
        timeout: 120],
    [$class: 'SubmoduleOption', depth: 5, disableSubmodules: false, parentCredentials: true, recursiveSubmodules: true, reference: '', shallow: true, trackingSubmodules: true]
  ],
  submoduleCfg: [],
  userRemoteConfigs: [
    [credentialsId: 'foobar',
    url: url]
  ]
])

score -1 · Answer 8 · answered Apr 16 '18 at 16:28

-1

In the new Pipeline flow, following image may help ..

answered Apr 16 '18 at 16:28

Sunny Tambi

2,393
3
23
27

This will throw an error when trying to use `git` executable saying there is no `.git` file – Jeremy Dec 06 '18 at 22:47

score -9 · Answer 9 · edited Apr 23 '19 at 15:29

-9

I do not use github plugin, but from the introduction page, it is more or less like gerrit-trigger plugin.

You can install git plugin, which can help you checkout your projects, if you want to include multi-projects in one jenkins job, just add Repository into your job.

edited Apr 23 '19 at 15:29

some_other_guy

3,364
4
37
55

answered Mar 19 '12 at 09:58

Tim

2,006
2
18
25

In Jenkins, how to checkout a project into a specific directory (using GIT)

9 Answers9

Linked