15

How to use git submodules with Bitbucket pipelines?

I'm using Bitbucket pipelines to build my project and I'm having issues pulling in my submodule, I'm probably not configuring the SSH keys correctly.

What I've done:

  1. Created SSH key pair in my computer.
  2. Pasted the same key pair in both repositories (repo where the build will run and in the dependency repo) under Settings/SSH keys.

The build error:

Submodule 'dependencies/my-dependency' (git@bitbucket.org:mycompany/my-dependency.git) registered for path 'dependencies/my-dependency'
Cloning into 'dependencies/my-dependency'...
Warning: Permanently added the RSA host key for IP address '18.205.93.2' to the list of known hosts.
Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
Clone of 'git@bitbucket.org:mycompany/my-dependency.git' into submodule path 'dependencies/my-dependency' failed

My yml file

image:
  name: myuser/my-image-name
  username: $DOCKER_HUB_USERNAME
  password: $DOCKER_HUB_PASSWORD
  email: $DOCKER_HUB_EMAIL

pipelines:
  branches:
    pipelines-setup:
      - step:
          script:
            - git submodule update --init
Alejandro Cotilla
  • 2,501
  • 1
  • 20
  • 35

4 Answers4

34
  1. Your source repository should contains file MyProject/.gitmodules with paths to submodules (the paths to the repos in you .gitmodules file should be in the git@bitbucket.org:....git format):
[submodule "modules"]
    path = modules
    url = git@bitbucket.org:....git

[submodule "translations"]
    path = translations
    url = git@bitbucket.org:....git
  • Open repository where do you want to run pipelines
  • Open Settings
  • In section PIPELINES open SSH keys
  • Click on Generate key
  • Copy public key

now you need to add the ssh key to submodule repository

  • Open submodule repository
  • Open Settings
  • In section GENERAL open Access keys
  • Add copied ssh public key
NickUnuchek
  • 11,794
  • 12
  • 98
  • 138
  • In my setup, I don't have access to the submodule repo's "settings" (I only have read access) so I had to add the pipeline key to my personal SSH keys - and that worked, though probably not ideal? – Guss Dec 27 '20 at 09:32
  • Want to emphasize that the paths to the repos in you `.gitmodules` file should be in the git@bitbucket.org:....git format. – danbrellis Oct 25 '21 at 18:46
17

Found the solution. I had to add the ssh public key to the submodule repository under Settings / Access Keys not Settings / SSH Keys.

Alejandro Cotilla
  • 2,501
  • 1
  • 20
  • 35
5

here is another example that

  • uses the default image
  • adds submodules
  • zips only the needed files and uploads to bitbucket downloads
image: atlassian/default-image:2
pipelines:
  default:
    - step:
        deployment: production
        script:
          - git submodule update --recursive --init
          - apt-get update && apt-get install -y zip
          - zip -r Test.zip . -x bitbucket-pipelines.yml *.git*
          - pipe: atlassian/bitbucket-upload-file:0.1.3
            variables:
              BITBUCKET_USERNAME: $BITBUCKET_USERNAME
              BITBUCKET_APP_PASSWORD: $BITBUCKET_APP_PASSWORD
              FILENAME: Test.zip
Rakka Rage
  • 15,941
  • 8
  • 33
  • 45
-1

If you have initialized a submodule in the main repository, then you can add this command in the bitbucket pipeline step script:

- git submodule update --init --recursive

No need to use SSH Keys approach.

Malay
  • 635
  • 8
  • 11
  • 1
    Wrong. Without access to the submodule the pipeline will not be able to read it. You can get access easiest with ssh keys, but you can also publish your password in the yml if you want to publish all your secrets to all the hackers. – rurban Jun 10 '21 at 06:49