Azure Pipelines Get Latest files only

Question

I'm looking for a way to create an artifact that I can attach to a deployment pipeline that only contains the files that were changed in the commits that triggered this build.

What I have is a repo that has change scripts for database objects, so I want to package up only the change scripts for the last commit into a zip file and attach it to the build outputs. That way I can take zip file and apply each of the files on top of the database, this will be done later in a different step, right now I'm just trying to get all of the files that were changed.

Editted I have created the following step in the YAML file based on the comments below

- powershell: |
   #get the changed template
   echo "git diff-tree --no-commit-id --name-only -r $(Build.SourceVersion)"
   $a = git diff-tree --no-commit-id --name-only -r $(Build.SourceVersion)  

   #assign the filename to a variable        
   echo "Files"
   echo "##vso[task.setvariable variable=fileName]$a" 
- powershell: |
   #Print Files
   $fileName: echo "$env:fileName"

Below is the result, you can see that no files are changed. Here I changed the Readme file, which triggered the build.

score 1 · Answer 1 · answered Jun 16 '20 at 15:13

Not sure if this would help you, but hopefully will point in the right direction.

Assuming you have Git as source control. Have you considered to query those changes using Git instead? (I haven't tried, but I bet you'll be able to find in the pipeline metadata which merge triggered the build, and then use it to query Git for the file changes.

Have a look at this question in Stackoverflow

Hope it will help.

Cece Dong - MSFT · Answer 2 · 2020-06-26T03:04:58.097

0

If you are using Git version control, you could try to add a script task to get the changed file names in your pipeline, copy them to artifact directory and then publish them.

It is easy to get the changed files using git commands git diff-tree --no-commit-id --name-only -r commitId. When you get the changed file's name, you need to assign it to a variable using expression ##vso[task.setvariable variable=VariableName]value. Then you can use this variable in the copy and publish task.

You can check below yaml pipeline for example:

    - powershell: |
       #get the changed template
       $a = git diff-tree --no-commit-id --name-only -r $(Build.SourceVersion)  
       
       #assign the filename to a variable        
       echo "##vso[task.setvariable variable=fileName]$a" 

    - powershell: |
       echo "$env:fileName"

edited Jun 26 '20 at 03:04

answered Jun 17 '20 at 07:27

Cece Dong - MSFT

29,631
1
24
39

I used the above script in the YAML, but it never echos out any file names. It just echos a blank line. – Paul Cavacas Jun 17 '20 at 12:01
This logging command sets a variable in the variable service of taskcontext. The first task can set a variable, and following tasks in the same phase are able to use the variable. You could add another PS task to print the `$fileName`: `echo "$env:fileName"`. – Cece Dong - MSFT Jun 22 '20 at 01:56
Are you able to print the `$filename`? – Cece Dong - MSFT Jun 24 '20 at 10:11
Sorry I'm not overly familiar with YAML and PowerShell. If I put $fileName: echo "$env:fileName" in there then it errors with Variable reference is not valid. ':' was not followed by a valid variable name character. – Paul Cavacas Jun 24 '20 at 20:01
You need to add a following PS task to print the variable. Check my update reply. – Cece Dong - MSFT Jun 26 '20 at 03:05
I still get a blank line. The entire YAML has been updated above – Paul Cavacas Jun 28 '20 at 12:15
You should check the second PS task output. – Cece Dong - MSFT Jun 29 '20 at 02:02
Sorry I missed your comment. Both outputs contain nothing for the files. – Paul Cavacas Jul 01 '20 at 11:56
Please check the whether you edit the correct branch and check whether `$(Build.SourceVersion)` is the version you edited. – Cece Dong - MSFT Jul 02 '20 at 03:32
The build is setup as a CI build, so it has to be the right version, when I make the change it starts the corresponding building automatically. – Paul Cavacas Jul 02 '20 at 12:05
Please set system.debug to true, to see whether you can see `$a` value. By the way, did you repo hosted in DevOps or other system? – Cece Dong - MSFT Jul 03 '20 at 10:41
Late to the party but try `echo "Changed file is $(fileName)"` and it should print the variable value – Gavin Jul 20 '20 at 14:43

Azure Pipelines Get Latest files only

2 Answers2