2

I have a flat file connection manager that reads data from a file that I have constructed with a Powershell script. The fields in the file are delimited with a vertical bar (|) and each field is qualified with the ¬ character (mainly because some fields contain either vertical bar or double quotes).

I have set up my flat file connection manager with the text qualifier specified like so: enter image description here

Clicking on preview I can view the data just fine, everything appears to be working.

I then add a flat file source, hook it up to my flat file connection manager, hit the Preview button and that all looks great: enter image description here

Yet, when I run the data flow, the text qualifier character (¬) is appearing in each field, like this: enter image description here

Can someone please explain to me what is going on here? Because I cannot figure out why this is happening.

I tried the suggestions mentioned in the question below with no luck:

Hadi
  • 36,233
  • 13
  • 65
  • 124
johnmcp
  • 891
  • 1
  • 10
  • 17
  • 1
    @Hadi I actually found that question earlier but the suggested answer did not work for me – johnmcp Jun 17 '19 at 22:27
  • I updated the question in order to not been marked as duplicate – Hadi Jun 17 '19 at 22:30
  • Is it because of Code page Setting? – BeiBei ZHU Jun 18 '19 at 02:29
  • @BeiBeiZHU I don't think so. I had 1252 at first, and now I just tried 65001 (UTF-8) because I believe this is what Powershell outputs, but same result unfortunately. I also tried checking the Unicode option, but when doing this it cannot detect the end of the header row and throws an error immediately. – johnmcp Jun 18 '19 at 08:46

0 Answers0