Stack Overflow
Stack Overflow

Questions tagged [mosaic-decisions]

23 questions
3
votes
1 answer

Is there a provision to view data at any processing node of a flow in Mosaic?

We have a complex flow with more than 50 processing nodes to transform huge amount of data and dump the data into a single Amazon S3 cluster. It is very difficult to understand if there is any issue in the data which is getting uploaded to S3 when…
Pravin Sharma
  • 1,160
  • 1
  • 8
  • 20
3
votes
1 answer

Mosaic-Decisions: different types of parameters

What different types of parameters do mosaic decision provide?What is the difference between input, calculated, sql and global variables?
aj1198
  • 53
  • 4
2
votes
1 answer

Save history of incremental changes of the flow without cloning them in Mosaic Decisions

While configuring a particular data pipeline in Mosaic Decisions, I want to try out different operations by using the available process nodes. I would like to keep the first few configured nodes for future reference and continue to add some other…
Priyanka Rokade
  • 47
  • 3
2
votes
2 answers

Handling data containing comma in a CSV file

I have a CSV File that I am trying to read from Amazon S3 in Mosaic Decisions. This file contains an Address column in which the data itself contains a comma. Example data in the file is shown below: Address sl,name,address 1,Ratan Kumar,FlatNo…
V Ruvesh
  • 281
  • 1
  • 7
2
votes
1 answer

Writing data into a single file for Azure instead of part files

I am trying to write a file to my Azure Storage using Mosaic Decisions. I want to write the file to Azure as a single file and not part files. How can this be achieved?
V Ruvesh
  • 281
  • 1
  • 7
2
votes
1 answer

How can I create a connection to any external database in Mosaic?

We are using Mosaic to load and read data from multiple sources like MySQL, SQL Server, Oracle in around 100 jobs using the reader node of Mosaic. To configure this reader node to connect these databases, how to create a connection for each one of…
codeogeek
  • 652
  • 1
  • 8
  • 22
2
votes
1 answer

Does Mosaic supports ingesting compressed data?

We have a scenario of uploading compressed files into Blob container in Microsoft Azure and then read it. Is it possible in Mosaic to do it and if yes, what is the way to achieve it? We have files in .gz format.
Pooja Bist
  • 257
  • 1
  • 5
2
votes
1 answer

Mosaic-Decisions: Different supported timezones in Expressions

In Mosaic Decisions Flows, I can see there's a system parameter called "$currentTime" which gives the current timestamp. But this is giving the current timestamp in UTC. I want to convert it into CST timezone. Is there a way I can do that?
Mayuri S
  • 23
  • 4
2
votes
1 answer

Using current_time system parameter in sql node of Mosaic decisions

In the custom SQL node of mosaic-decisions, I used the system parameter “current-time” . However, in the output, it is coming in as “Text” type – instead of “Date” type. What should be done to get it resolved as date in the output?
Anita Mishra
  • 23
  • 2
2
votes
1 answer

Mosaic Decisions Azure BLOB writer node creating multiple files

I’m using mosaic decisions data flow feature to read a file from Azure blob, do a few transformations and write that data back to Azure. It worked fine except that in the output file path I have given, it created a folder and I can see many files…
Soumyajeet Sarangi
  • 23
  • 2
2
votes
1 answer

Set default value for column in Mosaic Decisions

I’m using a data flow in Mosaic Decisions and I’m using a MySQL writer node. The result set that I’m going to write has a field inserted-time. But I want to skip the value in this column and want to use the default value set for that column in the…
onkar
  • 4,427
  • 10
  • 52
  • 89
1
vote
1 answer

Unexpected Result when data source has null values in Mosaic Decisions

I am designing a data pipeline in Mosaic Decisions. I have a database where some values in the data are nulls. I require to use a CustomSQL Node to query the database, but due to these Null values, the result is unexpected How can I avoid such…
Priyanka Rokade
  • 47
  • 3
1
vote
1 answer

How to fetch files from Azure Blob with current date in the path in Mosaic Decisions

I am using Mosaic Decisions for a specific data pipeline I have to run on a daily basis. I have a client whose file location changes everyday in the blob container based on the current date. For example, the file sales.xlsx has a path…
Priyanka Rokade
  • 47
  • 3
1
vote
1 answer

Convert Existing Stored Procedure having multiple update statements on Mosaic

I have a requirement to convert an existing Stored procedure having Multiple update statements. Ex: Current query in Stored procedure is - CREATE PROCEDURE [dbo].[SP_Load_Catalog] AS BEGIN SET NOCOUNT ON; truncate table dbo..Dummy2 update A set…
Abhijeet Vipat
  • 29
  • 5
1
vote
1 answer

Connection Timeout Error while reading the table having more than 100 columns in Mosaic Decisions

I am reading a table via snowflake reader node having less number of columns/attributes(around 50-80),the table is getting read on the Mosaic decisions Canvas. But when the attributes of table increases (approx 385 columns),Mosaic reader node fails.…
Abhijeet Vipat
  • 29
  • 5
1
2