Questions tagged [marklogic-dhf]

Use for questions about the MarkLogic Data Hub Framework. More people will see your question if you also tag it with "marklogic".

The MarkLogic Data Hub Framework is a data integration framework and tool-set to quickly and efficiently integrate data from many sources into a single MarkLogic database, and expose that data.

The MarkLogic Data Hub Framework lives at https://github.com/marklogic/marklogic-data-hub

190 questions
4
votes
2 answers

Can ml-gradle deploy a query options file to an app server?

I have a MarkLogic cluster configured with DHF 5 and ml-gradle. I have multiple HTTP app servers and a couple of query options file. When I do an mlDeploy, the query options files are deployed to the final app server, but not the others. Is there a…
eaolson
  • 14,717
  • 7
  • 43
  • 58
4
votes
0 answers

MarkLogic DHF Harmonization Flow Failing

I'm trying to run an absolutely minimal harmonization flow to test out the Data Hub Framework (DHF), but the flow fails every time. After creating a new harmonization flow (default settings, tried with blank template and creating from entity…
TUrwin
  • 755
  • 1
  • 5
  • 9
3
votes
1 answer

Facing issue when running data hub flow using REST API in Marklogic

When I am trying to run Data hub flow from REST API using the POST method, I am getting bad request error. I am using postman to run the below flow. I have followed the documentation…
3
votes
2 answers

MarkLogic - Incremental load using MLCP

MarkLogic version : 9.0-6.2 We are trying to use mlcp to load daily changes of customer data into data-hub-STAGING and then use a harmonize flow to bring changes into data-hub-FINAL. As I understand, the 'collector.sjs' is used to return the uris…
Bhanu
  • 427
  • 2
  • 8
3
votes
1 answer

MarkLogic - JSON to XML conversion - handling multiple attributes

I have a document as below. let j = { "PolicyInfo" : { "id" : "12345", "PolNum" : "TestPolicy", "NameInfo": { "idref":"9999", "Name":"TestName" } } } My requirement is to convert id (under PolicyInfo) and also…
Bhanu
  • 427
  • 2
  • 8
3
votes
1 answer

MarkLogic Data Hub Framework Quick Start Hub - Error "unsupported auth scheme: [Basic realm=public]" when connecting to a remote Instance

I am testing out the ML DHF Quickstart Hub from my workstation and can connect fine to a local instance of MarkLogic. But when I create a new environment gradle-DEV.properties file and try to connect to a remote MarkLogic cluster I get the error:…
dan
  • 131
  • 3
2
votes
1 answer

Marklogic DHF5:- Can we return multiple content for one document in main.sjs

We are migrating from MarkLogic DHF4 to DHF5 (Data Hub Framework) We are having scenario where for one entity, depending on criteria we need to create more than one harmonize document for a single input document. This scenario was possible in legacy…
SUB
  • 23
  • 2
2
votes
0 answers

DHF mlDeploy : Plugin [id: 'net.saliman.properties', version: '1.4.6'] was not found

While I was trying to deploy marklogic DHF project 5.4.x in my local using gradle mlDeploy, I was getting UnknownPlugin exception for net.saliman.properties. I am using gradle version 6.4. And I could see this plugin available in the repository. Any…
2
votes
1 answer

How to check mandatory fields are present in the CSV while data ingestion in marklogic mlcp

I want to check few mandatory fields are available in CSV while ingestion of data through MLCP in marklogic. If those fields are not available, I need to ignore those records has to be ingested in marklogic
ramz123
  • 207
  • 1
  • 8
2
votes
1 answer

How to do arithmetic operation in TDE

I have requirement to get previous date of one of the date field, for that I am doing below operation in TDE. But I am getting error on this operation. How can I achieve…
ramz123
  • 207
  • 1
  • 8
2
votes
1 answer

How to get the uri of the records returned by an optic query

I have written an optic query to get a list of documents and I need the URIs of those documents. let $sql := "select * from table1" let $results := op:from-sql($sql) I need the URIs of all the records in $results. How to achieve this?
ramz123
  • 207
  • 1
  • 8
2
votes
1 answer

How do I handle the REST API in node.js in Marklogic Grove?

I am developing a UI application using MarkLogic Grove(React). By default, REST API calls from web browser will be forwarded directly to MarkLogic. For example: http://hostname/v1/resources/foo/ If the REST API is a specific path, I would like to do…
2
votes
2 answers

Cannot deploy to SSL on app server with DHF 5.2.1

In our environment we have a self-signed certificate template and the app servers on ports 8000, 8001, 8002, as well as our application app servers, are using that. We're using DHF 5.2.1. When we try a deploy, it successfully deploys the database,…
Dave Cassel
  • 8,352
  • 20
  • 38
2
votes
1 answer

How can I map objects and arrays in the MarkLogic Data Hub QuickStart?

In the MarkLogic Data Hub QuickStart, I have configured a customer entity and an address entity. The address entity is embedded in the customer using a 1..n relationship. I have created a mapping for the customer entity: When I click on the "Test"…
Andreas H
  • 77
  • 7
2
votes
0 answers

Is there any way to do authentication other than password authentication with Marklogic Grove?

I am developing a UI application using MarkLogic Grove(React). By default, password authentication is used when logging in to grove. I would like to change this part to a more secure method such as multi-factor authentication or one-time…
1
2 3
12 13