Stack Overflow
Stack Overflow

Questions tagged [hpcc-ecl]

ECL is a declarative programming language for High Performance Computing Cluster (HPCC). Do not confuse with Embeddable Common Lisp (ECL).

ECL is a declarative, data centric programming language designed in 2000 to allow a team of programmers to process big data across a High Performance Computing Cluster (HPCC) without the programmer being involved in many of the lower level, imperative decisions.

Do not confuse with Embeddable Common Lisp (ECL).

60 questions
4
votes
2 answers

Controlling ECL loop macro using results of a query

We are trying to write a loop macro with a break function. Basically we would like to repeat a certain action until X (derived from a Dataset) is true. The compiler doesn't seem to like this approach however (returns 'Constant expression expected')…
DataMacGyver
  • 386
  • 3
  • 10
2
votes
3 answers

In HPCC ECL, when running a LOCAL, LOOKUP JOIN. Does the RHS dataset gets copied to all nodes, or kept distributed due to LOCAL?

Say I have a cluster of 400 machines, and 2 datasets. some_dataset_1 has 100M records, some_dataset_2 has 1M. I then run: ds1:=DISTRIBUTE(some_dataset_1,hash(field_a)); ds2:=DISTRIBUTE(some_dataset_2,hash(field_b)); Then, I run the…
Gabriel Marcan
  • 31
  • 3
2
votes
3 answers

LEFT and RIGHT keywords in ECL

I'm new to ECL and having trouble trying to understand RIGHT and LEFT keywords (used in DEDUP, GROUP and other functions). How do they work? The ECL reference guide has a single paragraph about what it's supposed to do. for example, what is it doing…
ocarlos-
  • 41
  • 2
2
votes
1 answer

What is the ECL equivalent of NaN or IsNumeric?

I want to check if some value (i.e: 42 or 41.0005) is a number in ECL (HPCC). I have in mind a function using Regular Expressions like this: EXPORT IsNumeric(STRING UniqueID) := FUNCTION regex:='^\\d+$'; RETURN…
Oscar Foley
  • 6,817
  • 8
  • 57
  • 90
1
vote
1 answer

Running ECL from Visual Studio Code with no local repo

We have a HPCC Cluster that is connected to a Git Repository. Is there any way to bypass a local compile when invoking ECL code from VSC? This is a use case where teams of individuals will need to run ECL 'templates' - where filter conditions will…
Stu C
  • 11
  • 1
1
vote
2 answers

How to send POST request using sendgrip api in HPCC ECL?

Could someone kindly assist me in making a POST request call using the SendGrid API in HPCC ECL? I have diligently referred to the documentation and examples provided in the forum, but I have not come across any specific information or methods…
Yashi Mishra
  • 13
  • 2
1
vote
1 answer

In my HPCC Cluster, what does this error in a workunit "Error receiving actinit data for graph: xx" really means?

Note: I am running code in a cluster with 16 slaves, HPCC version 6.4.40 I am running some ECL code that returns this error: System error: 0: Graph graph2[14], SLAVE #1 [10.313.316.31:20100]: Error receiving actinit data for graph: 14 What does…
Oscar Foley
  • 6,817
  • 8
  • 57
  • 90
1
vote
2 answers

Unable to get the filelist using STD.File.RemoteDirectory

We are trying to use a unix machine as landing zone for reading files into an HPCC Thor environment. Initially we would get the error System error: -1: Failed to connect (setting host down) to dafilesrv/daliservix on XX.XXX.XX.XX:7100 Then we got…
Akhilesh Badhri
  • 23
  • 3
1
vote
1 answer

ModuleNotFoundError: No module named 'matplotlib' when using plt.imread() in embedded Python code

I am trying to read an image using plt.imread() in embedded Python code within my DATA function. The code is as follows: IMPORT PYTHON3 AS PYTHON; IMPORT Std; IMPORT Image; myRec := RECORD STRING id; DATA image; END; ds :=…
Dumbledore
  • 23
  • 4
1
vote
1 answer

How to convert hex data to byte data in ECL?

I am working on a code in ECL and trying to convert hex data into byte data. I am using the following line of code for this: hex_data := Std.Str.ToHexPairs((>DATA<)ds.contents); d1:=Std.Str.FromHexPairs(hex_data); But when I uncomment the second…
Dumbledore
  • 23
  • 4
1
vote
1 answer

Linear Regression bundle OLS.ecl is not recognizing the Beta in math library

When calling the OLS Module in LinearRegression bundle for training the model. It prompts the error that "Object math doesnot have a member named Beta" and "unknown identifier Beta". However, in the Match Module Beta function is already…
Waqar Hassan
  • 11
  • 1
1
vote
1 answer

ECL Equivalent to "rank over partition " SQL Statement

I am wondering what is the ECL equivalent to "rank over partition" sql statement. For a project that I will be working on, I need to assign a rank according to date. I know how to do this in PySpark, but I do not want to export all the data to…
tianrenqin
  • 11
  • 1
1
vote
1 answer

Linking multiple C++ files in ECL

I have C++ code spread across multiple C++ and header files and wanted to know how to link them in ECL. Should I install them as libraries (.cpp and header files) into the local cluster I am running in order to import them into the main C++ embed…
ANAGHA ANAND
  • 21
  • 1
1
vote
2 answers

ROXIE: How to get a list of files associated with a query?

Probably a multipronged question coming from a Thor Dev-Apologies if the title is misleading. I am looking to do the following: Find all the queries on a given Roxie environment. Find all the files associated with said queries or Find all the…
Abhishek Tyagi
  • 21
  • 2
1
vote
2 answers

How to send POST request in HPCC ECL?

Can someone help me understand how to make a REST POST request in HPCC? I've read through the documentation but I couldn't find any examples. Any help would be appreciated.
Vipin Katara
  • 55
  • 1
  • 4
1
2 3 4