In my example architecture; I have an IN-Mobius and a ADN-AE-Thyme (nCube Thyme).
First of all; i created a AE which is called "ae_test_02", i can GET this resource via Postman.
After this step; i run ADN-AE-Thyme, thyme.js, and it created a…
I'm working on IoTKETI Mobius platform. I try to implement group-based authentication methods in oneM2M, Mobius platform. I was able to Register, Update, Delete an Application Entity. I did not use access control policies yet, because of my main aim…
I am currently new to .NET for Spark and need to append a C# list to a delta table.
I assume I first need to create a Spark DataFrame to do this.
In the sample code how would I go about appending "names" to the dataframe "df"?
It seems now this has…
I'm new to Databricks.Is it possible to send the code passing through API (like Mobius) from C# to run jobs in Databricks ?
Could you possibly give me some code example ?
such as if I want to run some job in notebook which contain the NoSql code in…
I am trying to run Mobius HiveDataFrame Example but not able to run.
var jsonFilePath = "file:///C:/Mobius/build/runtime/data/people.json";
const string dbName = "SampleHiveDataBaseForMobius";
const string tableName =…
No connection could be made because the target machine actively refused it 127.0.0.1:some port number
Here is my code i have just wrote in console application in Programe.cs is
using System;
using System.Collections.Generic;
using…
I know in Scala , you can read in a parquet file as follows:
//Create Spark Context
val sparkConf = new SparkConf().setAppName(appName).setMaster(sparkMaster)
val sc = new SparkContext(sparkConf)
val sqlContext = new SQLContext(sc)
import…
I am new to the world of Java and Spark, I found out an impressive library for providing C# binding to Spark which allows us to use the C# to work with the SparkSQL.
I have some large amount of process data in one of my custom data store that has…
My situation is as follows: I would like to submit to Spark a 32-bit driver program. The driver program is in C# (.NET Framework console app). I use Mobius (https://github.com/Microsoft/Mobius/releases) to enable Spark fo C#.
the app is rather…
I am new to Apache spark and trying to run this on Windows machine with Mobius.
but i am getting exception while running it.
first of all i have setup following environment variables
JAVA_HOME C:\Program Files\Java\jdk1.8.0_152
HADOOP_HOME…
I finally managed to get spark running locally and start it (?) using:
spark-shell
I see this like starting a server program that can be consumed via APIs - not sure if this is correct? Or is the spark master running anyway? The result is this…
I am looking to try the C# driver with an existing (stand alone) spark cluster (on Ubuntu Linux) which I interact happily with via python or scala.
I am unclear as to how to run a simple c# example having downloaded the latest Mobius release to the…
I am trying to run a simple spark clr program as local debug mode using VS2012 on my windows environment.
Please find the below steps that i did,
Downloaded v1.6.100 from the following page and extracted to my D…
Hi I'm trying to run the below example copied directly from Mobius Github. But when attempting to use the method SaveAsTextFile(string filepath) it's not finding the method. Instead its shows the error in Figure 1.
I'm referencing the latest…
First let me say that I am newbie to Spark, SparkR, Hadoop, etc... I am .NET developer that has been tasked with integrating our .NET applications with Apache Spark and eventually Apache SparkR. I am currently able to run the samples locally, but…