Questions tagged [mobius]

(previously known as SparkCLR) is the binding for .

External links:

35 questions
2
votes
2 answers

OneM2M, IOTKETI Mobius RETRIEVE Group Member ContentInstances

In my example architecture; I have an IN-Mobius and a ADN-AE-Thyme (nCube Thyme). First of all; i created a AE which is called "ae_test_02", i can GET this resource via Postman. After this step; i run ADN-AE-Thyme, thyme.js, and it created a…
2
votes
0 answers

OneM2M Authentication Server

I'm working on IoTKETI Mobius platform. I try to implement group-based authentication methods in oneM2M, Mobius platform. I was able to Register, Update, Delete an Application Entity. I did not use access control policies yet, because of my main aim…
2
votes
2 answers

Create dataframe from C# List - Spark for .NET

I am currently new to .NET for Spark and need to append a C# list to a delta table. I assume I first need to create a Spark DataFrame to do this. In the sample code how would I go about appending "names" to the dataframe "df"? It seems now this has…
ow123
  • 21
  • 1
  • 2
2
votes
1 answer

How to call notebook or run jobs from C# in databricks using Mobius?

I'm new to Databricks.Is it possible to send the code passing through API (like Mobius) from C# to run jobs in Databricks ? Could you possibly give me some code example ? such as if I want to run some job in notebook which contain the NoSql code in…
2
votes
1 answer

JVM method execution failed: Nonstatic method load failed for class 14 when called with no parameters

I am trying to run Mobius HiveDataFrame Example but not able to run. var jsonFilePath = "file:///C:/Mobius/build/runtime/data/people.json"; const string dbName = "SampleHiveDataBaseForMobius"; const string tableName =…
Jay Prajapati
  • 362
  • 4
  • 26
2
votes
1 answer

SparkClr: Sparkcontext gives an Error

No connection could be made because the target machine actively refused it 127.0.0.1:some port number Here is my code i have just wrote in console application in Programe.cs is using System; using System.Collections.Generic; using…
Jay Prajapati
  • 362
  • 4
  • 26
2
votes
2 answers

Is there a way to read from Parquet files in hdfs into SqlContext from Mobius?

I know in Scala , you can read in a parquet file as follows: //Create Spark Context val sparkConf = new SparkConf().setAppName(appName).setMaster(sparkMaster) val sc = new SparkContext(sparkConf) val sqlContext = new SQLContext(sc) import…
user2608613
  • 352
  • 2
  • 11
2
votes
1 answer

Using DataFrames created in SparkCLR with zeppelin queries

I am new to the world of Java and Spark, I found out an impressive library for providing C# binding to Spark which allows us to use the C# to work with the SparkSQL. I have some large amount of process data in one of my custom data store that has…
Kiran
  • 2,997
  • 6
  • 31
  • 62
1
vote
0 answers

Submitting a 32-bit application to Spark via Mobius

My situation is as follows: I would like to submit to Spark a 32-bit driver program. The driver program is in C# (.NET Framework console app). I use Mobius (https://github.com/Microsoft/Mobius/releases) to enable Spark fo C#. the app is rather…
C_M
  • 61
  • 8
1
vote
0 answers

Apache Spark + Mobius Debug mode

I am new to Apache spark and trying to run this on Windows machine with Mobius. but i am getting exception while running it. first of all i have setup following environment variables JAVA_HOME C:\Program Files\Java\jdk1.8.0_152 HADOOP_HOME…
Riyaj Shaikh
  • 108
  • 7
1
vote
1 answer

getting started with mobius against local spark

I finally managed to get spark running locally and start it (?) using: spark-shell I see this like starting a server program that can be consumed via APIs - not sure if this is correct? Or is the spark master running anyway? The result is this…
cs0815
  • 16,751
  • 45
  • 136
  • 299
1
vote
1 answer

Getting Started with Mobius SparkClr (on Linux)

I am looking to try the C# driver with an existing (stand alone) spark cluster (on Ubuntu Linux) which I interact happily with via python or scala. I am unclear as to how to run a simple c# example having downloaded the latest Mobius release to the…
ismisesisko
  • 151
  • 3
  • 10
1
vote
1 answer

failure running sparkclr-submit.cmd

I am trying to run a simple spark clr program as local debug mode using VS2012 on my windows environment. Please find the below steps that i did, Downloaded v1.6.100 from the following page and extracted to my D…
karthick vas
  • 33
  • 2
  • 4
1
vote
1 answer

Is the SaveAsTextFile method no longer available in Mobius (SparkCLR)?

Hi I'm trying to run the below example copied directly from Mobius Github. But when attempting to use the method SaveAsTextFile(string filepath) it's not finding the method. Instead its shows the error in Figure 1. I'm referencing the latest…
raah
  • 158
  • 12
1
vote
1 answer

Issue Running PI example on Standalone Cluster

First let me say that I am newbie to Spark, SparkR, Hadoop, etc... I am .NET developer that has been tasked with integrating our .NET applications with Apache Spark and eventually Apache SparkR. I am currently able to run the samples locally, but…
sehunley
  • 25
  • 4
1
2 3