Questions tagged [fiware-cosmos]

Cosmos is an implementation of the Big Data GE, allowing the deployment of private computing clusters based on Hadoop ecosystem.

References

Fiware Cosmos

72 questions
6
votes
1 answer

How can I Read and Transfer chunks of file with Hadoop WebHDFS?

I need to transfer big files (at least 14MB) from the Cosmos instance of the FIWARE Lab to my backend. I used the Spring RestTemplate as a client interface for the Hadoop WebHDFS REST API described here but I run into an IO Exception: Exception in…
Andrea Sassi
  • 101
  • 5
5
votes
2 answers

How to scale Orion GE?

I have deployed an Orion instance in FILAB and I have configured the Cygnus inyector in order to store information in Cosmos. But...let us imagine a scenario in which the number of entities increases drastically. In this hypothetical scenario one…
5
votes
2 answers

OAuth2 access to Cosmos' WebHDFS in FIWARE Lab

I've recently seen the access to Cosmos' WebHDFS in FIWARE Lab has been protected with OAuth2. I know I have to add a OAuth2 token to the request in order to continue using WebHDFS, but: How can I get the token? How the token is added to the…
3
votes
2 answers

How to connect Orion with the public cosmos.lab.fi-ware.org instance using Cygnus

I am trying to persist my Orion data into the public cosmos.lab.fi-ware.org instance using Cygnus. Cygnus is up and running and the HDFSSink part of my /usr/cygnus/conf/agent_1.conf looks like this: # OrionHDFSSink configuration …
José Castillo Lema
  • 315
  • 1
  • 2
  • 17
3
votes
1 answer

HDFS access error from Cosmos global instance

I'm trying to access to my HDFS space by using the Hadoop fs commands. I've followed the instuctions from: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/BigData_Analysis_-_Quick_Start_for_Programmers But after successfully logged…
tiziano
  • 33
  • 2
3
votes
1 answer

Connectivity problems between FILAB VMs and Cosmos global instance

I have the same kind of connectivity problem discussed in the question "Cygnus can not persist data on Cosmos global instance". However, I have found no solution after read it. Nowadays, I have recently deployed two virtual machines in FILAB (both…
3
votes
0 answers

Unable to connect from SpagoBI to Cosmos public server

Seems like the hive jdbc client version does not match the version on the cosmos server. Any idea which specific jar files I should use on SpagoBI to provide the appropriate JDBC connection to the hive2 server on Cosmos. Thanks! See stack trace…
M. S.
  • 131
  • 5
3
votes
1 answer

Cygnus can not persist data on Cosmos global instance

When trying to persist an entity from Cygnus to Cosmos global instance it fails. Looking at the log file I see something like that: 2015 15:31:50,006 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor]…
M. S.
  • 131
  • 5
3
votes
1 answer

How to get a valid oauth2 token in Cosmos?

My Cosmos profile is: IdM username: Cosmos username: Password: HDFS quota: 5 HDFS used: 0 Registration time: Fri Oct 23 2015 12:59:39 GMT+0200 (CEST) Last access time: …
nichel
  • 51
  • 2
3
votes
1 answer

Start Cosmos-GUI

I want to install Cosmos. I have installed Apache-Hadoop 2.6 with a single node and my next move was install cosmos-gui. So I follow the official installation guide -…
urb
  • 924
  • 1
  • 13
  • 28
3
votes
1 answer

Installing cosmos-gui

Can you help me with installing cosmos-gui? I think you are one of the developers behind cosmos? Am I right? We have already installed Cosmos, and now we want to install cosmos-gui. In the link below, I found the install…
3
votes
1 answer

PEP proxy config file for integration of IDM GE, PEP proxy and Cosmos big data

I have a question regarding PEP proxy file. My keystone service is running on 192.168.4.33:5000. My horizon service is running on 192.168.4.33:443. My WebHDFS service is running on 192.168.4.180:50070 and i intend to run PEP Proxy on…
Milos Miletic
  • 500
  • 6
  • 19
3
votes
1 answer

JDBC and Hive query error 10 or 9

In may i've created a Java servlet which allow me to query my hive tables on Cosmos . Before the migration to cygnus 0.8.2 , my data were pushed to a table named "hostabee" which I can still query from my Java application . But now a table is…
3
votes
1 answer

Can't connect to Cosmos to query Hive with Python or Node.js client

I am actually trying to develop a simple Node.js client, which can be used to query my Hive table on the Cosmos table . I first tried to use this implementation for Hive using Node.js : https://github.com/wdavidw/node-thrift-hive. My code is the…
2
votes
1 answer

FIWARE [NGSI] Orion-Cygnus-Hadoop HTTPBadRequestException: 'fiware-servicepath' through an Orion subscription

I want to persist some historical data from my server. So the documentation says that you must first send a subscription to Orion and then Orion will send the notification to Cygnus. I made the subscription like this: Entity payload =…
Cristina V
  • 117
  • 7
1
2 3 4 5