Questions tagged [netlib-java]
7 questions
6
votes
1 answer
Why netlib-java native blas/lapack libraries doesn't give performance improvement?
I am using this piece of code to calculate spark recommendations:
SparkSession spark = SparkSession
.builder()
.appName("SomeAppName")
.config("spark.master", "local[" + args[2] + "]")
…
Stepan Yakovenko
- 8,670
- 28
- 113
- 206
3
votes
1 answer
Spark-Shell cannot use Netlib-Java
I am trying to link against local BLAS libraries in a simple example to test out the performance difference to a "regular" implementation.
I dutifully followed the instructions posted on the official netlib-java GitHub,
but I still get an error,…
dennlinger
- 9,890
- 1
- 42
- 63
3
votes
2 answers
Where can I find the source-code for netlib-java?
Spark's MLLib states that https://github.com/fommil/netlib-java is a dependency.
However, this repo has been removed from github (the above link is dead). Google's cached version of the pages is still there, and there is a note that the library…
Luciano
- 2,388
- 1
- 22
- 33
1
vote
0 answers
Spark netlib-java openBLAS
I am using word2vec in mllib and I want to improve the speed of linear operations in word2vec by configuring OpenBLAS.
I configured OpenBLAS on the server by manually compiling OpenBLAS with the following command.
git clone…
Rain Chen
- 11
- 1
1
vote
0 answers
How to set scala breeze logger
The performance session at the bottom of page says that "Set your logger settings to ALL for the com.github.fommil.netlib package to check the status, and to com.github.fommil.jniloader for a more detailed breakdown. "
I am running some linear…
Xiangyu
- 824
- 9
- 34
0
votes
1 answer
Apache Spark - OpenBlas and Lapack are not working in Ubuntu 20.04
So, I am using spark 3.1.3 on standalone mode with 16 workers I have done all the necessary steps described in the Spark documentation but the native libraries still are not working.
I have included the below dependency in the pom…
Des0lat0r
- 482
- 3
- 18
0
votes
1 answer
Py4JNetworkError: symbol lookup error, undefined symbol: cblas_daxpy
The environment is: JDK 1.7; CDH 5.8.0
The code is
from pyspark.ml.feature import PCA
from pyspark.mllib.linalg import Vectors
data = [(Vectors.sparse(5, [(1, 1.0), (3, 7.0)]),),
(Vectors.dense([2.0, 0.0, 3.0, 4.0, 5.0]),),
…
cdhit
- 1,384
- 1
- 15
- 38