Stack Overflow
Stack Overflow

Questions tagged [rbm]

Restricted Boltzmann Machines, used in contemporary neural networks.

Restricted Boltzmann Machines, used in contemporary s.

70 questions
12
votes
1 answer

The Free energy approximation Equation in Restriction Boltzmann Machines

According a deeplearning tutorial: The free energy in python is def free_energy(self, v_sample): ''' Function to compute the free energy ''' wx_b = T.dot(v_sample, self.W) + self.hbias vbias_term = T.dot(v_sample, self.vbias) …
ryo
  • 568
  • 1
  • 4
  • 16
10
votes
2 answers

Restricted Boltzmann Machine for real-valued data - gaussian linear units (glu) -

I want my Restricted Boltzmann Machine to learn a new representation of real-valued data (see: Hinton - 2010 - A Practical Guide to Training RBMs). I'm struggling with an implementation of Gaussian linear units. With Gaussian linear units in the…
theo
  • 111
  • 2
  • 5
7
votes
1 answer

Problems with real-valued input deep belief networks (of RBMs)

I am trying to recreate the results reported in Reducing the dimensionality of data with neural networks of autoencoding the olivetti face dataset with an adapted version of the MNIST digits matlab code, but am having some difficulty. It seems that…
Junier
  • 1,622
  • 1
  • 15
  • 21
7
votes
1 answer

Java code for Restricted Boltzmann machines and Deep Learning

Since last few days I am reading and studying about Restricted Boltzmann machines and Deep Learning. Now to test the ability of Deep learning I am in search of Java code. I searched for long time on Google but could not get any satisfactory…
N D Thokare
  • 1,703
  • 6
  • 35
  • 57
6
votes
1 answer

Prediction for RBM in scikit

I would like to use RBM in scikit. I can define and train a RBM like many other classifiers. from sklearn.neural_network import BernoulliRBM clf = BernoulliRBM(random_state=0, verbose=True) clf.fit(X_train, y_train) But I can't seem to find a…
user3394040
  • 947
  • 13
  • 22
5
votes
1 answer

Gaussian-RBM fails on a trivial example

I want to have a nitty-gritty understanding of Restricted Boltzman Machines with continuous input variables. I am trying to devise the most trivial possible example, so that the behavior could be easily tracked. So, here it is. The input data is…
alex
  • 256
  • 1
  • 13
5
votes
1 answer

How to test a Restricted Boltzmann Machine implementation ?

I developed a simple binary Restricted Boltzmann Machine implementation and now I would like to test it. (Ultimately I'm gonna use it for a DBN, but I would like to test independently). I saw that several people and papers are talking about testing…
Baptiste Wicht
  • 7,472
  • 7
  • 45
  • 110
5
votes
1 answer

(Python) Gaussian Bernoulli RBM on computing P(v|h)

Context: I am implementing Gaussian Bernoulli RBM, it is like the popular RBM but with real-valued visible units. True that the procedure of sampling hidden values p(h=1|v) are the same for both, i.e. Problem: My problem is in coding (using Python)…
IssamLaradji
  • 6,637
  • 8
  • 43
  • 68
4
votes
4 answers

Restricted Boltzmann Machine - reconstruction

I read some articles about restricted Boltzmann machines. These machines were tested for their reconstruction capabilities. I understand how training works, but not how this reconstruction is done. Can anybody give me some hints ?
rocksportrocker
  • 7,251
  • 2
  • 31
  • 48
3
votes
3 answers

How to train a RBM and reconstruct input with DeepLearning4J?

I'm trying to train a Restricted Boltzmann Machine (RBM) with DeepLearning4J 0.7 but without success. All the examples I found are either not doing anything useful or not working anymore with DeepLearning4J 0.7. I need to train a single RBM with…
Baptiste Wicht
  • 7,472
  • 7
  • 45
  • 110
3
votes
0 answers

Tensorflow GraphDef cannot be larger than 2GB

I'm trying to implement a deep autoencoder with tensorflow. The RBM pretraining works just fine, but when it comes to fine tuning, it raises the error: 'ValueError: GraphDef cannot be larger than 2GB'. My input is an array in the shape of [12396,…
Baoming Wang
  • 31
  • 3
3
votes
2 answers

R Package Deepnet: Training and Testing the MNIST dataset

I am trying to train the MNIST dataset using deepenet package's dbn.dnn.train function. The task is a classification one. I am using the following command dbn.deepnet <- dbn.dnn.train(train.image.data,train.image.labels,hidden=c(5,5)) The problems…
the M
  • 125
  • 2
  • 10
3
votes
2 answers

Continuous RBM: Poor performance only for negative valued input data?

i tried to port this python implementation of a continuous RBM to Matlab: http://imonad.com/rbm/restricted-boltzmann-machine/ I generated 2-dimensional trainingdata in the shape of a (noisy) circle and trained the rbm with 2 visible an 8 hidden…
Johannes
  • 3,300
  • 2
  • 20
  • 35
2
votes
1 answer

"RuntimeError: self must be a matrix"

RBM we add methods to convert the visible input to the hidden representation and the hidden representation back to reconstructed visible input. Both methods return the activation probabilities, while the sample_h method also returns the observed…
reddotcheese13
  • 23
  • 1
  • 7
2
votes
1 answer

Gibbs sampling using sklearn package

I'm currently trying to use sklearns package for the bernoulli version of the Restricted Boltzmann Machine [RBM], but I don't understand how it works. The dataset I want to use it on is the MNIST-dataset. The very small amount of code I'm using…
Konrad S
  • 61
  • 1
  • 7
1
2 3 4 5