Stack Overflow
Stack Overflow

Questions tagged [ml-agent]

The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source Unity3D plugin that enables games and simulations to serve as environments for training intelligent agents. Agents - usually implemented as scripted C# Unity components - can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a Python API.

103 questions
5
votes
1 answer

ML Agents - Multiple agents break the training

I've been working on a self-balancing agent that strives to keep its waist at a certain height. Recently, I upgraded the "thighs" to allow for 3 axis to rotate instead of 2 that I previously had. After doing this, and modifying the ml agents code to…
Jaden Williams
  • 135
  • 9
5
votes
3 answers

how to deploy pytorch neural network for production code in Unity

I have a neural network trained in pytorch that I'd like to deploy into a Unity app. What's the best way to do it? I'm also interested in allowing the user to further train the neural network in the Unity app, which I guess would require to…
Mei Zhang
  • 1,434
  • 13
  • 29
4
votes
0 answers

Problem with unity mlagents-learn not training with --load

Hi I am trying to do my first unity ml-agents ai. Before, when I wanted to train my ai, I was writing mlagents-learn config/trainer_config.yaml --run-id=Taxi-1 --train in the terminal, but the ai stopped training after 50 000 steps. Then, I tried…
Vincent Quirion
  • 389
  • 2
  • 4
  • 16
3
votes
1 answer

"Expecting property name enclosed in double quotes" when running agents scene

In summary, I have a pair of legs that have rotation-axis-points and want to be able to allow the computer to figure out which way the legs should rotate to allow itself to balance and keep the 'waist' game-object greater than a certain height…
Jaden Williams
  • 135
  • 9
3
votes
1 answer

Why Unity Visual Studio doesn't recognise "Using MlAgents" when I create a new project, but recognises it within the demo project?

I've been trying to get Unity's MLAgents installed on my system. After going through the detailed guide "https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Installation-Windows.md" I managed to get the demo projects like the "3D Ball"…
Kimberly
  • 45
  • 4
3
votes
0 answers

How to use a TensorFlow Lite model in Unity

I would like to write an Android game in Unity which makes use of an already existing pre-trained neural network which I only have as a .tflite file. My first plan involved converting the .tflite file into a .nn file which then could be used by…
Welius
  • 53
  • 1
  • 7
2
votes
1 answer

Unity's ml-agents assets throw warnings and errors [PushBlockWithInput, Actuator, Barracuda]

The Problem I'm trying to work with Unity Machine Learning Agents and encountered problems during the setup. When I try to import the assets from Unity's ml-agents git into Unity, I get many warnings and errors inside Unity. For the purpose of…
Sharky Bamboozle
  • 1,066
  • 16
  • 28
2
votes
0 answers

(Unity ML-agent) What is the best way to observe the environment on a curved terrain?

Currently, For checking the objects on the slope, I'm using the RayPerceptionSensor3D component, increasing "EndVerticleOffset" variable by one every frame. But, I think this method seems to have a lot of overhead. is there a better way?
w ing
  • 31
  • 3
2
votes
6 answers

Unity ML Agents Package Manager is not importing Actuator script

I want to test the Unity ML example "3D Ball". So, I set up environment: Imported the ML Agents Package by Unity Package Manager. Copied the ML Agent example Assets from Unity's official GitHub to My Project File. Then, I opened the example scene…
MULTITAB
  • 21
  • 1
  • 2
2
votes
0 answers

Running ML-Agent Trained Frozen Graph in Tensorflow or Keras

I am trying to take a model trained by Unity ML-Agents and run inferences back inside Tensorflow / Keras. Any tips on how to do this? I tried loading the frozen graph file into a TF graph and then extracting the input/output tensor. I am assuming…
Billwaa
  • 21
  • 1
2
votes
1 answer

C# Unity - Extract pixel array from camera in unity and display in python

I am trying to do two things: Retrieve the 84 by 84 by 3 pixel array from a camera Send this array to a python script where it can be displayed I am stuck with 1), so for the moment I am simply writing the bytearray to a txt file and then opening…
Ludo
  • 2,307
  • 2
  • 27
  • 58
2
votes
1 answer

Couldn't connect to trainer on port 5004 using API version API-13 when using Unity3D ML-Agents

I'm using Unity3D ML-Agents and when running examples of multiple clones inside(3DBall for example), there is a message in the console says: Couldn't connect to trainer on port 5004 using API version API-13. Will perform inference instead.…
RoxaneY
  • 23
  • 3
2
votes
1 answer

How to get ML Agents to run in Unity?

I've tried going through the documentation but the steps mentioned there aren't quite clear enough. Is there a good step by step video tutorial that can be helpful? The ones I saw on YouTube are pretty old and don't work with the latest updates on…
nikmlnkr
  • 105
  • 2
  • 11
2
votes
5 answers

MLAgents Agent isn't getting better at training

I've been recently working on a self-balancing pair of legs that are supposed to try to keep the character from falling over. Each AgentReset, the legs reset all of its necessary factors such as pos, rot, and vel, and the floor beneath the character…
Jaden Williams
  • 135
  • 9
2
votes
2 answers

ModuleNotFoundError for Tensorflow and Anaconda (Windows 10)

I can't get tensorflow to work on two different Windows PCs and on both I get "ModuleNotFoundError: No module named 'tensorflow' when try to import them in python. Numpy for example works on one machine not the other. Checked a dozen of posts on…
Ren
  • 41
  • 1
  • 5
1
2 3 4 5 6 7