Stack Overflow
Stack Overflow

Questions tagged [pettingzoo]

This tag is for questions related to the PettingZoo framework for multi-agent reinforcement learning.

PettingZoo Code: https://github.com/Farama-Foundation/PettingZoo

PettingZoo Documentation: https://www.pettingzoo.ml/

12 questions
4
votes
1 answer

Add a TensorBoard metric from my PettingZoo environment

I'm using Tensorboard to see the progress of the PettingZoo environment that my agents are playing. I can see the reward go up with time, which is good, but I'd like to add other metrics that are specific to my environment. i.e. I'd like TensorBoard…
Ram Rachum
  • 84,019
  • 84
  • 236
  • 374
3
votes
0 answers

Stablebaselines3 and Pettingzoo

I am trying to understand how to train agents in a pettingzoo environment using the single agent algorithm PPO implemented in stablebaselines3. I'm following this tutorial where the agents act in a cooperative environment and they are all trained…
Onil90
  • 171
  • 1
  • 8
3
votes
1 answer

Why is TensorBoard not showing any data?

I'm running code to train a PPO policy on chess using PettingZoo: import gym.vector.utils import supersuit as ss import stable_baselines3.ppo import pettingzoo.classic if __name__ == '__main__': env = original_env =…
Ram Rachum
  • 84,019
  • 84
  • 236
  • 374
1
vote
1 answer

PettingZoo Agent Training with Supersuit and Stable Baselines 3

I am trying to train agents in a PettingZoo environment using stable baselines and supersuit. The new version from stable baselines 3, which is beta, is supporting Gymnasium now, and not just Gym. Therefore it should be compatible. Still it looks…
Ny Tech
  • 11
  • 1
1
vote
2 answers

Problem with PettingZoo and Stable-Baselines3 with a ParallelEnv

I am having trouble in making things work with a Custom ParallelEnv I wrote by using PettingZoo. I am using SuperSuit's ss.pettingzoo_env_to_vec_env_v1(env) as a wrapper to Vectorize the environment and make it work with Stable-Baseline3 and…
Piero Macaluso
  • 1,166
  • 1
  • 10
  • 24
0
votes
0 answers

Learn pettingzoo 1.24.0 pistonball_v6 multi agents with AEC env. (not parallel)

Trying to understand multi agents reinforcement learning (MARL) using SB3 PPO and pettingzoo pistonball env. Learning pistonball with parallel interface works ok (see enclosed code). Now I want to use AEC environment without conversion to parallel…
Ulf Wållgren
  • 161
  • 2
  • 8
0
votes
0 answers

Using Stable Baselines3 on pettingzoo MPE simple spread

SO I created a stable baseline model using A2C to train simple spread environment from pettingzoo (https://pettingzoo.farama.org/environments/mpe/simple_spread/). I referred to the SB3 tutorial provided at pettingzoo for this, and for some reason I…
ummokay
  • 1
0
votes
0 answers

Can the actor policy *function* be used to update the state in Gymnasium/PettingZoo?

I am trying to transition from hard-coding RL algorithms myself to using libraries like Stable Baselines 3 and RL-Lib, with environments built using Farama Foundation's Gymnasium and Petting Zoo libraries. However, many of the environments I am…
42bsk
  • 76
  • 1
  • 10
0
votes
0 answers

Experience with MARLlib

I trained some MPE environments (simpe_tag,...) in MALlib to see how well it trains.... but I came to a slight problem viewing the results I made and those they uploaded. I am realtivly new to MARL and have no idea if the are good or not. I tried…
Char
  • 1
  • 1
0
votes
0 answers

Petting Zoo Classic Environments

I am currently trying to implement my own version of a Connect Four Environment based on the version available on the PettingZoo Library github…
Lorenzo CONSOLI
  • 1
0
votes
0 answers

Different observation space Multi-Agent Reinforcement Learning using PettingZoo and SuperSuit

I'm trying to create a Multi-Agent Reinforcement Learning step-up where there are two types of agents. Each with a different type of observation and action space, precisely, two different sizes of images, one for each agent type. I am using…
assaf caftory
  • 1
  • 1
0
votes
1 answer

Errors with Atari Environments in PettingZooML

I'm trying to get the Atari environments from Petting Zoo working: https://www.pettingzoo.ml/. I've installed the AutoROMs and I can see the multiple .bin files from all the environments in the directory where the ROMs are installed. However, when I…
ksivakumar
  • 481
  • 2
  • 5
  • 19