-1

We have one EC2 test VM with spark master and 3 spark workers, what configs need to be done for Redis to work with PySpark? Thanks.

Abhi Basu
  • 1

1 Answers1

0

1) Make a zip file of Redis Module 2) Use PySpark's addPyFile as below sc.addPyFile("/path/to/redis.zip")

Reference : Write data to Redis from PySpark

Kaa
  • 154
  • 6