Questions tagged [weed-fs]

Seaweed-FS is a simple and highly scalable distributed file system.

Seaweed-FS is a simple and highly scalable distributed file system. There are two objectives:

  1. to store billions of files
  2. to serve the files fast
15 questions
4
votes
4 answers

Serve static files from Hadoop

My job is to design a distributed system for static image/video files. The size of the data is about tens of Terabytes. It's mostly for HTTP access (thus no processing on data; or only simple processing such as resizing- however it's not important…
hiro
  • 261
  • 7
  • 19
2
votes
1 answer

How to run seaweedFS as a daemon?

Started and tested a multi-server seaweedFS setup as below which is working great: ./weed server -dir=/VolA,/VolB -s3 -s3.config=weed.json -s3.port=9001 -master.defaultReplication="010" -master.peers=ip1:9333,ip2:9333,ip3:9333 -ip=ip1…
Geert-Jan
  • 18,623
  • 16
  • 75
  • 137
2
votes
1 answer

Add volume to SeaweedFS docker-compose file

I just working with SeaweedFS for a few days and I want to create multiple master and volume and filer in docker-compose so I just do that this way: version: '2' services: master_1: image: chrislusf/seaweedfs ports: - 9333:9333 …
MasOOd.KamYab
  • 944
  • 11
  • 25
1
vote
0 answers

Access SeaweedFS volume server dashboard running in kubernetes cluster

I have deployed SeaweedFS stack into on-promises k8s cluster. The deployed instances are 1 master server, 1 volume server, 1 filer and S3 API gateway. I defined k8s Deployment and Service on my own and I was able to make the stack running in the…
Won Kim
  • 31
  • 2
1
vote
1 answer

Any example on using GlusterFS from NodeJS

I have used Mongo GridFS and WeedFS to store media files before using NodeJS and now I would like to evaluate GlusterFS. I have found NodeJS module at https://github.com/qrpike/GlusterFS-NodeJS but examples shown below are confusing var GlusterFS,…
Exception
  • 8,111
  • 22
  • 85
  • 136
0
votes
1 answer

SeaweedFs: how to set max size for each volume?

When I start the master service I can specify the maximum volume size with the parameter -volumeSizeLimitMB. ./weed master -mdir="." -volumeSizeLimitMB=1000. Then, I start two volume services. ./weed volume -mserver="localhost:9333" -dir="."…
ALU
  • 353
  • 2
  • 4
  • 18
0
votes
2 answers

SeaweedFS Timeout exception

I was searching file storage lib for store my big datas. So I've found SeaweedFS and it looks very good for my project. I use windows bash for test on my localhost but I got error based on timeout issue. Command ./weed server -master.port=9333…
Obyvante
  • 95
  • 2
  • 11
0
votes
1 answer

what's the meaning of number of volumes?

I deploy one seaweedfs master and one volume server /usr/bin/weed master -ip=10.110.200.149 -port=9333 -mdir=/weed/mdir /usr/bin/weed volume -ip=10.110.200.149 -dir=/weed/vdir -port=8080 -mserver=10.110.200.149:9333 -max=7 When running for several…
zhashuyu
  • 161
  • 2
  • 9
0
votes
1 answer

Cross-Origin Request Blocked HLS URL

we are using seaweedFS to save our images and mp4 video file. Now, we are planning to save HLS files on seaweedFS. Everything is perfect, HLS files are now saving on seaweedFS but when we try to use HLS URL in HTML5 video player it gives following…
azharmalik3
  • 553
  • 8
  • 21
0
votes
1 answer

cannot write to seaweedfs

I am writing an image file to seaweedfs but it is throwing an err SyntaxError: Unexpected end of input below is the code var seaweedfs = new weedClient({ server: "localhost", port: 8080 …
JN_newbie
  • 5,492
  • 14
  • 59
  • 97
0
votes
1 answer

weed-fs in Linode running master

I'm using weed-fs 0.7 beta. I'm having an issue where the master server always does not have any free volume servers while i have 2 of them. I have 2 servers in Linode, i used one of them to create a master, volume and filer server using this…
Eugene Lim
  • 269
  • 3
  • 15
0
votes
1 answer

NAS vs Distributed File Systems

What are the use cases when should we prefer over any distributed file system like HDFS? How to decide which one to use or any other comparable alternative?
ptntialunrlsd
  • 794
  • 8
  • 23
0
votes
0 answers

Stream a file from NodeJS

I am using weed-fs to store files and trying to stream file to client using below code var fileName = [__dirname, '/uploads/', req.params.id, ".png"].join(''); try { var writeStream = fs.createWriteStream(fileName); …
redV
  • 684
  • 1
  • 9
  • 26
0
votes
1 answer

How to upload a file to weed-fs

Hi I am trying to upload a file to weed-fs using the weed-fs java client. I think I have successfully installed weed as per the instructions of how to install weed. In short I start the master with the command $./weed master then volume servers…
qualebs
  • 1,291
  • 2
  • 17
  • 34
-4
votes
1 answer

How can I store 1 billion images on servers uploaded from a web application?

What is the best way to store 1 billion images? (uploaded by users of website via PHP or Javascript upload) Since everyone knows storing tons of images (website users uploaded images in this case) are bad inside a single directory or NFS etc, what…