Stack Overflow
Stack Overflow

Questions tagged [scribe-server]

Scribe is a server for aggregating log data streamed in real time from a large number of servers.

Scribe is a server for aggregating log data that's streamed in real time from clients. It is designed to be scalable, extensible without client-side modification, and robust to failure of the network or any specific machine.

For more information, check out the github repo: https://github.com/facebook/scribe

See the Scribe Wiki for documentation: http://wiki.github.com/facebook/scribe

11 questions
11
votes
0 answers

Scribe, Flume and Chukwa - what are alternatives?

I would like to learn about alternatives to those projects, especially designed to aggregate data from logs from multiple nodes (>500) and designed for low memory/cpu usage. I'm familiar with scribe, flume and chukwa and I think that they use too…
wlk
  • 5,695
  • 6
  • 54
  • 72
4
votes
4 answers

Logging/tracking in PHP: Scribe, Chukwa, log4php?

This is probably a pretty high-level question that requires a lot of explaining, but I'm in need of a lot of explaining. Basically I'm developing a PHP application that requires a lot of logging and tracking. Tracking clicks, interactions,…
Josh Smith
  • 14,674
  • 18
  • 72
  • 118
4
votes
2 answers

Has anyone used Facebook Scribe? (the tool for logging everything)

How does it work? (Explain it in terms of server, writes, GETs, values, whatever). DOes it work with Win32 apps?
TIMEX
  • 259,804
  • 351
  • 777
  • 1,080
3
votes
3 answers

Logging data with scribe

None of the scribe examples I've seen actually mention the best way to take logs/logfiles and send them to scribe. I could configure a logrotate script that has a postrotate section that "cats" the rotated file to scribe (but then I get minutes…
lukatmyshu
  • 31
  • 1
  • 3
2
votes
1 answer

Cloudera's Flume vs Facebook's Scribe

Is there anyone who got a chance to work on both? I need to set up a framework to move data around. Basically, we have clickstream data coming in as text files. This data needs to be moved around form the app-servers to HDFS, and then to S3 after…
Hari Menon
  • 33,649
  • 14
  • 85
  • 108
2
votes
1 answer

What does a Scribe log look like?

I'm having trouble understanding what I can log with Scribe, or even what the log output looks like... Is it a text or binary format? What is the structure of a log message? Time-Message tuples? Any answers or links to documentation would be greatly…
nicolaskruchten
  • 26,384
  • 8
  • 83
  • 101
2
votes
1 answer

scribe with protocol buffer and advanced thrift?

I have two questions here: Question 1: -- can thrift provide an inner-class functionality? (see my example next) -- if it can, can thrift use such functionality easily? Here is the scribe interface (scribe/if/scribe.thrift). But its message field…
charlie111
  • 121
  • 1
  • 5
0
votes
1 answer

error while compiling scribe2.2 with thrift 0.7.0 on ubuntu lucid and maverick

I am getting following error while compiling scribe server on ubuntu. In file included from store.cpp:27: scribe_server.h:45: error: conflicting return type specified for ‘virtual scribe::thrift::ResultCode scribeHandler::Log(const…
Shridhar
  • 1
  • 2
0
votes
1 answer

Does the Facebook Scribe Server support authenticating its clients and securing the client/server connection?

I plan on running a Facebook Scribe Server on an AWS EC2 providing logging services to several Heroku hosted Rails clients. Is there a mechanism to authenticate Scribe clients in cloud-based scenarios like one described above? If so, can the…
Steve Wilhelm
  • 6,200
  • 2
  • 32
  • 36
0
votes
4 answers

Anyone have details steps for installing Facebook's Scribe on an EC2 Instance?

Anyone have details steps for installing Facebook's Scribe on an EC2 Instance? Most of the instructions found by doing a search are a bit out of date.
Steve Wilhelm
  • 6,200
  • 2
  • 32
  • 36
0
votes
2 answers

How to build facebook's scribe?

I just downloaded the source code of facebook's scribe. I'm new to it and having read the readme.build file , I can say I could barely understand how to build it. Could anyone give me the step by step procedures? thanks... :)
Owen
  • 4,063
  • 17
  • 58
  • 78