Python on the AWS Beanstalk. How to snapshot custom logs?

Question

I'm developing python application which works on aws beanstalk environment. For error handling and debugging proposes I write logs to custom lof file on the directory /var/logs/.

What should I do in order to have ability snapshot logs from Elastic beanstalk management console?

Chuck · Answer 1 · 2014-05-21T18:51:42.000

24

Expanding on Vadim911 (and my own comment), I solved the problem using a config file in .ebextensions. Here is the python code:

import logging
logging.basicConfig(filename='/opt/python/log/my.log', level=logging.DEBUG)

Here is the .ebextensions config file code:

files:
  "/opt/python/log/my.log" :
   mode: "000666"
   owner: ec2-user
   group: ec2-user
   content: |
       # Askbot log file

The contents of this file (along with other log files) is available using the Logs snapshot function on the AWS elastic beanstalk console.

edited May 21 '14 at 18:51

answered May 21 '14 at 17:25

Chuck

1,089
1
13
18

True, but there is no need to create the file in `.ebextensions`, as `logging` will do that for you when the file-handler is first initialized. If you run into a `PermissionError`, try removing the log file at the end of `container_commands` as explained [here](https://stackoverflow.com/a/60549321). – djvg Mar 06 '20 at 07:59

score 7 · Accepted Answer · answered Mar 03 '13 at 07:07

7

If you need have ability to snapshot log files from Beanstalk management console, you should just write you log files to "/opt/python/log/" folder. Elastic beanstalk scripts use this folder for log tailing.

answered Mar 03 '13 at 07:07

Vadym Fedorov

2,395
2
21
31

4

I get Permission denied when I try that. – Chuck May 21 '14 at 14:52
Chuck what exactly did you try? – Vadym Fedorov May 21 '14 at 15:39
logging.basicConfig(filename='/opt/python/log/my_log.log',level=logging.DEBUG) – Chuck May 21 '14 at 15:46

Python on the AWS Beanstalk. How to snapshot custom logs?

2 Answers2

Linked