Monitor Directory for Changes

Question

Much like a similar SO question, I am trying to monitor a directory on a Linux box for the addition of new files and would like to immediately process these new files when they arrive. Any ideas on the best way to implement this?

Answer 1

First make sure inotify-tools in installed.

Then use them like this:

logOfChanges="/tmp/changes.log.csv" # Set your file name here.

# Lock and load
inotifywait -mrcq $DIR > "$logOfChanges" &
IN_PID=$$

# Do your stuff here
...

# Kill and analyze
kill $IN_PID
while read entry; do
   # Split your CSV, but beware that file names may contain spaces too.
   # Just look up how to parse CSV with bash. :)
   path=... 
   event=...
   ...  # Other stuff like time stamps?
   # Depending on the event…
   case "$event" in
     SOME_EVENT) myHandlingCode path ;;
     ...
     *) myDefaultHandlingCode path ;;
done < "$logOfChanges"

Alternatively, using --format instead of -c on inotifywait would be an idea.

Just man inotifywait and man inotifywatch for more infos.

You can also use incron and use it to call a handling script.

Answer 2

Look at inotify.

With inotify you can watch a directory for file creation.

Answer 3

One solution I thought of is to create a "file listener" coupled with a cron job. I'm not crazy about this but I think it could work.

Answer 4

fschange (Linux File System Change Notification) is a perfect solution, but it needs to patch your kernel