1

Python newb...beware!

I am trying to recursively ftp some files. In the script below, I get an error:

Traceback (most recent call last):
  File "dump.py", line 7, in <module>
    for root,dirs,files in recursive:
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftputil.py", line 880, in walk
    if self.path.isdir(self.path.join(top, name)):
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_path.py", line 133, in isdir
    path, _exception_for_missing_path=False)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftputil.py", line 860, in stat
    return self._stat._stat(path, _exception_for_missing_path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_stat.py", line 624, in _stat
    _exception_for_missing_path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_stat.py", line 578, in __call_with_parser_retry
    result = method(*args, **kwargs)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_stat.py", line 543, in _real_stat
    lstat_result = self._real_lstat(path, _exception_for_missing_path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_stat.py", line 502, in _real_lstat
    for stat_result in self._stat_results_from_dir(dirname):
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_stat.py", line 419, in _stat_results_from_dir
    lines = self._host_dir(path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_stat.py", line 411, in _host_dir
    return self._host._dir(path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftputil.py", line 811, in _dir
    descend_deeply=True)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftputil.py", line 578, in _robust_ftp_command
    self.chdir(path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftputil.py", line 603, in chdir
    ftp_error._try_with_oserror(self._session.cwd, path)
  File "/usr/local/lib/python2.6/site-packages/ftputil/ftp_error.py", line 146, in _try_with_oserror
    raise PermanentError(*exc.args)
ftputil.ftp_error.PermanentError: 550 /usr/local/web: No such file or directory
Debugging info: ftputil 2.6, Python 2.6.5 (linux2)

Exited: 256

I have no idea what that means. However, when I change the directory to "/path/dir2" it works and prints out "file.txt".

Here's my directory structures: 

/path/dir1/another/file.txt # I get the above error with this path
/path/dir2/another/file.txt # this works fine, even though the directories have the same structure

My script: import ftputil

ftp = ftputil.FTPHost('ftp.site.com','user','pass')
recursive = ftp.walk("/path/dir1",topdown=True,onerror=None)
for root,dirs,files in recursive:
 for name in files:
  print name
ftp.close
VisioN
  • 143,310
  • 32
  • 282
  • 281
usr951
  • 73
  • 1
  • 6

1 Answers1

2

Is there a symblolic link in /path/dir1/ that points back to /usr/local/web?

If you want to step over this error you could put a try catch block in and log...

ftp = ftputil.FTPHost('ftp.site.com','user','pass')
try:
    recursive = ftp.walk("/path/dir1",topdown=True,onerror=None)
    for root,dirs,files in recursive:
         for name in files:
               print name
except Error e:
   print "Error: %s occurred" % (e)
ftp.close

the above will catch all errors. you can also import the specific error your getting and do this...

import ftputil.ftp_error.PermanentError as PermanentError
ftp = ftputil.FTPHost('ftp.site.com','user','pass')
try:
    recursive = ftp.walk("/path/dir1",topdown=True,onerror=None)
    for root,dirs,files in recursive:
         for name in files:
              print name
except PermanentError e:
   print "Permanent Error: %s occurred" % (e)
ftp.close
JimM
  • 3
  • 1
Matt Alcock
  • 12,399
  • 14
  • 45
  • 61
  • that could be it but I really have no idea since the ftp site is a 3rd party. If it is that, how can I "skip" files that have symbolic links? – usr951 Feb 22 '12 at 23:28
  • thx. It doesn't move on after an error. It will print the error once and then die – usr951 Feb 22 '12 at 23:52
  • Yes my mistake you need to have this try except in the walk function. Another option is to move to the level below "/path/dir1" if you find an error in that directory. Sort of divide and conquer the problem when you get the error. – Matt Alcock Feb 22 '12 at 23:59
  • I already accepted the answer but I don't have enough points to upvote it. – usr951 Feb 25 '12 at 17:45