Questions tagged [odo]

Odo migrates between many formats. These include in-memory structures like list, pd.DataFrame and np.ndarray and also data outside of Python like CSV/JSON/HDF5 files, SQL databases, data on remote machines, and the Hadoop File System.

More info: https://odo.readthedocs.io/en/latest/index.html

38 questions
7
votes
2 answers

Where is the pydata BLAZE project heading?

I find the blaze ecosystem* amazing because it covers most of the data engineering use cases. There was definitely a lot of interest on these projects during the period 2015-2016, but of late it has been ignored. I say this looking at the commits on…
human
  • 2,250
  • 20
  • 24
5
votes
3 answers

python odo sql AssertionError: datashape must be Record type, got 0 * {...}

I'm trying to import a CSV into MySQL using odo but am getting a datashape error. My understanding is that datashape takes the format: var * { column: type ... } where var means a variable number of rows. I'm getting the following…
jeff
  • 51
  • 2
4
votes
1 answer

access data in sharded JSON files on S3 from Blaze

I am trying to access line delimited JSON data on S3. From my understanding of the docs I should be able to do something like print data(S3(Chunks(JSONLines))('s3://KEY:SECRET@bucket/dir/part-*.json').peek() which throws BotoClientError:…
Daniel Mahler
  • 7,653
  • 5
  • 51
  • 90
3
votes
1 answer

Loading CSV to MySQL with odo and SQLAlchemy

I'm using odo to write a CSV file to a MySQL table. uri = 'mysql+pymysql://username:password@database/schema::table' odo('data.csv', uri) When I do not specify a datashape, the MySQL table gets created with all string columns as TEXT and all…
Raddfood
  • 169
  • 2
  • 4
  • 17
3
votes
0 answers

CSV to Oracle via Odo and SQL Alchemy

I have this code that sends CSVs to Oracle but it's slower than molasses in January. I'd like to use odo but the documentation is scarce for this exact type of situation (data from CSV to Oracle). I'm not married to Pandas, so if it's better to not…
Dance Party2
  • 7,214
  • 17
  • 59
  • 106
2
votes
1 answer

odo Function has keyword only parameters or annotations

The following command: from odo import odo odo(target='postgresql://{user}:{pass}@localhost/{server}::odo_dest_table',source='/home/username/Downloads/large_csv.csv') Produces the following error: File…
jason m
  • 6,519
  • 20
  • 69
  • 122
2
votes
1 answer

Replace Menu in website using Xpath

I want to use Xpath to replace my website menu of odoo 8. I don't want to replace all the header, but only one element in the menu : The shop When i inspect the element li , i see this :
2
votes
0 answers

blaze-odo error when trying to export an odo result to csv with MSSQL backend

I'm having an issue exporting some data from a MSSQL back-end to csv using blaze and odo. The first thing that I do is create a blaze.data object that connects to the MSSQL db using a dns connection and pyodbc as the driver. adjustment_statuses is a…
jgens
  • 21
  • 2
2
votes
1 answer

Python odo CSV to SQL - No such file or directory

I'm trying to upload files to a PostgreSQL database from my local computer, the error I get is: sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) could not open file "C:\Mar-2015.csv" for reading: No such file or directory The command…
QuinRiva
  • 679
  • 1
  • 7
  • 14
2
votes
1 answer

odo converting data between csv and mysql

When converting one of the .csv's to a pd.DataFrame using the python odo module I receive a TypeError TypeError: Cannot cast array from dtype('float64') to dtype('int64') according to the rule 'safe' The code that works for…
Itay Livni
  • 2,143
  • 24
  • 38
2
votes
0 answers

Migrating pandas dataframe from local computer using odo

Loading a pandas dataframe into postgres using odo does not work. I first use SQLalchemy to create a table object. The name of the table on my local postgres instance is testaccounts. meta = MetaData(bind=engine) table = Table('testaccounts', meta,…
Lucas Neo
  • 53
  • 6
1
vote
1 answer

DeprecationWarning: The longpolling-port is a deprecated alias to the gevent-port option, please use the latter

Odoo version 16.0 Python version 3.10 While running service it gives below warning in terminal odoo-16.0/odoo/tools/config.py:565 DeprecationWarning: The longpolling-port is a deprecated alias to the gevent-port option, please use the latter How to…
shashank verma
  • 303
  • 1
  • 3
  • 9
1
vote
0 answers

Exporting MySQL table to CSV using Blaze ODO library?

I am trying to export tables from My SQL to CSV using odo library the code is: src =f'mysql+pymysql://{MYSQL_READER_USERNAME}:%s@{MYSQL_READER_HOST}/{MYSQL_DB_NAME}' % urllib.parse.quote(f'{MYSQL_READER_PASSWORD}') csv =…
Asad Khalil
  • 45
  • 1
  • 10
1
vote
0 answers

TypeError: Cannot interpret 'CategoricalDtype(categories=['no', 'yes'], ordered=False)' as a data type

I just upgraded all my python libraries, and now my previous code is started to fail. I'm using blaze with pandas. Here is my method code blaze.data(res) res contains below data col1 age ... …
suresh goud
  • 367
  • 1
  • 3
  • 19
1
vote
0 answers

How to use python odo to update records in database?

Is the python odo function able to UPDATE records in a database table - or can it only INSERT? I've inherited a python script that uses odo for inserting records into a database table. I need to update a Value column in each record, but as it is…
okorng
  • 149
  • 1
  • 18
1
2 3