Odo migrates between many formats. These include in-memory structures like list, pd.DataFrame and np.ndarray and also data outside of Python like CSV/JSON/HDF5 files, SQL databases, data on remote machines, and the Hadoop File System.
Questions tagged [odo]
38 questions
7
votes
2 answers
Where is the pydata BLAZE project heading?
I find the blaze ecosystem* amazing because it covers most of the data engineering use cases. There was definitely a lot of interest on these projects during the period 2015-2016, but of late it has been ignored. I say this looking at the commits on…

human
- 2,250
- 20
- 24
5
votes
3 answers
python odo sql AssertionError: datashape must be Record type, got 0 * {...}
I'm trying to import a CSV into MySQL using odo but am getting a datashape error.
My understanding is that datashape takes the format:
var * {
column: type
...
}
where var means a variable number of rows. I'm getting the following…

jeff
- 51
- 2
4
votes
1 answer
access data in sharded JSON files on S3 from Blaze
I am trying to access line delimited JSON data on S3.
From my understanding of the docs I should be able to do something like
print data(S3(Chunks(JSONLines))('s3://KEY:SECRET@bucket/dir/part-*.json').peek()
which throws
BotoClientError:…

Daniel Mahler
- 7,653
- 5
- 51
- 90
3
votes
1 answer
Loading CSV to MySQL with odo and SQLAlchemy
I'm using odo to write a CSV file to a MySQL table.
uri = 'mysql+pymysql://username:password@database/schema::table'
odo('data.csv', uri)
When I do not specify a datashape, the MySQL table gets created with all string columns as TEXT and all…

Raddfood
- 169
- 2
- 4
- 17
3
votes
0 answers
CSV to Oracle via Odo and SQL Alchemy
I have this code that sends CSVs to Oracle but it's slower than molasses in January. I'd like to use odo but the documentation is scarce for this exact type of situation (data from CSV to Oracle). I'm not married to Pandas, so if it's better to not…

Dance Party2
- 7,214
- 17
- 59
- 106
2
votes
1 answer
odo Function has keyword only parameters or annotations
The following command:
from odo import odo
odo(target='postgresql://{user}:{pass}@localhost/{server}::odo_dest_table',source='/home/username/Downloads/large_csv.csv')
Produces the following error:
File…

jason m
- 6,519
- 20
- 69
- 122
2
votes
1 answer
Replace Menu in website using Xpath
I want to use Xpath to replace my website menu of odoo 8.
I don't want to replace all the header, but only one element in the menu : The shop
When i inspect the element li , i see this :

user3718532
- 21
- 4
2
votes
0 answers
blaze-odo error when trying to export an odo result to csv with MSSQL backend
I'm having an issue exporting some data from a MSSQL back-end to csv using blaze and odo.
The first thing that I do is create a blaze.data object that connects to the MSSQL db using a dns connection and pyodbc as the driver.
adjustment_statuses is a…

jgens
- 21
- 2
2
votes
1 answer
Python odo CSV to SQL - No such file or directory
I'm trying to upload files to a PostgreSQL database from my local computer, the error I get is:
sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) could not open file "C:\Mar-2015.csv" for reading: No such file or directory
The command…

QuinRiva
- 679
- 1
- 7
- 14
2
votes
1 answer
odo converting data between csv and mysql
When converting one of the .csv's to a pd.DataFrame using the python odo module I receive a TypeError
TypeError: Cannot cast array from dtype('float64') to dtype('int64')
according to the rule 'safe'
The code that works for…

Itay Livni
- 2,143
- 24
- 38
2
votes
0 answers
Migrating pandas dataframe from local computer using odo
Loading a pandas dataframe into postgres using odo does not work.
I first use SQLalchemy to create a table object. The name of the table on my local postgres instance is testaccounts.
meta = MetaData(bind=engine)
table = Table('testaccounts', meta,…

Lucas Neo
- 53
- 6
1
vote
1 answer
DeprecationWarning: The longpolling-port is a deprecated alias to the gevent-port option, please use the latter
Odoo version 16.0
Python version 3.10
While running service it gives below warning in terminal
odoo-16.0/odoo/tools/config.py:565
DeprecationWarning: The longpolling-port is a deprecated alias to the gevent-port option, please use the latter
How to…

shashank verma
- 303
- 1
- 3
- 9
1
vote
0 answers
Exporting MySQL table to CSV using Blaze ODO library?
I am trying to export tables from My SQL to CSV using odo library
the code is:
src =f'mysql+pymysql://{MYSQL_READER_USERNAME}:%s@{MYSQL_READER_HOST}/{MYSQL_DB_NAME}' % urllib.parse.quote(f'{MYSQL_READER_PASSWORD}')
csv =…

Asad Khalil
- 45
- 1
- 10
1
vote
0 answers
TypeError: Cannot interpret 'CategoricalDtype(categories=['no', 'yes'], ordered=False)' as a data type
I just upgraded all my python libraries, and now my previous code is started to fail.
I'm using blaze with pandas. Here is my method code
blaze.data(res)
res contains below data
col1 age ... …

suresh goud
- 367
- 1
- 3
- 19
1
vote
0 answers
How to use python odo to update records in database?
Is the python odo function able to UPDATE records in a database table - or can it only INSERT? I've inherited a python script that uses odo for inserting records into a database table. I need to update a Value column in each record, but as it is…

okorng
- 149
- 1
- 18