Questions tagged [sdmx]

Statistical Data and Metadata eXchange

Official site: https://sdmx.org/

Tools

Listed on official site: https://sdmx.org/?page_id=4500

Listed on GitHub: https://github.com/search?utf8=%E2%9C%93&q=sdmx

46 questions
6
votes
3 answers

Reading sdmx-xml files into a dataframe in R

I was wondering if anyone has managed to read SDMX-XML files into a dataframe. The file I’d like to read is https://www.ecb.europa.eu/stats/sdmx/icpf/1/data/pension_funds.xml (1mb). I saved the file as “pensions_funds.xml” to the pwd and tried to…
Aidan
  • 109
  • 1
  • 7
5
votes
3 answers

pandas data mining from Eurostat

I'm starting a work to analyse data from Stats Institutions like Eurostat using python, and so pandas. I found out there are two methods to get data from Eurostat. pandas_datareader: it seems very easy to use but I found some problems to get some…
SPS
  • 465
  • 9
  • 23
4
votes
2 answers

Australian Bureau of Statistics SDMX timeout issue

I'm trying to download Australian Bureau of Statistics data using pandasdmx. I can download the ERP_COB using SDMX no problem but for ERP by SA2, age and sex I am getting a timeout error. I have limited the time period to 2018 only but am still…
4
votes
2 answers

Statistical Data and Metadata eXchange (SDMX)

I stuck myself in SDMX, Since i am not found enough resources to study(programming code) about SDMX. Like:- Creating structure Reading Structure Writing data .. etc Yes there are some guideline in its personal website,But those are not enough…
Kanhu Bhol
  • 450
  • 3
  • 20
2
votes
1 answer

Get currency of today from ECB - pandassdmx?

I need to get the latest currency rates from ECB for USD/EUR and CHF/EUR. What is the recommended method? Version 1: Tried pandasdmx but do not know the most efficient way to extract the value: ecb = sdmx.Request("ECB") parameters = { …
S.Benz
  • 33
  • 4
2
votes
1 answer

Plotting SDMX with PANDAS or plot

What's the easiest way to plot SDMX data with PANDAS or Plotly? I have the following code: import pandasdmx as sdmx import plotly.express as px df = sdmx.Request('OECD').data( resource_id='MEI_FIN', key='IR3TIB.GBR+USA.M', …
nonamednono
  • 49
  • 1
  • 4
2
votes
2 answers

Most efficient way of converting RESTful output to dataframe

I have output from a REST call that I've converted to JSON. It's a highly nested collection of dicts and lists, but I'm eventually able to convert it to dataframe as follows: import panads as pd from requests import get url =…
Chris
  • 1,401
  • 4
  • 17
  • 28
2
votes
1 answer

Does .Stat Suite support SDMX version 2.1

FAQ page says https://siscc.org/faq/ The .Stat Suite is a native SDMX solution, supporting a complete end to end flow. It can consume, manage, and export SDMX 2.1 in SDMX-JSON, SDMX-ML, and SDMX-CSV formats. While checking some of the latest…
demonno
  • 524
  • 5
  • 14
2
votes
0 answers

Using Python / pandaSDMX to process & upload to Postgresql

I am seeking a way to take SDMX files (like here: http://www12.statcan.gc.ca/datasets/Alternative.cfm?PID=105929&EXT=SDMX) and process them into a Postgresql table. I can use rsdmx (https://cran.r-project.org/web/packages/rsdmx/index.html) for…
Gordon
  • 21
  • 1
2
votes
1 answer

Encoding lost when reading XML in R

I am retrieving online XML data using the XML R packages. My issue is that the UTF-8 encoding is lost during the call to xmlToList : for instance, 'é' are replaced by 'é'. This happens during the XML parsing. Here is a code snippet, with an…
jlesuffleur
  • 1,113
  • 1
  • 7
  • 19
2
votes
1 answer

Error importing SDMX data into R

The problem happens when I am trying to import OECD data. For example, if I try the following code: library(rsdmx) data.url <-…
Gustavo
  • 53
  • 3
2
votes
2 answers

Reading SDMX in R - parse error?

I've been trying to develop a shiny app in R with INEGI (mexican statistics agency) data through their recently initiated SDMX service. I went as far a contacting the developers themselves and they gave me the following, unworkable, code:…
eflores89
  • 339
  • 2
  • 10
  • 27
1
vote
2 answers

Downloading and reading XML SSDMX/ZIP file into R

I am in very unfamiliar terrain with downloading this file set from the Federal Reserve's website (I was hoping for an API but it doesn't appear to exist). I am not sure what this Fed link format really is and how I would read the data into R. I…
DaveM
  • 664
  • 6
  • 19
1
vote
1 answer

Loop URL in SDMX format and combine the result into R dataframe

I'm trying to download World Bank's WITS data and convert them into R dataframe. The site's API (ref. pp. 12-13) does not seem to allow users to call all "reporters," "partners," and "products" at once, so one may need to loop through a list of…
Chris T.
  • 1,699
  • 7
  • 23
  • 45
1
vote
1 answer

Create an SDMX file in R

I do not have any code to post, but just a question. There are several tools I am aware of to read SDMX files in R (an SDMX is an XML file for exchanging statistical data) like for…
larry77
  • 1,309
  • 14
  • 29
1
2 3 4