| Table of Contents |
|---|
| Tip |
|---|
This section will be enriched on base of received questions, to be submitted through the Eurostat user support. |
Guides
Some information would not fit in the short Q&A section below, a dedicated page is proposed for the following topics:
| Children Display |
|---|
Questions and answers
How can I get information about the structural metadata?
...
Why does SDMX API reject my data query with 400 error code
HTTP 400 Bad Request is a generic error status to inform that the requested URL could not be processed by the server. It can happens in several cases
Case 1 : Invalid request
Network appliance receiving HTTP requests may reject them with the following information
Main case is when a URL would exceed the character size limit supported by the network appliance.
A simple example is when building an explicit query for a NUTS3 regional datas for API statistics, the URL would contains a lot of &geo= parameters
In most case, it would be recommended to leave such dimension unfiltered in the query URL and filter the received data or use the dedicated geoLevel parameter in this particular example:
https://ec.europa.eu/eurostat/api/dissemination/statistics/1.0/data/DEMO_R_GIND3?format=JSON&lang=en&freq=A&indic_de=JAN&time=2018&time=2019&time=2020&time=2021&time=2022 Case 2: Invalid query
SDMX API REST URLs are validated that they contain dimension codes and position codes actually declared in the dataset definition. In other words validation ensures that the codes present in the query are present in the SDMX Constraint of the dataset.
...
The SDMX Constraint can be retrieved to allow client side query validation. The SDMX Contraint of the sample dataset can be It can be retrieved from the SDMX API as follow :
https://ec.europa.eu/eurostat/api/dissemination/sdmx/2.1/contentconstraint/ESTAT/ISOC_CI_ID_H
Why does TSV data file contains extra whitespace ?
As dataset may contains attributes flags attached to an observation value, the TSV format is adding them next to the value separated by.
In case of data results without such flags, these extra spaces could look like as unnecessary but they always be present to ensure format consistency.
In below example, space are visible as a dot and tabulation as an arrow.
The space is present in all data columns to ensure generic processing, for example separating by both tabulation and whitespace will result in having the attributes in an extra column next to the value.
Please consult the format description page for more details : API - FAQ - TSV data format
Why does SDMX API reject my data query with lastNObservations with EXTRACTION_TOO_BIG error code
To better understand why this specific query is rejected as being too costly to perform is because the lastNObservation cannot help in reducing the overall cost of the data extraction.
From SDMX API definition, lastNObservation means "The maximum number of observations to be returned for each of the matching series, counting back from the most recent observation."
as this is the only parameter, no data filtering is done, so the full data need to be extracted and then scanned to confirm a observation value is available or not.
One possibility to actually reduce the data extraction is to express a filter on the time dimension to only search in recent year values
https://ec.europa.eu/eurostat/api/dissemination/sdmx/3.0/data/dataflow/ESTAT/STS_INPR_M/1.0?compress=false&format=TSV&lastNObservations=1&c[TIME_PERIOD]=ge:2024
Please note that first call to this may receive an asynchronous statement, waiting a few minutes and recalling the same URL should be enough under normal operation of the API.
We can see in the resulting data several time columns (2024-3 being the most recent one) that where scanned for data.
If the user is in fact interested only in the most recent time position, sadly there is no direct SDMX data query to represent this.
It must be done in 2 different queries :
1. retrieve the data constraints of the dataset: https://ec.europa.eu/eurostat/api/dissemination/sdmx/3.0/structure/dataconstraint/ESTAT/STS_INPR_M?compress=false
2. lookup the last value of the TIME_PERIOD dimension and use it in the data query below
3. retrieve data for this specific time position https://ec.europa.eu/eurostat/api/dissemination/sdmx/3.0/data/dataflow/ESTAT/STS_INPR_M/1.0?compress=false&format=TSV&c[TIME_PERIOD]=eq:2024-03