2. Overview
Work flow
Codification: CPC
Codifications: HS
Codifications: UM
Codifications: Flags
Codifications: GAUL
Codifications: CountrySTAT indicators
Codifications: Attributes
Preparing tables in CountrySTAT
Uploading tables in CountrySTAT
Metadata Editor
DSD Editor
Data Editor
Important rules for creating tables
Retrieving tables in CountrySTAT
Editing an already uploaded dataset
3. • Have the data ready
07/12/2016 3
Work flow
• Create your
table following
the rules
• Have the
metadata ready
• Use the right
codification
• Fill all
metadata
• Create the
DSD structure
• CVS format
• No columns with
labels
• Upload the
values
• CPC 2.1
• HS
• GAUL
• CountrySTAT indicators
• Attributes
• Unit of Measurement
• Flag
• Go to the
metadata
editor
• Title
• Subject
• Data type
• Domain
• Key
Your table
is
published
4. Codifications
CPC 2.1
For goods and services
HS
For trade data
UM
Unit of measurement
Flags
To indicate missing and
estimated values
GAUL
For geo data
CountrySTAT indicators
For all indicators
Attributes
Characteristics of the indicators
5. • The Central Product Classification (CPC) constitutes a
complete product classification covering all goods and
services based on a set of internationally agreed
concepts, definitions, principles and classification rules
• It provides a comprehensive framework within which
data on products can be collected and presented in a
format that allows for economic analysis supporting
decision-taking and policy-making
07/12/2016 5
Codification: CPC
6. The current version, CPC version 2.1, is the result of a scheduled
review of the CPC structure and detail, in order to ensure the
classification’s relevance for describing current products in the
economy.
All detailed structure and explanatory notes can be found at the
following link (CPC 2.1 not expanded version):
http://unstats.un.org/unsd/cr/registry/regcst.
asp?Cl=31
Codification: CPC
Here all the available correspondences:
http://unstats.un.org/unsd/cr/registry/regot.asp?Lg=1
12. The Harmonized Commodity Description and Coding System
generally referred to as "Harmonized System" or simply "HS" is a
multipurpose international product nomenclature developed by the
World Customs Organization (WCO).
The Harmonized Commodity Description and Coding System (HS) is
an exhaustive nomenclature of internationally traded commodities
(goods) classified according to the following criteria:
– raw or basic material
– degree of processing
– use or function
– economic activities
07/12/2016 12
Codifications: HS
13. Codifications: UM
0101 head
0102 Ha
0103 ton
0104 US$
0105 local currency
0106 index
0107 thousands
0108 units
0109 cubic meter
0110 kg/capita/yr
0111 Kcal/capita/day
0112 g/capita/day
0113 1000 US$
0114 Liter
0115 Cubic meter/second
0116 Centimeter
0117 local currency by ton
0118 Degree Celsius
0119 Percentage
0120 MT or Cubic meter
0121 Local currency/hectar
0122
Local currency/1 cubic
meter
0123 Kg/Ha
0124 Local currency/Kg
0125 1000 Ha
0126 mm
0127 Square meter
14. Codifications: FLAGS
FLAGS
• Category not applicable / Data not available = “m”
Data for these categories do not even hypothetically exist and/or data included
in another category / Missing data (data exist but were not collected)
• Estimated value = “e”
15. Codifications: GAUL
The Global Administrative Unit Layers (GAUL) is an initiative implemented by FAO
within the Bill & Melinda Gates Foundation, Agricultural Market Information
System (AMIS) and AfricaFertilizer.org projects.
The GAUL compiles and disseminates the best available information on
administrative units for all the countries in the world, providing a contribution to
the standardization of the spatial dataset representing administrative units. The
GAUL always maintains global layers with a unified coding system at country, first
(e.g. departments) and second administrative levels (e.g. districts). Where data is
available, it provides layers on a country by country basis down to third, fourth
and lowers levels
16. Codifications: GAUL
The overall methodology consists in
a) collecting the best available data from most reliable sources
b) establishing validation periods of the geographic features (when possible)
c) adding selected data to the global layer based on the last country
boundaries map provided by the UN Cartographic Unit (UNCS)
d) generating codes using GAUL Coding System
e) distribute data to the users
17. Codifications: GAUL
Because GAUL works at global level, unsettled territories are reported. The
approach of GAUL is to deal with these areas in such a way to preserve national
integrity for all disputing countries .
GAUL is released once a year and the target beneficiary of GAUL data is the UN
community and other authorized international and national partners. Data
might not be officially validated by authoritative national sources and cannot be
distributed to the general public. A disclaimer should always accompany any use
of GAUL data.
GAUL keeps track of administrative units that has been changed, added or
dismissed in the past for political causes. Changes implemented in different
years are recorded in GAUL on different layers. For this reason the GAUL product
is not a single layer but a group of layers, named "GAUL Set" .
18. Codifications: GAUL
ADM0_NAME ADM1_CODE ADM1_NAME
Kenya 51325 Central
Kenya 51326 Coast
Kenya 51327 Eastern
Kenya 51328 Nairobi
Kenya 51329 North Eastern
Kenya 51330 Nyanza
Kenya 51331 Rift Valley
Kenya 51332 Western
19. Codifications: CountrySTAT indicators
Domain code indicator
Production
0101 Production quantity
0102 Production value
0103 Yield
0104 Area Harvested
0105 Area sown
0106 Seeds quantity
0107 Slaughtered animals
0108 Live animals
0109 Laying hens
0110 Lactating live animals
Food availability
0201 Protein quantity
0202 Lipid quantity
0203 Food supply quantity
Trade
0301 Export quantity
0302 Export value
0303 Import quantity
0304 Import value
0305 Consumption quantity
0306 Re-export quantity
0307 Re-export value
Machinery 0401 Machines in service
Population
0501 Population
0502
Economically active
population
0503 Population total density
0504 Population growth Rate
Prices
0601 Consumer price
0602 Producer price
0603 Commercial rate
0604 Official rate
Value added
0701 Constant prices
0702 Current prices
Land use
0801 Agricultural area
0802 Permanent crops area
0803 Temporary crops area
0804
Arable land and permanent
crops area
0805 Forest area
0806 Other wooded land
Employment
0901 Unemployment Rate
0902 Labourforce Participation Rate
Water 1001 Average rainfall
20. Codifications: Attributes
code dimensions
8001 Total
8002 Male
8003 Female
Food
code dimensions
8004 Rural
8005 Urban
8006 Total
code dimensions
8007 Food
8008 Non Food
code dimensions
8009 Rainfed
8010 Irrigated
Residence
Gender
Field
management
code dimensions
8011 Agricultural
8012 Non-Agricultural
Agricultural
Population
21. Codifications: Attributes – DAC: Sector
DAC 5
CODE
DESCRIPTION
110 EDUCATION
111 Education, level unspecified
112 Basic education
113 Secondary education
114 Post-secondary education
120 HEALTH
121 Health, general
122 Basic health
130 POPULATION POLICIES/PROGRAMMES AND REPRODUCTIVE HEALTH
140 WATER SUPPLY AND SANITATION
150 GOVERNMENT AND CIVIL SOCIETY
151 Government and civil society, general
152 Conflict prevention and resolution, peace and security
160 OTHER SOCIAL INFRASTRUCTURE AND SERVICES
210 TRANSPORT AND STORAGE
230 ENERGY GENERATION AND SUPPLY
240 BANKING AND FINANCIAL SERVICES
250 BUSINESS AND OTHER SERVICES
310 AGRICULTURE+FORESTRY+FISHERY
311 AGRICULTURE
22. Preparing tables in CountrySTAT
Unit of
measurement:
code and label
2° dimension :
code and label
1° dimension : Year
3° dimension :
code and label
Value
Flag
23. Preparing tables in CountrySTAT
Unit of
measurement:
code and label
2° dimension :
code and label
Once done, DELETE ALL LABEL COLUMNS
1° dimension : Year
3° dimension :
code and label
Value
Flag
25. Preparing tables in CountrySTAT
year Indicator (code) species (code) Value Flag um (code)
1990 0102 21115 454 0101
1990 0102 21113 15532 0101
1990 0102 21116 1534 0101
1990 0102 21121 19000000 0101
1990 0102 21111 126318 0101
1991 0102 21111 124281 0101
1991 0102 21115 285 0101
1991 0102 21113 16189 0101
1991 0102 21116 2166 0101
1991 0102 21121 19500000 0101
1992 0102 21116 1107 0101
1992 0102 21113 13155 0101
1992 0102 21111 114086 0101
1992 0102 21121 18000000 0101
1992 0102 21115 297 0101
1993 0102 21113 7000 0101
1993 0102 21115 176 0101
1993 0102 21121 17500000 0101
This is how a table
should look like
after deleting its
label columns!
26. Preparing tables in CountrySTAT
• Save it and keep the Excel table open
• Go in the Metadata Editor
• Go in the DSD Editor
• Save the file in CVS and close it
27. Important rules for creating tables
The Excel spreadsheet must be formatted as text
The name of the Excel file must NOT contain any accent and/or
symbol and/or numbers and/or empty spaces
Always convert to CSV file at the very end and do not open the
CSV file afterwards!
28. Important rules for creating tables
NEVER use comma or dot for separating the thousands
e.g. one thousand: NO 1.000 NO 1,000 YES 1000
Always use a dot for separating decimals
e.g. three dot four: NO 3,4 YES 3.4
In each “value cell” input only a numeric value or only text
e.g. two tons: NO 2 tons YES 2 in the other column
called “unit” write tons
31. METADATA
• Definition: a metadata is a data defining a data.
– Metadata on statistical data (to insure quality of data): units,
source, contact, creation date, last-updated date …
– And additional statistical metadata (methodology,
survey/census, frequency of data collection, etc…)
12/7/2016
32. Metadata example
Raw data without any data :
I don't know the meaning of
the data, I suspect it's the
age of the races.
Data with metadata:
With two metadata, (title –
name of variable), I know the
meaning of the data.
07/12/2016 32
METADATA
33. Metadata Editor
The more fields are filled in, the more accurate the description of data and the
retrieval of the dataset will be.
34. Metadata Editor
Once the previous section has
been filled, by clicking on each
of these elements, new sections
will appear.
These new sections need to be
completed as well.
All these information enhance data quality and end-users’ trust in the related data!
35. Metadata Editor
After every category has
been filled with the right
metadata information,
click on the “save” button
at the top right of the
page, in order to get to
the next phase of the
uploading.
36. DSD Editor
The green boxes in the upper right corner signify that the resource has been created
and metadata has been correctly stored.
The “edit resource” box contains three buttons:
• “Metadata”, which brings back the metadata editor tool.
• “DSD”, to create the DSD structure mirroring the one of your dataset
• “Data”, to upload and modify your dataset
37. DSD Editor
Start adding columns to the DSD structure by clicking on the “+” sign.
The structure should mirror the one of the dataset you wish to upload.
• Dimension refers to time and geo information as well as indicators and commodities
• Value refers to actual numeric or percentage values
• Other refers to flag, unit of measurement columns, etc.
38. DSD Editor
Clicking on the “Dimension +” will
lead to this page in which the
following information can be entered:
• Title, which refers to the column
header’s name
• Supplemental, which refers to
supplemental info regarding that
column data
• Subject, which refers to the type
of data contained in the column
• Data type, which specifies the
type of data chosen in the subject
• Domain, which requires the user
to choose the appropriate codelist
from those available, if needed Once done don’t forget to click
here!
39. Download DSD if you want
to save this DSD structure.
Don't forget to save itOnce all the columns have been entered, it will look
like this!
Next time you’ll just need to
upload it and the DSD will
automatically show up
40. Data editor
Once in the Data editor, the dataset can be uploaded by clicking on “Browse”
Don’t forget that the dataset must be in CSV format
41. Data editor
Once the dataset you wish to upload is selected, a new interface will open. Here you will
have to align the columns of your dataset with the ones you created through the DSD
editor.
To switch two columns just drag and drop the name of any column.
Don’t forget to press the Ok button once everything is ok
43. Retrieving tables in CountrySTAT
Tables’ retrieval is
driven by the metadata
previously stored
during the uploading of
the dataset.
By clicking on the
“Search” button,
datasets can be
retrieved by imposing
metadata fields as
filters.
44. Retrieving tables in CountrySTAT
By clicking on content, the
retrieval of datasets can be
filtered by selecting “Resource
type”, “Reference period” and so
on.
More than one filter can be
selected at once.
45. Retrieving tables in CountrySTAT
The more criteria are imposed the more the dataset’s retrieval will be refined since, by
selecting more than one filter at once, only datasets compliant with every one of
those filters will be shown.
46. Retrieving tables in CountrySTAT
Underneath the selectors, a
“selection resume” will be
displayed showing the selected
filters.
By clicking on “show
result” datasets
compliant with the
chosen criteria will be
displayed.
47. Editing an already uploaded dataset
After successfully retrieving a dataset, by clicking on the “Data” button from the “Edit
Resource” box, the above-mentioned dataset will be shown
48. Editing an already uploaded dataset
• By clicking on the “Pencil” button of any row, a pop-up will be displayed allowing
the chosen row to be modified.
• By clicking on the “Dustbin” button of any row, the chosen row will be removed
from the dataset.
49. Editing an already uploaded dataset
A new row can be added
to the dataset without
uploading it again from
the beginning.
This can be done by
clicking on the “Plus”
button located at the
bottom left of the page
and compiling the newly-
appeared pop-up.
50. Editing an already uploaded dataset
After all the editing has been done, remember to click on the “Save” button on the
top right of the page.