UN Comtrade United Nations Commodity Trade Statistics Database

1. UN ComtradeUnited Nations Commodity Trade Statistics Database Markie Muryawan Statistician Trade Statistics Branch United Nations Statistics Division Email: markie@un.org Tel: +1-212-963-0692 United Nations Statistics Division

2. Importance of trade data (1) United Nations Statistics Division

3. Importance of trade data (2) China is now the biggest ICT Goods Exporter United Nations Statistics Division

4. International Merchandise Trade Statistics Database Maintained by UN Statistics Division / Trade Statistics Branch Inside UN Comtrade database: Imports, Exports, Re-exports, Re-imports Commodity by Trading Partner Annual data (since 1962) Value in US dollars Net weight and secondary quantities Over 150 reporters per year (>95% of the World Trade) Received 2005 prestigious UN 21 Awards in the category of Knowledge Management What is UN Comtrade? United Nations Statistics Division

5. Key elements • Dimension • Classifications and Commodity Codes • Harmonized System (HS) • SITC • BEC • Reporter country • Partner country • Trade Flow • Year • Measure / indicator • Net weight • Supplementary quantity unit • value United Nations Statistics Division

6. Main trade data source • UN Comtrade is the largest database of annual commodity trade statistics • On average, more than 2 billion records downloaded every month • Newly published data synchronized with other international organizations such as World Bank, ECLAC, OECD, ITC, etc via web service Free Site License trial subscription(please contact comtrade@un.org) United Nations Statistics Division

7. Data collection & processing United Nations Statistics Division

8. Cooperation with OECD Joint UN/OECD Data Collection and Processing System (CoprA) • Joint collection = Reduced response burden • Joint standards = Increased Quality • Joint processing = Full harmonization of data United Nations Statistics Division

9. Official annual request sent in February to national institution responsible for dissemination of trade statistics: Almost all data come from custom declarations, with an addition of postal services, oil ministry, electricity, sales/lease of aircraft/ship, etc About 80% data sent from National Statistical Offices and 20% sent from statistics unit in Custom Administration Most of reporters report data in more than 6 digit HS Most countries report in electronic format (via CD, FTP or email attachment) by June (for major countries), large chunk of data reported between March and June Since 2001, UN and OECD decided to collect data jointly: OECD collects OECD countries and shares them with UN. This cooperation aims to eliminate redundancy in data collection. In the beginning 2006, OECD and UN released joint data processing system, named CoprA. Reported data format must be refitted into standard format (see Key Element slide). This pre-processing task consumes a lot of time compare to processing itself (see next slide) SDMX format is intended to reduce pre-processing time and minimize error in transforming data format Collection United Nations Statistics Division

10. Joint UN/OECD Processing System, CoprA (2006) Main Processing Flows: Data format standardization Convert into US$ Codes Normalization Data Aggregation Quantity Estimation Data Checking Data Conversion Publish to UN Comtrade During processing, data is duplicated and stored original, tariff line, complete and final data for publication Processing – UN/OECD CoprA Processing flows controlled by system United Nations Statistics Division

11. Original format is non-text or non-database Such as PDF or printed publication How to handle confidential/higher level data Estimating and Checking quantities Missing quantity units / net weight Outliers of unit value Different quantity units with WCO Non HS or high level HS (< 6 digit) reported Incomplete partners/commodities breakdown To make sure data is correct and make sense Lead to Delay in releasing data and/or lower data quality Challenges in processing Unit Value rejected due to standard unit value United Nations Statistics Division

12. General rule Based on country definition of custom territories (legality) CoprA processing system transforms detailed partner into UN Comtrade countries & areas For an example: US data includes US Virgin Islands and Puerto Rico, thus, any data referring US VI and PR as partners will be lumped together with US China Hong Kong SAR (344), China Macao SAR (446) and China (156) are two separate areas in UN Comtrade. They also declares trade to each others. Countries & Areas (1) Before 1981 USA was 841 (incl. PR) Since 1981 USA is 842 (incl. PR and USVI) United Nations Statistics Division

13. Areas France (France, French Guiana, Guadeloupe, Martinique, Monaco, Réunion) Italy (Holy See, Italy, San Marino) Norway (Norway, Svalbard and Jan Mayen Islands) USA (Puerto Rico, United States, US Virgin Isds) Switzerland (Liechtenstein, Switzerland) Serbia and Montenegro (Kosovo, Montenegro, Serbia) Any major splits or joints, new country code may be assigned For an example: separate codes for Kosovo, Montenegro, Serbia Countries & Areas (2) United Nations Statistics Division

14. Data availability United Nations Statistics Division

15. There are 5221 country-period datasets from 1962-now, 1.1 billion records, and 224 countries/areas as reporters (as of Jan 2007) Data availability is accessible via “Data Availability menu”, RSS and web services (http://comtrade.un.org/kb/article.aspx?id=10089) Tariff Line data (detailed national level commodity codes) is not available for public use except in a project between international organizations and universities General Data Availability United Nations Statistics Division

16. Every user must take into account “not yet available reporters” Will have impact on calculation of country groups Not-yet-available reporters are shown in the front page 54% of countries represent 96% of world trade (based on mbs country tables) Normally, by June, almost all major countries have reported their data It is updated as soon as data comes in Not yet available reporters United Nations Statistics Division

17. HS2007 & SITC Rev.4 United Nations Statistics Division

18. Addition of HS2007 will increase UN Comtrade commodity classifications from 7 to 9 User must understand impact of break in time series HS-2007 will be the starting point of the classification conversion linking to earlier HS and SITC, and to CPC, ISIC, and BEC Correlation between SITC Rev.4 and HS 2007 is available on UN Comtrade web sites HS 2007 & SITC Rev.4 • Time Series Continuation • HS-2007 appearing code 0105.94 • HS-2002 disappearing codes 0105.92 and 0105.93 • 0105.92 = Chicken < 2 Kg • 0105.93 = Chicken > 2 Kg • 0105.94 = 0105.92 + 0105.93 • Which code to choose for Time Series continuation in HS-2002 as of 2007 ? United Nations Statistics Division

19. UN Comtrade Portal United Nations Statistics Division

20. UN Comtrade Portal Pagecomtrade.un.org United Nations Statistics Division

21. Database Contains the largest trade statistics database Publication Online version of International Trade Yearbook Web Services Facilitate automated large data transfer Knowledge base Guidelines, User Manuals, Reference Tables, Metadata, FAQ, Methodology, How-To, etc. Any knowledge related to trade statistics Community Forum Peer-to-peer support. Discuss anything from incorrect quantities to SDMX. Expert Forum Restricted membership, by invitation only. To discuss various issues regarding IMTS and supporting tools. UN Comtrade Sites United Nations Statistics Division

22. Do-it-your-self extraction Comtrade Explorer (text search) Shortcut Query Express Selection Basic Selection Via data availability Via web services Download up to 20 million records per query via batch submission Special data extraction is not offered anymore Data Extraction Selecting commodity classification is crucial for historical time series United Nations Statistics Division

23. Express Selection Auto convert from text to code More features than Basic Selection Expert User Text sensitive search of commodities and countries EXAMPLE Possibility to execute data requests off-line United Nations Statistics Division

24. Comtrade Explorer “Google like” search Data results in table and graph Modification in Basic or Express Selection For data mining and overviews EXAMPLE Data availability of search result shown in Tag Cloud United Nations Statistics Division

25. Summary of data request EXAMPLE View Map Germany = main exporter of cars over the last 4 years United Nations Statistics Division

26. Map shows World Exports of motor vehicles : Germany and Japan are leaders United Nations Statistics Division

27. Data Availability • Interactive • In Graph • Reporters • Commodities • Years • By Date of LoadingRSS United Nations Statistics Division

28. Data Availability by Reporter Click to get all data Drill down possibility Modify with Express Selection EXAMPLE Commodity Classification Years available Iceland = Reporting Country United Nations Statistics Division

29. Data Availability by Year Overview per year and classification Click to get all data Drill down possibility Modify with Express Selection EXAMPLE All the Reporters available for Year = 2005 Classification = HS-2002 United Nations Statistics Division

30. Direct Download Max. 150,000 records to CSV output file Instant extraction. Uncompressed file. Batch Download Max. 20,000,000 records to CSV output file Background extraction. Compressed file Notification of completion via e-mail. Output format can be customized Data Download For Subscribers, not for Guest User United Nations Statistics Division

31. Personalization For Subscribers, not for Guest User • Favorites • Saved Queries • FrontPage • Download Format • Automated Data Extraction • E-mail alerts United Nations Statistics Division

32. Favorites For Subscribers, not for Guest User • Country Groups (as reporter or partner) • Such as EU25, ASEAN • During data extraction, it is considered as one country • Commodity Groups Commodities • Such as ICT products, Fuel, etc • During data extraction, it is considered as one commodity • Reporters • Partners • Years United Nations Statistics Division

33. Commodity List HS, SITC, Data Availability and Snapshot Countries List Data Availability, Snapshot, National Practices and ITC Country Profile Glossary Also refer to Knowledge Base which contains all detailed terminology used in UN Comtrade Suggested Articles Link to knowledge base with page sensitive articles Metadata & Reference United Nations Statistics Division

34. Summary United Nations Statistics Division

35. http://comtrade.un.org/db/help/SubscriptionPrices.aspx Not for Profit Rate is 25% of Commercial Rate Additional discounts for libraries from certain countries Extra discount for UN Depository Libraries or library in the consortiums Best deal for library: Site Licence (including 5 individual users) Please contact subscriptions@un.org for further information Pricing Policy for libraries United Nations Statistics Division

36. Methodology - Supplement to the Compilers Manual Part I: Questionnaire on National Compilation and Reporting Practices Part II: Special topics Singling out areas of increasing importance (Export Processing Zones/ Customs unions/ Affiliated trade/ Business Surveys) Database on National Compilation and Reporting Practices New trade statistics yearbook, additional online publication Writing IMTS, Rev.3 (2010) UN Comtrade Adding World and Region Totals On going interface improvement Improvement on web services (SDMX version 2.0) Adding classification in different languages Better revision control Future work United Nations Statistics Division

37. Over 1 billion annual merchandise trade data, consists of detailed (6 digit) commodity with more than 209 countries & areas Coverage of reporting countries not available anywhere else Data extraction and Data mining Personalization of your requirements From 1962 until now, perfect for studying historical series Site License: institute-wide access and unlimited download UN Comtrade portal provides complete sets of tools: data extraction, comprehensive help and support and collaboration tools. Single point of contact: comtrade@un.org Summary United Nations Statistics Division

38. Thank you for your attentionPlease visit UN Comtrade at booth 1337 United Nations Statistics Division

39. Database Contains the largest trade statistics database Publication Online version of International Trade Yearbook Web Services Facilitate automated large data transfer Knowledge base Guidelines, User Manuals, Reference Tables, Metadata, FAQ, Methodology, How-To, etc. Any knowledge related to trade statistics Community Forum Peer-to-peer support. Discuss anything from incorrect quantities to SDMX. Expert Forum Restricted membership, by invitation only. To discuss various issues regarding IMTS and supporting tools. UN Comtrade Sites (@ booth 1337) United Nations Statistics Division