PROSTORSKI ETL ZA BOLJŠO MEDOPRAVILNOST V GIS
SPATIAL ETL TOOL FOR BETTER INTEROPERABILITY IN GIS

Katja Šušteršič, Tomaž Podobnikar

DOI: 10.15292/geodetski-vestnik.2013.04.719-733

 

Izvleček:

V prispevku predstavimo prostorsko ETL-orodje, ki omogoča medopravilnost prostorskih in neprostorskih podatkov. Skovanka prostorsko ETL-orodje kaže, da orodje omogoča uporabnikom obdelavo in preoblikovanje prostorskih podatkov med podatkovnimi formati. Kratica ETL (angl. extract, transform, load) se nanaša na aktivnost izbora, preoblikovanja in nalaganja podatkov. Uporaba prostorskih podatkov je postala del vsakdanjika, vendar lahko le s pravilno uporabo dosežemo pravo vrednost, ki jo lahko ponudijo uporabnikom. Namen prispevka je predstavitev sposobnosti in uporabnosti prostorskega ETL-orodja, podrobnejša opredelitev ETL-postopka, seznanitev s prostorskim ETL-orodjem FME Desktop ter predstavitev uporabnosti na dveh primerih. V prvem primeru smo vzpostavili poenoteno podatkovno skladišče iz nehomogenih skladišč za ugotovitev vpliva geološke podlage na poškodovanost stavb pri potresu leta 2004. V drugem primeru smo opisali obveščanje lokalnih prebivalcev o predvidenih spremembah v
prostoru. S tem smo potrdili fleksibilnost orodja pri urejanju in analizi prostorskih podatkov ter pokazali, da je prostorski ETL primeren za hitrejše in učinkovitejše rešitve pri delu s podatki.

Ključne besede: prostorski ETL, medopravilnost, ETL, FME Desktop, uporabnost prostorskega ETL-orodja

 

Abstract:

A spatial ETL tool that allows interoperability between spatial and non-spatial data is presented in this article. The primary goal of the tool is to provide spatial data processing and transformation among various data formats. This is made possible by the ETL process, which extracts, transforms and loads data. The use of spatial data has become significant in everyday life, because only correctly applying the data enables users to extract the true value spatial data offers. The main purpose of this article is to demonstrate the capability and usability of the spatial ETL tool, in order to introduce a more detailed definition of the ETL process to acquaint the reader with the FME Desktop tool, and to demonstrate the applicability of the tool in two case studies. In the first case, a unified spatial data warehouse is built from non-homogeneous data warehouses in order to assess the impacts and effects the geological basis had on the amount of damage to buildings in the 2004 earthquake. The second case
demonstrates how the spatial ETL tool can be used to inform locals of predicted spatial changes in the area. The flexibility and the efficiency of the spatial ETL tool are successfully demonstrated in both cases; ETL turns out to be a robust tool for editing and analysing data.

Keywords: spatial ETL, interoperability, ETL, FME Desktop, serviceability of spatial ETL tool

 

Literatura / References:

Cragg, R. (2009a). ArcGIS Data Interoperability Basics. Safe Software. Vancouver. Kanada.

Cragg, R. (2009b). Data Transformation with ArcGIS Data Interoperability Spatial ETL Tools. Safe Software. Vancouver. Kanada.

Cunningham, B. (2009). Using FME to Drive a Location-Based Email / Cell Phone Notification Service. FME International user conference. Whistler. Kanada.

ESRI (2012). ArcGIS Data Interoperability Exstensions. http://www.esri.com/software/arcgis/extensions/datainteroperability/key-features/spatial-etl (16. 8. 2012).

FMEinsider (2013). FME 2013 Has Landed. http://www.safe.com/about/newsletter/2013/Winter/founders-perspectivemissions-mars-and-fme-2013/ (10. 2. 2013).

FMEpedia (2012). FME Desktop Documentation. http://fmepedia.safe.com/knowledgeDocumentation (12. 6. 2012).

GeoKettle (2013). A powerful open sourcespatial ETL tool. http://www.spatialytics.org/projects/geokettle/ (12. 8. 2013).

GeoServer (2013). GeoServer. http://geoserver.org/display/GEOS/What+is+Geoserver (12. 8. 2913).

Intergraph (2013a). Geospatial Intergraph. http://geospatial.intergraph.com/2013-release.aspx (12. 8. 2913).

Intergraph (2013b). Intergraph History. http://www.intergraph.com/about_us/history_2000s.aspx (12. 8. 2913).

Kimball, R., Caserta, J. (2004). The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data. New York, Wiley Publishing, 161–170.

Kralj, P. (2010). Realizacija sistema poslovnega obveščanja v CPK d. d. Magistrsko delo. Ljubljana, Univerza v Ljubljani, Fakulteta za računalništvo in informatiko.

MapAlerter (2013). Aplikacija MapAlerter. http://www.mapalerter.com/ (27. 2. 2013).

Marti, R. (2011). Data Warehouse ETL – Processing. http://archive.systems.ethz.ch/www.systems.ethz.ch/education/fs11/data-wareh/slides/04-1%20DWh%20Data%20Warehouse%20-%20ETL.pdf (7. 9. 2013).

Murray, D. (2008). The growing Need for Spatial ETL. GeoInformatics. http://www.geoinformatics.com/blog/onlinearticles/the-growing-need-for-spatial-etl (26. 11. 2012).

Ribičič, M., Vidrih, R., Godec, M. (2000). Seizmološki in geotehničini pogoji gradnje v zgornjem Posočju. Geologija 43(1), 115–143.

Safe Software (2013). Solutions for applications. http://www.safe.com/solutions/for-applications/ (12. 8. 2013).

Safe Software (2012). Spatial ETL. http://www.safe.com/ (11. 6. 2012).

Safe Software (2010). Spatial ETL. Making Data Accessible.Whitepaper.

Spatial Data Integrator (2013). Open source spatial ETL. http://www.docstoc.com/docs/27391255/Spatial-Data-Integrator-powered-by (23. 2. 2013).

Talend (2013). Spatial extension for Talend. http://talend-spatial.github.io/ (12. 8. 2013).

The FME Evangelist (2013). Using FME to Drive a Location-Based Email / Cell Phone Notification Service: Brendan Cunningham, Kilkenny County Council. http://evangelism.safe.com/fmeevangelist34/ (9. 3. 2013).

Standard SIST EN ISO 19113:2002 GI – kakovostna načela (Quality principles).

Standard SIST EN ISO 19114:2003 GI – postopki za ocenjevanje kakovosti (Quality evaluation procedures).

Standard SIST EN ISO 19119:2005 GI – servisi (Services).

Šušteršič, K. (2012). Vzpostavitev prostorskega podatkovnega skladišča na primeru občine Bovec za potres 2004. Diplomsko delo. Ljubljana, Univerza v Ljubljani, Fakulteta za gradbeništvo in geodezijo, 58 str.

Wikipedia (2013). Interoperability. http://en.wikipedia.org/wiki/Interoperability (14. 8. 2013).

Žefran, E. (2009). Zagotavljanje kakovosti informacij pri podatkovnem skladiščenju. Diplomsko delo. Ljubljana, Univerza v Ljubljani, Ekonomska fakulteta (samozaložba E. Žefran), str. 5.

Östman, A., Abugessaisa, I., Tanyilli, S., He, X., El-Mekawy, M. (2009). GeoTest: A Testing Environment for Swedish Geodata. Gävle. Švedska.