General Strategy for Querying Web Sources in a Data Federation Environment-Reference-Cited by-同舟云学术

General Strategy for Querying Web Sources in a Data Federation Environment

Published:2011 Issue: Volume: Page:62-80
ISSN:
Container-title:Theoretical and Practical Advances in Information Systems Development
language:
Short-container-title:

Author:

Firat Aykut¹,Wu Lynn²,Madnick Stuart²

Affiliation:

1. Northeastern University, USA

2. Massachusetts Institute of Technology, USA

Abstract

Modern database management systems are supporting the inclusion and querying of non-relational sources within a data federation environment via wrappers. Wrapper development for Web sources, however, is a convolution of code with extraction and query planning knowledge and becomes a daunting task. We use IBM DB2 federation engine to demonstrate the challenges of incorporating web sources into a data federation. We, then, present a practical and general strategy for the inclusion and querying of web sources without requiring any changes in the underlying data federation technology. This strategy separates the code and knowledge in wrapper development by introducing a general-purpose capabilities-aware mini query-planner and a data extraction engine. As a result, Web sources can be included in a data federation system faster, and maintained easier.

Publisher

IGI Global

Reference27 articles.

1. Alatovic, T. (2001). Capabilities aware, planner, optimizer, executioner for Context Interchange project. Unpublished master’s thesis, Massachusetts Institute of Technology, Cambridge, MA, USA.

2. ObjectGlobe: Ubiquitous query processing on the Internet.;R.Braumandl;The VLDB Journal,2001

3. Chawathe, S. S., Garcia-Molina, H., Hammer, J., Ireland, K., Papakonstantinou, Y., Ullman, J. D., & Widom, J. (1994). The TSIMMIS project: Integration of heterogeneous information sources. Proceedings of the 16th Meeting of the Information Processing Society of Japan, 7–18.

4. DB2 Information Center. (2006, March 14). Retrieved January, 31, 2007 from http://publib.boulder.ibm.com/infocenter/db2luw/v8//index.jsp.

5. DB2 Information Integrator Wrapper Developer’s Guide. (2004, September 8). Retrieved January, 31, 2007 from http://publibfp.boulder.ibm.com/epubs/pdf/c1891740.pdf