专利汇可以提供Rewriting queries to access materialized views that group along an ordered dimension专利检索,专利查询,专利分析的服务。并且A method and apparatus are provided for rewriting aggregate queries to access a materialized view when (1) the queries place a restriction on an ordered dimension, (2) the materialized view aggregates the information referenced in the query and groups by the same dimension, and (3) the materialized view groups the information at a coarser level of granularity than the granularity associated with the restriction contained in the aggregate queries.,下面是Rewriting queries to access materialized views that group along an ordered dimension专利的具体信息内容。
What is claimed is:1. A method for processing queries, the method comprising the steps of:receiving an aggregate query that places a restriction on an ordered dimension;wherein said restriction is specified at a first level of granularity for the dimension;wherein said aggregate query does not reference a materialized view that groups results at a second level of granularity of the ordered dimension;wherein the second level of granularity is coarser than said first level of granularity;determining whether said materialized view satisfies each condition of a first set of conditions; andif said materialized view satisfies each condition in said first set of conditions, then rewriting said query to produce a rewritten query that references said materialized view and that includes a rewritten restriction that restricts said ordered dimension at said second level of granularity.2. The method of claim 1, wherein said step of rewriting includes determining whether bounds of at least one coarser granule of said coarser granules coincide to bounds of said restriction.3. The method of claim 2, wherein the step of rewriting includes if bounds of at least one coarser granule of said coarser granules coincide to bounds of said restriction, then rewriting said query to produce a rewritten query that references said at least one coarser granule.4. The method of claim 2, wherein the step of rewriting includes rewriting said query to produce a union between a plurality of queries that include a first query and a second query, wherein:the first query references said materialized view and includes a restriction based on one or more of the coarser granules, anda second aggregate query that reflects data requested by said aggregate query but not data requested by said first query.5. The method of claim 4, wherein the step of rewriting said query to produce a union between a plurality of queries includes producing said second aggregate query as an aggregate query that places a restriction on said ordered dimension, said restriction referencing at least one granule at said first level of granularity.6. The method of claim 1, wherein ordered dimension metadata defines said ordered dimension;wherein the step of determining whether said materialized view satisfies each condition of a first set of conditions includes examining said ordered dimension metadata to determine whether said materialized view satisfies a condition that said materialized view groups results by coarser granules for the ordered dimension; andwherein the step of rewriting is based on said ordered dimension metadata.7. The method of claim 1, wherein the step of receiving an aggregate query includes receiving an aggregate query that places a restriction that limits to a set of granules defined by one or more dimension tables.8. The method of claim 1, wherein the step of receiving an aggregate query includes receiving an aggregate query that places a restriction on an ordered time dimension; andwherein the step of determining whether said materialized view satisfies each condition of a first set of conditions includes determining whether said materialized view satisfies a condition that said materialized view groups results by coarser granules for the ordered time dimension.9. The method of claim 1,wherein the method further includes the step of determining that a second materialized view satisfies a second set of conditions; andwherein the first set of conditions includes that said second level of granularity by which said first materialized view groups results is coarser then the level of granularity of the ordered dimension at which said materialized view groups results.10. A computer-readable medium carrying one or more sequences of one or more instructions for processing queries, the one or more sequences of one or more instructions including instruction which, when executed by one or more processors, cause the one or more processors to perform the steps of:receiving an aggregate query that places a restriction on an ordered dimension;wherein said restriction is specified at a first level of granularity for the dimension;wherein said aggregate query does not reference a materialized view that groups results at a second level of granularity of the ordered dimension;wherein the second level of granularity is coarser than said first level of granularity;determining whether said materialized view satisfies each condition of a first set of conditions; andif said materialized view satisfies each condition in said first set of conditions, then rewriting said query to produce a rewritten query that references said materialized view and that includes a rewritten restriction that restricts said ordered dimension at said second level of granularity.11. The computer-readable medium of claim 10, wherein said step of rewriting includes determining whether bounds of at least one coarser granule of said coarser granules coincide to bounds of said restriction.12. The computer-readable medium of claim 11, wherein the step of rewriting includes if bounds of at least one coarser granule of said coarser granules coincide to bounds of said restriction, then rewriting said query to produce a rewritten query that references said at least one coarser granule.13. The computer-readable medium of claim 11, wherein the step of rewriting includes rewriting said query to produce a union between a plurality of queries that include a first query and a second query, wherein:the first query references said materialized view and includes a restriction based on one or more of the coarser granules, anda second aggregate query that reflects data requested by said aggregate query but not data requested by said first query.14. The computer-readable medium of claim 13, wherein the step of rewriting said query to produce a union between a plurality of queries includes producing said second aggregate query as an aggregate query that places a restriction on said ordered dimension, said restriction referencing at least one granule at said first level of granularity.15. The computer-readable medium of claim 10, wherein ordered dimension metadata defines said ordered dimension;wherein the step of determining whether said materialized view satisfies each condition of a first set of conditions includes examining said ordered dimension metadata to determine whether said materialized view satisfies a condition that said materialized view groups results by coarser granules for the ordered dimension; andwherein the step of rewriting is based on said ordered dimension metadata.16. The computer-readable medium of claim 10, wherein the step of receiving an aggregate query includes receiving an aggregate query that places a restriction that limits to a set of granules defined by one or more dimension tables.17. The computer-readable medium of claim 10, wherein the step of receiving an aggregate query includes receiving an aggregate query that places a restriction on an ordered time dimension; andwherein the step of determining whether said materialized view satisfies each condition of a first set of conditions includes determining whether said materialized view satisfies a condition that said materialized view groups results by coarser granules for the ordered time dimension.18. The computer-readable medium of claim 10, wherein the computer-readable medium further including sequences of instructions for performing the step of determining that a second materialized view satisfies a second set of conditions; andwherein the first set of conditions includes that said second level of granularity by which said first materialized view groups results is coarser then the level of granularity of the ordered dimension at which said materialized view groups results.19. A database system that processes queries, comprising:said database system configured to receive an aggregate query that places a restriction on an ordered dimension;wherein said restriction is specified at a first level of granularity for the dimension;wherein said aggregate query does not reference a materialized view that groups results at a second level of granularity of the ordered dimension;wherein the second level of granularity is coarser than said first level of granularity;said database system configured to determine whether said materialized view satisfies each condition of a first set of conditions; andsaid database system configured to rewrite said query, when said materialized view satisfies each condition in said first set of conditions, to produce a rewritten query that references said materialized view and that includes a rewritten restriction that restricts said ordered dimension at said second level of granularity.20. The database system of claim 19, wherein said database system is configured to rewrite by determining whether bounds of at least one coarser granule of said coarser granules coincide to bounds of said restriction.
FIELD OF THE INVENTION
The present invention relates to rewriting queries, and in particular, rewriting queries to access a materialized view.
BACKGROUND OF THE INVENTION
In a database management system (DBMS), data is stored in one or more data containers, each container contains records, and the data within each record is organized into one or more fields. In relational database systems, the data containers are referred to as tables, the records are referred to as rows, and the fields are referred to as columns. In object oriented databases, the data containers are referred to as object classes, the records are referred to as objects, and the fields are referred to as attributes. Other database architectures may use other terminology.
The present invention is not limited to any particular type of data container or database architecture. However, for the purpose of explanation, the examples and the terminology used herein shall be that typically associated with relational databases. Thus, the terms “table”, “row” and “column” shall be used herein to refer respectively to the data container, record, and field.
For various reasons, it may not be desirable for certain users to have access to all of the columns of a table. For example, one column of an employee table may hold the salaries for the employees. Under these circumstances, it may be desirable to limit access to the salary column to management, and allow all employees to have access to the other columns. To address this situation, the employees may be restricted from directly accessing the table. Instead, they may be allowed to indirectly access the appropriate columns in the table through a “view”.
A view is a logical table. As logical tables, views may be queried by users as if they were a table. However, views actually present data that is extracted or derived from existing tables. Thus, the problem described above may be solved by (1) creating a view that extracts data from all columns of the employee table except the salary column, and (2) allowing all employees to access the view.
A view is defined by metadata referred to as a view definition. The view definition contains mappings to one or more columns in the one or more tables containing the data. Typically, the view definition is in the form of a database query. Columns and tables that are mapped to a view are referred to herein as base columns and base tables of the view, respectively. The data maintained in the base columns is referred to herein as base data.
The data presented by conventional views is gathered and derived on-the-fly from the base tables in response to queries that access the views. That data gathered for the view is not persistently stored after the query accessing the view has been processed. Because the data provided by conventional views is gathered from the base tables at the time the views are accessed, the data from the views will reflect the current state of the base tables. However, the overhead associated with gathering the data from the base tables for a view every time the view is accessed may be prohibitive.
A materialized view, on the other hand, is a view for which a copy of the view data is stored separate from the base tables from which the data was originally gathered and derived. The data contained in a materialized view is referred to herein as (“materialized data”). Materialized views eliminate the overhead associated with gathering and deriving the view data every time a query accesses the view. As new data is periodically added to the base tables, the materialized view needs to be updated (i.e., refreshed) to reflect the new base data.
Computer database systems that are used for data warehousing frequently maintain materialized views that contain pre-computed summary information in order to speed up query processing. Such summary information is created by applying an aggregate function, such as SUM, COUNT, or AVERAGE, to values contained in the base tables. Materialized views that contain pre-computed summary information are referred to herein as “summary tables” or more simply, “summaries”. Base tables from summary information is generated are referred to as fact tables.
Summary tables typically store aggregated information, such as “sum of PRODUCT_SALES, by region, by month.” Other examples of aggregated information include counts of tally totals, minimum values, maximum values, and average calculations. Summary tables are used to reduce the overhead associated with processing queries that request summary information. Because the summary information is already pre-computed, it need not be re-computed during the execution of each query that requests summary information. Instead, the pre-computed summary values can be directly retrieved from the summary columns of the summary table.
When a database user knows that a particular materialized view contains the data desired by the user, the user can formulate a query that extracts the desired data directly from that materialized view. However, there are numerous circumstances in which a user will design a query that does not reference a materialized view to retrieve a set of data that can be most efficiently retrieved by accessing the materialized view. For example, the user may not be aware of all of the materialized views available in the database, or may not be sure how a particular materialized view could be used to retrieve the desired information.
Even when the user is aware that materialized views are available that have data desired by the user, the user may prefer to have the server transparently rewrite the query in terms of the materialized views, rather than writing the query to directly reference the materialized views. By allowing the server to rewrite the query, the database administrator may easily add and drop materialized views without affecting the application code that imbeds the user query. For example, if a user query is rewritten by the server to use a particular materialized view MV
1
, then the application will not break if the database administrator decides to drop MV
1
. In contrast, if the user query directly references MV
1
in the application code, then dropping MV
1
will break the application.
In light of the foregoing, some database servers include mechanisms for rewriting queries that do not reference materialized views in a way that causes them to reference materialized views. The execution of the rewritten query is often considerably improved relative to the original query because the relational objects accessed by the rewritten query are (e.g. the materialized views) much smaller than the objects referenced in the original query (e.g. the base tables), and/or the number of objects used by the rewritten query is less than the number of objects referenced in the original query.
For example, a summary can correspond to a query which joins two tables and performs data aggregation to compute sum-of-sales by city, and stores the materialized result in a table. If a user issues a query Q which requests sum-of-sales by city, then Q can be transparently rewritten to access pre-computed data stored in the summary table. Because of the rewrite, the result for Q can be quickly produced by simply scanning the summary table instead of joining two tables and then aggregating the data.
One type of query that is rewritten is an aggregate queries that places a restriction on a hierarchical dimension. This type of query may be rewritten to use a materialized view that groups data along the same hierarchical dimension. A dimension is an attribute of a set of data, such as a column of a table. A hierarchical dimension is a dimension where there is a hierarchical relationship between the values of the dimension. A common example of a hierarchical dimension is time. Possible values for time include a particular day, month, quarter, or year. The values are hierarchically related because a particular day is associated with a particular month, which is associated with a particular quarter, which is associated with a particular year.
FIG. 1
depicts a dimension hierarchy
100
, an illustrative dimension hierarchy for a time dimension. A dimension hierarchy is a hierarchy of values in an hierarchical dimension. Each node in a dimension hierarchy represents a value in a dimension. Node
102
represents 1998-1, a value representing the first quarter in 1998. Node
104
,
106
,
108
represents values ‘1998-01’, ‘1998-02’, and ‘1998-03’, which each represent months. The following definitions are helpful to describing dimension hierarchies.
DIMENSION HIERARCHY DEFINITIONS
Each node in dimension hierarchy
100
represents a granule. A granule is a particular value in the hierarchical dimension.
Each granule resides at one of the levels in the hierarchy. Each level of the hierarchy has a “level of granularity”. Levels that are higher in the hierarchy have coarser levels of granularity, while levels that are lower in the hierarchy have finer levels of granularity. For example, Quarter level
152
, which is higher than month level
154
in the hierarchy, has a coarser level of granularity than month level
154
.
Each level of granularity is associated with a set of granules. For example, quarter level of granularity
152
is associated with granules 1998-1, 1998-2, 1998-3, and 1998-4, which correspond to quarters. Similarly, month level
154
is associated with granules 1998-01, 1998-02, etc. that correspond to months.
The “parent granule” of a particular granule is the granule associated with the particular granule that is at the hierarchical level immediately above the hierarchical level of the particular granule. Thus, 1998-1 is the parent granule for granules 1998-01, 1998-02, and 1998-03.
A coarser granule, with respect to a particular granule, is a granule associated with a level of granularity that is coarser than the level of granularity of the particular granule. Thus, with respect to granule 1998-01, granules 1998 (represented by node
180
) and 1998-1 are coarser granules.
A finer granule, with respect to a particular granule, is a granule associated with a level of granularity that is finer than the level of granularity of the particular granule.
CONVENTIONAL REWRITES OF AGGREGATE QUERIES THAT RESTRICT ALONG A DIMENSION
Aggregate queries that restrict a particular dimension at a particular level of granularity may be rewritten by conventional rewrite mechanisms to access summary tables that group data from the fact table along the same dimension when the level of granularity at which the summary table groups the data is the finest level of granularity used by the fact table for that dimension.
FIG. 2
illustrates a conventional rewrite of this type of query.
Referring to
FIG. 2
, aggregate query
210
requests summary information from sales table
250
. Sales table
250
contains columns date
260
, region
262
, product
264
, and $Amt
266
. Date
260
contains values that represent days. Consequently, days are the finest level of granularity for the time dimension by which information in sales table
250
may be grouped. Query
210
requests summarized data from sales table
250
and restricts column date
260
to between Jan. 1, 1998 and Dec. 31, 1998. Thus, query
210
specifies a restriction on a time dimension.
FIG. 2
also shows the definition of a materialized view (MVSales
270
). The illustrated definition defines a summary table that groups data from sales table
250
by date. Thus, MVSales
270
groups data along the same dimension (time) as the dimension specified in the restriction contained in query
210
, and at the finest level of granularity of that dimension (date).
Because MVSales
270
groups data along the same dimension (time) as the dimension specified in the restriction contained in query
210
, and at the finest level of granularity of that dimension (date), conventional rewrite mechanisms are able to rewrite the query
210
to access MVSales
270
. Thus, query
210
is rewritten as query
280
.
Unfortunately, conventional rewrite mechanisms do not rewrite aggregate queries to access summary tables when the summary tables group along the same dimension as is used in a restriction of the queries, but where the grouping in the summary table is not done at the finest level of granularity. Summary tables that aggregate data at the finest level of granularity are much bigger than summary tables that aggregate data at coarser levels, and therefore require more work to process when an aggregate query is rewritten to access them.
Based on the foregoing, it is clearly desirable to provide a query rewrite mechanism that is capable of rewriting queries to access materialized views that would otherwise not be rewritten by conventional rewrite mechanisms. In particular, it is desirable to provide a query rewrite mechanism that does not depend on summary tables that group data along the finest granularity of a hierarchical dimension.
SUMMARY OF THE INVENTION
Mechanisms described herein rewrite aggregate queries to access a materialized view when (1) the queries place a restriction on an ordered dimension, (2) the materialized view aggregates the information referenced in the query and groups by the same dimension, and (3) the materialized view groups the information at a coarser level of granularity than the granularity associated with the restriction contained in the aggregate queries.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
FIG. 1
is block diagram depicting a dimension hierarchy according to an embodiment of the present invention;
FIG. 2
shows a query, table, and materialized view definition used to illustrate query rewrites;
FIG. 3
is an exemplary computer system upon which an embodiment of the present invention may be implemented;
FIG. 4
shows illustrative queries and a materialized view definition used to illustrate query rewrites;
FIG. 5
shows illustrative queries and a materialized view definition used to illustrate query rewrites;
FIG. 6A
shows an illustrative query and a materialized view definition used to illustrate query rewrites;
FIG. 6B
shows illustrative queries and a materialized view definition used to illustrate query rewrites;
FIG. 6C
shows a materialized view definition used to illustrate query rewrites;
FIG. 6D
shows illustrative queries and a materialized view definition used to illustrate query rewrites;
FIG. 7
is a block diagram depicting an hierarchy for an ordered dimension according to an embodiment of the present invention;
FIG. 8
is a block diagram showing a dimension table and a chart of information describing an ordered dimension;
FIG. 9A
shows illustrative queries, a table, and a materialized view definition used to illustrate query rewrites; and
FIG. 9B
shows an illustrative rewritten query.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
A method and apparatus for rewriting queries is described. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
HARDWARE OVERVIEW
FIG. 3
is a block diagram that illustrates a computer system
300
upon which an embodiment of the invention may be implemented. Computer system
300
includes a bus
302
or other communication mechanism for communicating information, and a processor
304
coupled with bus
302
for processing information. Computer system
300
also includes a main memory
306
, such as a random access memory (RAM) or other dynamic storage device, coupled to bus
302
for storing information and instructions to be executed by processor
304
. Main memory
306
also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor
304
. Computer system
300
further includes a read only memory (ROM)
308
or other static storage device coupled to bus
302
for storing static information and instructions for processor
304
. A storage device
310
, such as a magnetic disk or optical disk, is provided and coupled to bus
302
for storing information and instructions.
Computer system
300
may be coupled via bus
302
to a display
312
, such as a cathode ray tube (CRT), for displaying information to a computer user. An input device
314
, including alphanumeric and other keys, is coupled to bus
302
for communicating information and command selections to processor
304
. Another type of user input device is cursor control
316
, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor
304
and for controlling cursor movement on display
312
. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
The invention is related to the use of computer system
300
for rewriting queries. According to one embodiment of the invention, rewriting queries is provided by computer system
300
in response to processor
304
executing one or more sequences of one or more instructions contained in main memory
306
. Such instructions may be read into main memory
306
from another computer-readable medium, such as storage device
310
. Execution of the sequences of instructions contained in main memory
306
causes processor
304
to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
The term “computer-readable medium” as used herein refers to any medium that participates in providing instructions to processor
304
for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such as storage device
310
. Volatile media includes dynamic memory, such as main memory
306
. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus
302
. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to processor
304
for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to computer system
300
can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus
302
. Bus
302
carries the data to main memory
306
, from which processor
304
retrieves and executes the instructions. The instructions received by main memory
306
may optionally be stored on storage device
310
either before or after execution by processor
304
.
Computer system
300
also includes a communication interface
318
coupled to bus
302
. Communication interface
318
provides a two-way data communication coupling to a network link
320
that is connected to a local network
322
. For example, communication interface
318
may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, communication interface
318
may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface
318
sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
Network link
320
typically provides data communication through one or more networks to other data devices. For example, network link
320
may provide a connection through local network
322
to a host computer
324
or to data equipment operated by an Internet Service Provider (ISP)
326
. ISP
326
in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet”
328
. Local network
322
and Internet
328
both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals on network link
320
and through communication interface
318
, which carry the digital data to and from computer system
300
, are exemplary forms of carrier waves transporting the information.
Computer system
300
can send messages and receive data, including program code, through the network(s), network link
320
and communication interface
318
. In the Internet example, a server
330
might transmit a requested code for an application program through Internet
328
, ISP
326
, local network
322
and communication interface
318
. In accordance with the invention, one such downloaded application provides for rewriting queries as described herein.
The received code may be executed by processor
304
as it is received, and/or stored in storage device
310
, or other non-volatile storage for later execution. In this manner, computer system
300
may obtain application code in the form of a carrier wave.
FUNCTIONAL OVERVIEW
The techniques for rewriting aggregate queries described hereafter rewrite aggregate queries that place restrictions upon ordered dimensions. An ordered dimension is a dimension where an order is associated with the granules at a particular level of granularity, and where each parent granule is associated with a particular range of finer granules. For example, referring to granules represented by dimension hierarchy
100
, the granules 1998-01, 1998-02 . . . 1998-12 represent an ordered set of values that represent months. Granule 1998-1 represents a quarter, and is associated with a range of granules that represent months of the first quarter 1998. This range begins with January 1998 inclusively and ends with March 1998 inclusively, and in particular, includes granules 1998-01, 1998-02, and 1998-03.
As another example, particular days (e.g. Jan. 1, 1998) are represented by granules at the day level
156
which is immediately below the month level of granularity
354
. There is an order between days. A particular range of days is associated with a parent granule that represents a month. The granules associated with date range Jan. 1, 1998-Jan. 31, 1998 are associated with the granule 1998-01.
According to one embodiment of the invention, techniques are provided to rewrite aggregate queries to access a materialized view when (1) the queries place a restriction on an ordered dimension, (2) the materialized view aggregates the information referenced in the query and groups by the same dimension, and (3) the materialized view groups the information at a coarser level of granularity than the granularity associated with the restriction contained in the aggregate queries. The ability to rewrite queries to access a materialized view that groups information at a coarser level of granularity than the granularity associated with restrictions contained in the queries allows queries that satisfy these conditions to be processed more efficiently than currently possible.
The rewritten query places a restriction along the same dimension as the restriction contained in the original query, but restriction in the rewritten query is at a coarser level of granularity than the restriction contained in the original query. For example, the restriction of the rewritten query may be in terms of months, while the restriction of the original query is in terms of days. The ordered dimension may be a well-established ordered dimension, such as time, or an ordered dimension defined by metadata.
GENERAL REWRITE ELIGIBILITY CONDITIONS
It should be noted that for any query rewrite mechanism to rewrite an aggregate query to access a materialized view, certain rewrite eligibility conditions must be satisfied. Rewrite eligibility conditions include those that are particular to the type of rewrites described herein, and eligibility conditions that are more general to the field of rewriting of aggregate queries. These more general conditions include, and are not limited to, data sufficiency and aggregate compatibility.
Data sufficiency is satisfied if all necessary columns of a query can be obtained using the data stored in the materialized view. If values from a column necessary for the processing of a query are not contained in the materialized view, then the data sufficiency condition is not satisfied.
Aggregate compatibility is satisfied if the aggregates in a summary are at the same or lower level than the level of aggregates in a query. For example, a sum of sales by month is at a lower level than a sum of sales by year. Therefore, the aggregate compatibility is satisfied if the summary has sum of sales by month and the query asks for sum of sales by year, but is unsatisfied if the summary has sum of sales by year and the query asks for sum of sales by month.
For purposes of exposition, the rewrites described herein assume that the more general eligibility rewrite conditions are satisfied. Thus, the general rewrite eligibility conditions are not described in detail in the rewrite illustrations provided herein.
AGGREGATE QUERIES THAT RESTRICT TO COINCIDING BOUNDS
When an aggregate query requests data and specifies a restriction along an ordered dimension at a particular level of granularity, and a summary table groups along the ordered dimension but at a coarser level of granularity, the query may be rewritten to access the summary table if bounds of the granules at the coarser level of granularity coincide with the bounds of those specified by the restriction.
For the purpose of illustration, assume that an aggregate query specifies a restriction based on a time column, and that the restriction specifies a range that begins with the first day of a year and ends with the last day of a year. This query may be rewritten to access a summary table that groups the data based on the same column, but at a coarser level of granularity that corresponds to years, because bounds of a year correspond to the bounds of the restriction specified by the aggregate query restriction. Specifically, a first day of a year corresponds to a beginning bound of a year, and the last day of a year coincides with the ending bound of a year.
Stated another way, an aggregate query can be rewritten to access a materialized view when: (1) the query has a restriction at a first level of granularity, (2) the query groups at a second, relatively coarser, level of granularity, and (3) if any second-level granule has any first-level descendent that satisfies the restriction, then all of the first-level descendents of the second-level granule must satisfy the restriction.
REWRITE EXAMPLES
FIG. 4
shows queries and a materialized view definition used to illustrate a rewrite of a query that places a restriction that specifies coinciding bounds. QBG
401
is an aggregate query that requests summarized data from sales table
250
(
FIG. 2
) grouped by column region
262
. Where clause
403
specifies a restriction along the ordered time dimension, and in particular, specifies a restriction upon column date
260
to values between the days Jan. 1, 1997 and Dec. 31, 1999.
MVBG
421
is a summary table definition that reflects data from sales table
250
. Specifically, MVBG
421
contains summary data that includes sums of values in column $Amt
266
, grouped by the column region
262
and the output of function to_date as applied to column date
260
. Function to_date is a function recognized by DBMSs developed by Oracle corporation. The function to_data extracts from a date field the components of a date e.g. day, month, or year. The function to_date is similar to the ANSI SQL function extract.
The function to_date as applied in MVBG
421
outputs a year. Thus, MVBG
421
groups data along the same ordered dimension referenced by the restriction specified by WHERE clause
403
, except that in MVBG
421
data is grouped at a coarser level of granularity than that specified by WHERE clause
403
.
The bounds of year granules correspond to bounds of days referenced by the restriction specified by WHERE clause
403
. Thus, query
401
may be rewritten to QrwBG
441
(
FIG. 4
) to access MVBG
421
. The WHERE clause
442
of QrwBG
441
is rewritten so that the restriction specified by WHERE clause
442
is based on years, and in particular, references column year
423
and coarser granules
1997
and
1999
.
FIG. 5
show queries and a materialized view used to further illustrate a rewrite of a query that specifies a restriction with coinciding bounds. QBGQ
501
is an aggregate query that requests summary data from sales table
250
(
FIG. 2
) grouped by column region
262
. WHERE clause
503
specifies a restriction upon an ordered time dimension, and in particular, restricts column date
260
to granules between the days Jan. 1, 1997 and Mar. 31, 1997.
MVBGQ
521
defines a summary table that contains summary data based on sales table
250
. Like MVBG
421
, MVBGQ
521
includes sums of values from $Amt
266
grouped by data from column region
262
and the output of function to_date applied to column date
266
, except that MVBGQ
521
groups by quarter.
The bounds of the day granules in column data
266
that are referenced by the restriction specified by WHERE clause
403
correspond to bounds of quarter granules. Thus QBGQ
501
may be rewritten as QrwBGQ
541
. The WHERE clause
503
of QBGQ
501
is rewritten to WHERE clause
543
, which places restrictions based on quarters, the coarser granules by which data in MVBGQ
521
is grouped.
AGGREGATE QUERIES THAT RESTRICT TO NONCOINCIDING BOUNDS
According to an embodiment of the invention, techniques are provided for rewriting an aggregate query that specifies a restriction along an ordered dimension to access a summary table that groups by the same ordered dimension but according to coarser granules, even when the bounds of the restriction do not coincide with the bounds of the coarser granules.
Under such conditions, the query is rewritten as a union between two or more queries, where one of the queries in the union accesses the materialized view, and one or more other queries in the union access the fact table referenced by the original aggregate query. The rewritten query accessing the materialized view specifies a restriction along the ordered dimension but at a coarser level of granularity, referencing coarser granules, and reflecting a portion of the fact table that corresponds to data that falls within the bounds of the coarser granules. The one or more other queries access the fact tables for the remaining portion of the data that falls outside the bounds of the query referencing the materialized view, but within the bounds specified by the aggregate query.
FIG. 6A
shows an aggregate query that specifies a restriction along an ordered dimension, and illustrates how such a query may be rewritten to access a summary table that also groups along the dimension but by coarser granules whose bounds do not coincide with the bounds of the restriction.
QUB
601
requests summary data from sales table
250
(
FIG. 2
) that includes sums of values in $Amt
266
grouped by region
262
. WHERE clause
603
specifies a restriction on column date
260
to values between the days Dec. 15, 1991 and Jan. 31, 1997.
QUB
601
may be rewritten as union QU
643
(FIG.
6
B), which is a union of queries
660
,
670
, and
680
. Query
670
references MVBG
421
. WHERE clause
678
specifies a restriction on column year
423
to between 1992 and 1996, a restriction along the same ordered time dimension as that specified by QUBQ
501
, but at a coarser level of granularity. The results of query
670
only summarize a portion of the data requested by QUBQ
501
, the remaining portion is reflected by queries
660
and
680
.
Queries
660
and
680
reference the fact table referenced by QUBQ
501
, that is sales table
250
. Query
660
contains WHERE clause
668
, and query
680
contains WHERE clause
688
. WHERE clause
668
specifies a restriction along the same ordered time dimension as that of WHERE clause
603
and at the same level of granularity as that specified in WHERE clause
603
. However, WHERE clause
668
specifies a date range that (1) begins at the beginning of the range specified in WHERE clause
603
of the original query, and (2) ends at the beginning of the start boundary of the restriction specified by query
670
.
WHERE clause
688
restricts along the same ordered time dimension as that of WHERE clause
603
and at the same level of granularity as that specified in WHERE clause
603
. However, WHERE clause
688
(1) begins at the end boundary of the restriction specified in WHERE clause
678
, and (2) ends at the end of the range specified in WHERE clause
603
of the original query.
REFERENCING MULTIPLE MATERIALIZED VIEWS
An aggregate query specifying a restriction whose bounds do not coincide with the bounds of the coarser granules of any particular summary table may be rewritten as union of queries that each may reference a different summary table.
For example, referring to
FIG. 6C
, MVBGM
640
is a summary table definition that reflects data from sales table
250
. Specifically, like MVBG
421
, MVBGM
640
groups data along the same ordered dimension referenced by the restriction specified by WHERE clause
603
of QUB
601
. However, MVBGM
640
groups at a finer level of granularity than MVBG
421
, a level of granularity that corresponds to months. Thus, referring to
FIG. 6D
, QUB
601
may be rewritten as a union between queries
660
,
670
, and
650
.
SELECTION OF THE MATERIALIZED VIEW GROUPING AT A MORE COURSER LEVEL OF GRANULARITY
More than one materialized view may satisfy eligibility conditions relative to an aggregate query. In this case, to the degree that more than one materialized view may be used, the materialized view that groups data at the coarsest level of granularity is selected for rewrite purposes. The rewrite of QUB
601
demonstrates selecting the materialized view that groups results at the coarsest level of granularity. Either MVBG
421
and MVBGM
653
may have been used that supply the data corresponding to the range between Jan. 1, 1992 and Dec. 31, 1996 (i.e. the data supplied by query
670
). However, MVBG
421
was selected because it grouped along the needed dimension at a courser level of granularity. Extracting data from the materialized view that groups data at the courser level of granularity requires less work than extracting from one that groups at a finer level of granularity, thus improving efficiency.
REWRITING QUERIES THAT REFERENCE USER DEFINED ORDERED DIMENSIONS
Rewriting queries to access materialized views that group along the same ordered dimension has been illustrated using an established dimension (the time dimension). This dimension is popularly defined. Various standard granules, dimension hierarchies, data types, functions, and rules have been established to support the ordered dimension. Thus, a database server may be configured to recognize queries grouping along the time dimension and materialized views grouping data along same dimension using the various standards, and how to rewrite queries under the conditions and in the manner described previously.
However, there are other useful ordered dimensions which have not been standardized. In order to rewrite aggregate queries to access a materialized view grouping along such dimensions, a mechanism is needed to describe the ordered dimension to a database management system.
ORDERED DIMENSION METADATA
Order dimension metadata is an example of such a mechanism. Ordered dimension metadata describes the hierarchical relationship and order between a set of granules in an ordered dimension. Specifically, order dimension metadata indicates the hierarchy between granules, the order between granules for each level of granularity, and the range of finer granules that each parent granule covers. Dimensions described by order dimension metadata may be referred to as “user defined ordered dimensions” because typically order dimension metadata is generated from user input.
FIG. 7
shows dimension hierarchy
700
for user defined ordered dimension for sales offices. Node
701
represents a granule that corresponds to a sales region, and is associated with level of granularity sales region level
790
. Nodes
710
and
730
represent granules that correspond to sales districts, and are associated with level of granularity sales district level
791
. Nodes
720
correspond to granules that represent sales offices, and are associated with level of granularity sales office level
792
. Granules at sales region level
790
are referred to as sales region granules, granules at sales district level
791
are referred to as sales district granules, and granules as sales office level
792
are referred to as sales office granules.
Sales district granule
1
is a parent granule for the sales office granules in range
715
, i.e. values 0-9. Sales district granule
3
is a parent granule for the sales office granules in range
735
, i.e. values 30-39. Sales region granule
1
is a parent granule associated with the range of sales district granules
0
-
5
, i.e. range
705
.
FIG. 8
shows a dimension table sales_location
801
for the dimension for the sales office dimension. Sales_location
801
includes columns sales_office
810
, sales_district
812
, and sales_region
814
.
According to an embodiment of the present invention, order dimension metadata describes the hierarchical relationship between columns of sales_location
801
, the range of finer granules corresponding to parent granules, and the order of granules in a particular level of granularity. These relationships may be described using the type of information depicted in chart
850
(FIG.
8
).
Chart
850
includes the following vertical sections: dimension table column
852
, child-of
854
, granule section
856
, parent granule range
858
, and granule order
860
. Section child-of
854
indicates that sales_office
810
is a child of sales_district
812
, and sales_district
812
is a child of sales_region
814
.
Granule order
860
shows that the level of granularity associated with sales_office column
810
(i.e. sales office level
792
) is dictated by the values of granules in sales_office column
810
, that the order within the level of granularity associated with sales_district
812
(i.e. sales district level
791
) is dictated by the values of the granules in sales_district
812
, and that the order within the level of granularity associated with sales_region column
814
(i.e. sales region level
790
) is dictated by the values of granules in sales region column
814
. Thus, for a particular level of granularity, the granules themselves explicitly dictate their order.
Sections granule
856
and range
858
shows that sales district granule
1
is associated with the range of sales office granules from
0
-
9
, sales district granule
3
is associated with the range of sales office granules from
30
-
39
(i.e. range
735
), and that sales region granule
1
is associated with the range of sales district granules
0
-
5
, (i.e. range
705
).
REWRITING AGGREGATE QUERIES BASED ON ORDERED DIMENSION METADATA
An aggregate query that groups data along a user defined ordered dimension may be rewritten to access a materialized view that also aggregates data along the same dimension, if the ordered dimension metadata indicates that the materialized view aggregates at a coarser level of granularity. Expository queries, table, and materialized view are provided to demonstrate such a rewrite.
FIG. 9A
shows fact table office_sales
970
, which includes office_location
972
and dollar_amt
974
. Office_location
972
corresponds to the sales office level
792
, and thus contains sales office granules. Query
901
is a aggregate query that groups along the sales office ordered dimension, and in particular, groups by office_location
972
. WHERE clause predicate
903
specifies a restriction on column office_location
972
to values between 0 and 9. MVUB
921
groups along the sales office dimension, grouping by column sales_district
812
.
According to one embodiment, a query rewrite mechanism examines ordered dimension metadata to detect a variety of eligibility conditions with respect to QUB
901
that indicate that QUB
901
may be rewritten to access the materialized view defined by MVUB
921
. First, QUB
901
places a restriction on office_location
972
and MVUB
921
groups by sales_district
812
. Thus, QUB
901
specifies a restriction upon the sales office ordered dimension, and materialized view MvUB
921
groups along that dimension. MVUB
921
groups at the relatively coarser sales district level, while the WHERE clause predicate
903
restricts along relatively finer sales office level. Finally, QUB
901
restricts sales_office
810
column to values between 0 and 9, the range that corresponds to sales district granule
1
. Thus, QUB
901
may be rewritten to access MVUB
921
as QrwUB
941
, with WHERE clause predicate
942
. WHERE clause predicate
942
specifies a restriction on the sales district dimension limiting the dimension to sales district granule
1
.
The present invention has been illustrated using granules whose order within a particular level of granularity corresponds to their values. However, other ordering mechanisms may be used. For example, a particular granule may be mapped to an ordinal number used to order the granules, or position within a list of granules may used to order them. Therefore, it is understood that present invention is not limited to any particular mechanism for ordering granules.
In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
标题 | 发布/更新时间 | 阅读量 |
---|---|---|
用于维护主动查询的方法、系统和计算机可读存储介质 | 2020-05-15 | 794 |
基于甲骨文In-Memory的SQL语句调优方法 | 2020-05-18 | 254 |
用于演进分析的系统 | 2020-05-22 | 204 |
数据的查询方法、装置、终端及存储介质 | 2020-05-08 | 586 |
一种GPCR药物靶标的配体生物活性预测方法及其应用 | 2020-05-11 | 578 |
一种数据存储方法、数据查询方法及装置 | 2020-05-14 | 675 |
用于存储数据的方法和装置 | 2020-05-16 | 709 |
基于图结构匹配的智能推荐系统及方法 | 2020-05-11 | 711 |
一种数据处理的方法、存储节点及协调节点 | 2020-05-22 | 167 |
具有多项目事务支持的多数据库日志 | 2020-05-24 | 559 |
高效检索全球专利专利汇是专利免费检索,专利查询,专利分析-国家发明专利查询检索分析平台,是提供专利分析,专利查询,专利检索等数据服务功能的知识产权数据服务商。
我们的产品包含105个国家的1.26亿组数据,免费查、免费专利分析。
专利汇分析报告产品可以对行业情报数据进行梳理分析,涉及维度包括行业专利基本状况分析、地域分析、技术分析、发明人分析、申请人分析、专利权人分析、失效分析、核心专利分析、法律分析、研发重点分析、企业专利处境分析、技术处境分析、专利寿命分析、企业定位分析、引证分析等超过60个分析角度,系统通过AI智能系统对图表进行解读,只需1分钟,一键生成行业专利分析报告。