Mapping a data from a data warehouse to a data mart
专利汇可以提供Mapping a data from a data warehouse to a data mart专利检索，专利查询，专利分析的服务。并且A method and system and a computer program are provided for allowing users to extract predetermined, specialized content out of an Online transaction processing system (OLTP) into the portfolio management system database using data warehouse as a filtering device in an integrated database system. The use of the data warehouse as a filter involves determining a data structure representation for data sets stored in the data warehouse that conforms to the portfolio management system database schema, mapping data structure defined in the data warehouse schema to data structure supported by the portfolio management database and extracting predetermined data sets for use in the future processes.，下面是Mapping a data from a data warehouse to a data mart专利的具体信息内容。
The present invention relates in general to a data management method and a system and, in particular, to a method and a system for providing data sets to a portfolio management system database.
Enterprise database systems can be divided into two categories: operational and informational. Operational databases function as repositories for data produced by online transaction processing systems of the manufacturing, production, and transactional systems. On the other hand, informational databases store data for use in decision support and information processing systems. Informational databases include data warehouses and portfolio management system databases.
Data warehouses, like for example SAP Business Warehouse (BW), were designed and developed as a solution to problems of users submitting queries directly, slowing down the performance of online transaction processing systems which require a minimum guaranteed response time with uninterrupted availability and jeopardizing important production system functions. This, along with the risks associated with giving the extended e-business enterprise direct access to online transaction processing systems, constituted urgent necessity to store data in an environment that is not only optimised for business analysis and reporting, but also for secure broad access.
U.S. Pat. No 6,490,590 (Fink) discloses a method and system for improved data modelling, extraction and loading routines where detailed description of the prior art extraction and loading technique and the related prior art problems are included.
Portfolio management system with its database was developed for specialized informational purposes in order to support managers in their strategic decisions, like for example SAP Real Estate portfolio management system. The dynamic nature of today's market caused portfolio management to evolve into an increasingly complex environment. It involves the utilization of a variety of tools covering a wide range of functions. A typical portfolio manager must stay abreast of changing market conditions and numerous factors related to the portfolios they manage. These factors include knowing the most recent portfolio's status as well as changes in the risk profile of a portfolio due to changing market conditions or risk attributes. Thus, it is crucial to have the most recent data available for decision making and for the successful management of the portfolios.
In the prior art however, the manually inputted data that was available to the portfolio management system was often delayed and inconsistent with the online transaction processing system data. Good quality integrated data available in data warehouses after the extraction from the online transaction processing system was not available to the portfolio management system.
The present invention provides a system and method for updating a portfolio management system database with data retrieved from a online relational database by using data warehouse as a filtering device in an integrated database system. The program module filtering out the predetermined data sets determines the structure of the extracted content, determination involves mapping data structure defined in the data warehouse schema to data structure supported by the portfolio management database.
The present invention makes available an integrated data standard within each data warehouse system, for use in the portfolio management system, allowing for the advanced analysis and reporting based on the consistent data. Thus, since the integrated databases of online transaction processing, data warehouse and portfolio management system use the same data, the duplication of data is avoided. Also, the present invention enables portfolio managers to make decisions faster and thus achieve considerable cost savings.
Since the data must be mapped before it can be extracted and transformed, a transformation has to be defined for all data from each data source. Transformation is the process of mapping data from source objects onto target objects and optionally applying conversions to the data. After the transformations have been defined, then scripts are generated, which perform the function of converting and loading data into target objects at run time when so requested.
In the prior art, a transformation had to be defined for the online transaction processing data, in order to make possible mapping onto the target objects in the data warehouse system. In the present invention the data is mapped from data warehouse objects onto the portfolio management system objects in order to make extraction for portfolio management possible.
- Figure 1
- is a block diagram of a integrated database system where the data sets received from the online transaction processing system are filtered out with the use of the data warehouse and made available to the portfolio management system.
- Figure 2
- is a flowchart of a process describing a method of the present invention.
- Figure 3
- illustrates mapping of objects from data warehouse onto the objects of the portfolio management system.
The claimed invention is applicable to many different industries. One skilled in the art will appreciate that the various embodiments and concepts of the present invention are applicable to plurality of industries without straying from the spirit of the present invention.
Figure 1 illustrates a block diagram showing an integrated database system where data sets are provided to a portfolio management system database. The integrated database system comprises online transaction processing system (OLTP) 100 that comprises one or more tables 102 each configured to store a plurality of data sets 103. The data sets undergo aggregation and reformatting as they are transferred to the data warehouse. This is a process of standard mapping where the data sets from the source (operational data) are mapped to the target database (data warehouse).
In the data warehouse 104 the process of the new mapping and extraction takes place. That means that the data sets are this time extracted out from the data warehouse into the portfolio management system 110 for the use in the future processes and in the analysis and planning. The data sets 105 received from the online transaction processing system are stored in the Info-cube, a multidimensional data model 106 of the SAP Business Information Warehouse.
An Info-cube comprises a plurality of relational tables that are created according to the star schema: a large fact table in the centre, with several dimension tables surrounding it. Data sets 105 received from the online transaction processing system can be also loaded into the info-objects 108. Each SAP info-object has characteristics with attributes, texts, or hierarchies; in prior art it has functioned as a data target, in the present invention, it functions as a data source.
In the next step, the determination of a data structure representation for data sets stored in the data warehouse that conforms to the portfolio management system database schema takes place. A data structure representation for data sets stored in the data warehouse has to be determined using the program module for filtering out the predetermined data sets 109, in order to accomplish the task of mapping the objects of the data warehouse onto the objects of portfolio management system database 112, and not like it was in a case of prior art mapping where the online transactional processing system data was mapped onto the data warehouse objects. The analysis is done field by field, character by character, to establish actual contents, and to determine acceptable data structures for organizing the data.
Thus, data sets 105 from source objects located in the data warehouse 108 are mapped onto target objects of the portfolio management system database 116 and conversions to the data sets 105 are optionally applied resulting in providing the filtered out data sets 115 that are stored in the Info-cubes 114 of the Dynamic Real Estate Analysis Model and can be used in the future processes. Then, correlations between objects 108 of data warehouse database and objects of a portfolio management system database 116 are indicated. Also, mapping data types associated with objects of the data warehouse schema to data types supported by said portfolio management system database takes place. Data types describe the technical attributes of data objects. They are purely descriptive and do not take up any memory space.
The mapping can take place on the individual basis, manually or automatically, on the mass scale. In both cases, one or more data warehouse objects are mapped onto the portfolio management system objects using unique identification (a key). Manual mapping of source objects using GUI interface has such an advantage that if manager, for example, needs to group the objects for increasing their value, he is able to do so. However, the mapping can be done also automatically, on the mass scale. In both cases objects are usually mapped with their hierarchies even though single objects can be taken out of the hierarchy if so requested.
After the transformations have been defined, and data is mapped from the objects of the data warehouse onto the target portfolio management system, then scripts are generated, which perform the function of converting and loading data into target objects at run time for this specialized extraction. An extraction variant is defined which joins together several fields. All fields that belong to one extraction variant are extracted together.
Each extraction variant is allocated a function module for example:
However, also different function modules including those especially customized for the customers can be assigned to the extraction variants. For all the extraction variants, the table structure is the same. Included in the table attributes are also evaluated.
Figure 2 is a corresponding flow chart illustrating steps of a method of providing data sets to the portfolio management system. In the step 200 data sets from an online transaction processing system are recived in a data warehouse. The data sets are received as a result of the standard extraction process. In step 202 a data structure representation for data sets stored in the data warehouse conforming to the portfolio management system database schema is determined. Determining a data structure database representation involves, for example, determining the database objects that are to be used by the database system. The determining a data structure representation includes further mapping data types associated with objects of the data warehouse schema onto the data types supported by said portfolio management system database. Also, this step creates a cross reference, at the field level, of what data goes where. The next step 204 involves generating mapping data, in other words, the required scripts are generated, which perform the function of converting and loading data into target objects, in this case portfolio management system objects and more specifically DREAM objects (Dynamic Real Estate Analysis Model) at run time. In step 206 the data sets are extracted from the data warehouse.
Different extraction variants can be defined. The user determines which extraction variant will be used. All fields that belong to one extraction variant are extracted together and for all variants the table structure is identical. In the next step 208, the filtered out data sets are provided to the portfolio management system for storage in the portfolio management system 210. The stored in the portfolio management system data sets are ready for use in further processes. Thus, the present invention for the first time makes available an integrated data warehouse data for use in the portfolio management system, allowing for the advanced analysis and reporting based on the consistent data. Also, since the integrated databases of online transaction processing, data warehouse and portfolio management system use the same data, the duplication of data is avoided.
Figure 3 depicts the case when more then one info object 300 of the data warehouse is mapped onto the object of the portfolio management 304 and the mapped source objects have the same parameter values 302, in such a case the mapping onto the target object parameter value 306 is completed and the value is extracted. However, another, not shown possibility exists when the source objects stored in the data warehouse have different parameter values, in this case no value is extracted unless the user specifies which content should be extracted.
- 100
- online transaction processing system
- 102
- database table
- 103
- data set
- 104
- data warehouse
- 105
- data set
- 106
- data warehouse Info-cube
- 108
- Info-object
- 109
- Program module for filtering out the predetermined data sets
- 110
- Portfolio management system
- 112
- Portfolio management system database table
- 114
- Portfolio management system Info-cube
- 115
- Filtered out data set
- 116
- Portfolio management system info-object
- 300
- Object of the data warehouse
- 302
- Parameter value
- 304
- Object of the portfolio management system
- 306
- Parameter value
| 标题 | 发布/更新时间 | 阅读量 |
|---|---|---|
| 一种数据加载清洗引擎、调度与存储系统 | 2020-05-16 | 542 |
| 一种基于大数据平台数据分析域构架方法 | 2020-05-21 | 199 |
| 一种能源数据仓库系统构建方法及装置 | 2020-05-08 | 318 |
| 一种古村落空间舒适度测量方法及拟合算法 | 2020-05-19 | 700 |
| 一种测试方法、装置、服务器及存储介质 | 2020-05-13 | 348 |
| 大规模数据管理与数据分发系统及方法 | 2020-05-14 | 762 |
| 一种皮肤病患者规范化系统 | 2020-05-12 | 342 |
| 基于大数据的安全事件上报平台及方法 | 2020-05-14 | 623 |
| 基于JSON文档结构的工业大数据多维分析与可视化方法 | 2020-05-15 | 31 |
| 一种高效的用户兴趣类别预测方法 | 2020-05-11 | 681 |
高效检索全球专利专利汇是专利免费检索,专利查询,专利分析-国家发明专利查询检索分析平台，是提供专利分析，专利查询，专利检索等数据服务功能的知识产权数据服务商。
我们的产品包含105个国家的1.26亿组数据，免费查、免费专利分析。
专利汇分析报告产品可以对行业情报数据进行梳理分析，涉及维度包括行业专利基本状况分析、地域分析、技术分析、发明人分析、申请人分析、专利权人分析、失效分析、核心专利分析、法律分析、研发重点分析、企业专利处境分析、技术处境分析、专利寿命分析、企业定位分析、引证分析等超过60个分析角度，系统通过AI智能系统对图表进行解读，只需1分钟，一键生成行业专利分析报告。
