Data Warehousing and Data Mining
Executive Overview
Analytics, Business Intelligence (BI) and the exponential increase of insight and decision making accuracy and quality in many enterprises today can be directly attributed to the successful implementation of Enterprise Data Warehouse (EDW) and data mining systems. The examples of how Continental Airlines (Watson, Wixom, Hoffer, 2006) and Toyota (Dyer, Nobeoka, 2000) continue to use advanced EDW and data mining systems and processes to streamline their business models are a case in point. The greater the level of economic uncertainty, perceived and actual risk in any given strategy or endeavor, the more the reliance on EDW, data mining and advanced forms of predictive modeling including analytics (Sen, Ramamurthy, Sinha, 2012). From this standpoint, the emerging areas of high growth in the global economy are attracting a high level of investment in EDW, data mining, predictive modeling and analytics. The latest figures illustrate how valued EDW and data mining are in enterprise today. According to industry research and advisory firm Gartner, the EDW and data mining market began 2011 with a global value of $23.2 billion with a projection of market growth of 7% per year through 2015, making it one of the largest and perennially growing enterprise software market (Sen, Ramamurthy, Sinha, 2012). Gartner has defined the EDW and data mining architecture as being comprised of the architectural design, repository and execution platform. These three core components are how this research and advisory firm analyze the market from a software component standpoint, looking at the relative adoption of each EDW and data mining component (Sen, Ramamurthy, Sinha, 2012). The intent of this analysis is to evaluate the benefits and current trends in EDW and data mining, evaluating Continentals’ and Toyota’s best practices and results achieved. Additional objectives include an assessment of EDW and data mining optimization techniques, recommendations for storage solutions and an analysis of a potential EDW process workflow predicated on a Customer Relationship Management (CRM) system.
Benefits and Current Trends in Data Warehousing and Data Mining
The greatest benefit that is being accrued from EDW and data mining is the ability to gain greater insights into the customer, distribution channel, supplier and stakeholder processes, systems and metrics over time. A highly effective EDW and data mining strategy will bring together a myriad of systems that had been disconnected, even siloed, throughout an enterprise. The Master Data Management (MDM) applications that are part of an EDW architecture or platform deliver what many enterprise lack previous to this point, which is a single system of record for all transactions and enterprise-wide activity (Fay, Zahay, 2003). Having a single system of record leads to more synchronized, unified strategies across an entire enterprise and often leads to corporate cultures becoming more galvanized around specific goals, objectives, while also measuring their relative performance with much greater accuracy and insight (Watson, Wixom, Hoffer, 2006). Based on the solid foundations of an MDM architecture and the ability to mine data across the enterprise, enterprises often accelerate their use of many different forms of analytics, from predictive modeling to data visualization including modeling customer interactions to see how pricing and product promotions will impact sales and profitability (Fay, Zahay, 2003). This leads to one of the most critically important advantages of using EDW and data mining applications, which is the ability to predict overall corporate performance based on the impact of demand-driven, customer-driven and supply chain-based factors and determinants of performance (Watson, Wixom, Hoffer, 2006).
Relying on this integration of customer, distributor and supplier EDW and data mining applications once integrated to financial systems have been delivering insights that continue to revolutionize the financial management of firms (ABA Journal, 1999). The trend begun over fifteen years of integrating customer, distribution and supply chain data into a single system of record to drive greater insights into an enterprise and therefore attain a greater clarity of decision making is a pervasive best practice across many enterprises today (Brachman, Khabaza, Kloesgen, Piatetsky-Shapiro, Simoudis, 1996). The trend has accelerated in the last three years to include Big Data and the use of Hadoop and MapReduce to better analyze and interpret large-scale data sets that are outside the range of calculating and analysis levels of existing mainstream EDW systems and platforms (Sen, Ramamurthy, Sinha, 2012). The advent of Big Data is already beginning to reshape how decisions are made in enterprises, even though this specific technology, considered part of the highest-growing areas of EDW and data mining, is nascent and in the first phase of its industry lifecycle (Sen, Ramamurthy, Sinha, 2012). One of the most promising aspects of this trend is the development of more comprehensive and strategic Business Intelligence (BI) platforms as shown in Figure 1, The Impact of EDW and Data Mining Systems on CRM Analytics. The integration of these factors will continue to have an additive effect on the level of insight and intelligence enterprises will be able to use over time.
Figure 1: The Impact of EDW & Data Mining Systems on CRM Analytics
Based on analysis of the following sources: (Brachman, Khabaza, Kloesgen, Piatetsky-Shapiro, Simoudis, 1996) (Fay, Zahay, 2003) (Fong, Wong, 2002) (Marks, Frolick, 2001) (Sutherland, 2003)
Of the many companies that are successfully using EDW and data mining today, two of the more noteworthy ones are Continental Airlines (Watson, Wixom, Hoffer, 2006) and Toyota in their world-famous supply chain management system, the Toyota Production System (TPS)(Dyer, Nobeoka, 2000). Both of these company’s best practices are briefly described in this analysis starting with the impressive use of EDW, data mining and predictive modeling completed by Continental. The well-known airline had recently emerged from bankruptcy, and one of the more valuable lessons learned from that experience was how disconnected the entire enterprise was from its customers. In 1988 Continental launched its Go Forward Initiative, which sought to unify the diverse and disparate systems across the company, bringing together the foundation of its MDM and EDW architectures. Spending $30M for the entire series of software, hardware and systems and generating a $500M increase in combined cost savings and revenue growth, Continental hailed this IT strategy as the most successful in the company’s history (Watson, Wixom, Hoffer, 2006). Using this system the company was able to, for the first time, integrate their many airline and maintenance operations processes with CRM, accounting, finance and security systems to ensure real-time 360-degree views of the customer and the entire operations process. This ensures that flight staffing, planning and gross margin analysis are all synchronized to a common set of metrics and key performance indicators (Watson, Wixom, Hoffer, 2006). Continental went on to optimize their entire operations using the lessons learned regarding analytics and metrics from their investments in EDW and data mining, trimming entire routes and increasing customer satisfaction and profitability in the process (Watson, Wixom, Hoffer, 2006). Another company who has successfully transitioned from being managed to metrics that lagged the performance of their supply chain, services and had a corresponding impact on their new product launch strategies is Toyota and the TPS system they use for global procurement and supply chain management (Dyer, Nobeoka, 2000). Toyota has taken the approach of quantifying overall supplier performance, rank-ordering it on a series of dashboards and scorecards, and using Six Sigma, evaluate overall performance across all product lines. The intent of this is to ascertain how best to augment and increase the knowledge across the organization to transform it into a competitive asset (Dyer, Nobeoka, 2000). It is a best practice to use an EDW and data mining platform to create a knowledge management system, coupling quantified metrics and those that are more aligned to process-based performance (Sen, Ramamurthy, Sinha, 2012). The TPS system can manage a new product introduction in as little as 26 weeks’ time when necessary, by far the quickest in the auto industry (Dyer, Nobeoka, 2000). It can also troubleshoot quality to the production lot literally in seconds. The lapses in product quality that occurred in the last few years on core product liens, Toyota was able to use the analytics of the TPS and troubleshoot down to the factory level, finding plant managers had neglected to use Six Sigma incoming inspection practices to track overall quality (Dyer, Nobeoka, 2000). This example is admittedly unique in that it blends the ability to manage knowledge while also creating a quality management system that is predicated on knowledge creation over pure compliance reporting.
Data Warehousing and Data Mining Optimization Techniques
The emerging nature of EDW and data mining optimization techniques is emerging rapidly due to the increasing use of constraint-based modeling platforms (Sen, Ramamurthy, Sinha, 2012). Constraint-based modeling is predicated on a series of parameter sets that continually optimize the levels of selections made throughout an EDW including the MDM repositories as defined previously in this paper. The use of constraint-based modeling is making it possible for Web-based applications to populate and propagate analytics, predictive models and performance analyses across enterprises regardless of device. An effective optimization would be able to create an entire series of options for a specific strategic decision or option in real time and display the results across the enterprise literally within seconds (Sen, Ramamurthy, Sinha, 2012). The progression from rules-based to constraint-driven EDW and data mining modeling is also predicated on an entirely new class of presentation and Application Programmer Interface (API) technologies as well, all aimed at streamlining this aspect of EDW use in decision making and support (Sen, Ramamurthy, Sinha, 2012).
Recommendations for Storage Solutions
Faced with a rapidly growth data set of 20TB with a projected growth of 20% per year, the best possible solution is to choose a hardware platform purpose-built for EDW and data mining. The Oracle Exadata Database Machine would be the best possible option, as it support 160 CPU cores and 4 TB of memory for database processing, can be configured as two logical database servers and can support up to 224TB per server racks in a multi-rack configuration. The Oracle Exadata Database Machine would be ideally suited for this specific task, and it also has a series of bundles of Oracle EDW, data mining and predictive analytics included. It can also be configured as a private cloud server, offering MDM functionality and support across an entire enterprise (Stonebraker, 2011).
Analysis of Data Warehouse Workflows
Based on the study of EDW and data mining the following schematic has been defined based on an analysis of the Continental Airlines Go Forward Initiative (Watson, Wixom, Hoffer, 2006). The structure of this replicates how Continental had created a unique MDM platform to support enterprise-wide visibility of their operations.
References
Applications to “visualize” the data stream. (1999). American Bankers Association.ABA Banking Journal, 91(3), 56-56.
Brachman, R.J., Khabaza, T., Kloesgen, W., Piatetsky-Shapiro, G., & Simoudis, E. (1996). Mining business databases. Association for Computing Machinery.Communications of the ACM, 39(11), 42-48.
Jeffrey H. Dyer, & Kentaro Nobeoka. (2000). Creating and managing a high-performance knowledge-sharing network: The Toyota case. Strategic Management Journal: Special Issue: Strategic Networks, 21(3), 345-367.
Fay, C.P., & Zahay, D. (2003). Understanding why marketing does not use the corporate data warehouse for CRM applications. Journal of Database Marketing & Customer Strategy Management, 10(4), 315-326.
Fong, J., & Wong, H.K. (2002). Online analytical mining of path traversal patterns for web measurement. Journal of Database Management, 13(4), 39-61.
Forcht, K.A., & Cochran, K. (1999). Using data mining and datawarehousing techniques. Industrial Management + Data Systems, 99(5), 189-196.
Lei-da, C., & Frolick, M.N. (2000). Web-based data warehousing. Information Systems Management, 17(2), 80-86.
Marks, W.T., & Frolick, M.N. (2001). Building customer data warehouses for a marketing and service environment: A case study. Information Systems Management, 18(3), 51-56.
Paas, L.J. (2009). Database marketing practices and opportunities in a newly emerging african market. Journal of Database Marketing & Customer Strategy Management, 16(2), 92-100.
Sen, A., Ramamurthy, K. (., & Sinha, A.P. (2012). A model of data warehousing process maturity. IEEE Transactions on Software Engineering, 38(2), 336-353.
Stonebraker, M. (2011). Stonebraker on data warehouses. Association for Computing Machinery.Communications of the ACM, 54(5), 10.
Sutherland, K. (2003). How to use your database or data warehouse of profitability information to make better marketing decisions. Journal of Performance Management, 16(1), 25-30.
Watson, H., Ariyachandra, T., & Matyska, Robert J.,,Jr. (2001). Data warehousing stages of growth. Information Systems Management, 18(3), 42-50.
Hugh J. Watson, Barbara H. Wixom, Jeffrey A Hoffer, Ron Anderson-Lehman, Anne Marie Reynolds. “Real-Time Business Intelligence: Best Practices at Continental Airlines.” Information Systems Management 23, no. 1 (January 1, 2006): 7-18.
Get Professional Assignment Help Cheaply
Are you busy and do not have time to handle your assignment? Are you scared that your paper will not make the grade? Do you have responsibilities that may hinder you from turning in your assignment on time? Are you tired and can barely handle your assignment? Are your grades inconsistent?
Whichever your reason is, it is valid! You can get professional academic help from our service at affordable rates. We have a team of professional academic writers who can handle all your assignments.
Why Choose Our Academic Writing Service?
- Plagiarism free papers
- Timely delivery
- Any deadline
- Skilled, Experienced Native English Writers
- Subject-relevant academic writer
- Adherence to paper instructions
- Ability to tackle bulk assignments
- Reasonable prices
- 24/7 Customer Support
- Get superb grades consistently
Online Academic Help With Different Subjects
Literature
Students barely have time to read. We got you! Have your literature essay or book review written without having the hassle of reading the book. You can get your literature paper custom-written for you by our literature specialists.
Finance
Do you struggle with finance? No need to torture yourself if finance is not your cup of tea. You can order your finance paper from our academic writing service and get 100% original work from competent finance experts.
Computer science
Computer science is a tough subject. Fortunately, our computer science experts are up to the match. No need to stress and have sleepless nights. Our academic writers will tackle all your computer science assignments and deliver them on time. Let us handle all your python, java, ruby, JavaScript, php , C+ assignments!
Psychology
While psychology may be an interesting subject, you may lack sufficient time to handle your assignments. Don’t despair; by using our academic writing service, you can be assured of perfect grades. Moreover, your grades will be consistent.
Engineering
Engineering is quite a demanding subject. Students face a lot of pressure and barely have enough time to do what they love to do. Our academic writing service got you covered! Our engineering specialists follow the paper instructions and ensure timely delivery of the paper.
Nursing
In the nursing course, you may have difficulties with literature reviews, annotated bibliographies, critical essays, and other assignments. Our nursing assignment writers will offer you professional nursing paper help at low prices.
Sociology
Truth be told, sociology papers can be quite exhausting. Our academic writing service relieves you of fatigue, pressure, and stress. You can relax and have peace of mind as our academic writers handle your sociology assignment.
Business
We take pride in having some of the best business writers in the industry. Our business writers have a lot of experience in the field. They are reliable, and you can be assured of a high-grade paper. They are able to handle business papers of any subject, length, deadline, and difficulty!
Statistics
We boast of having some of the most experienced statistics experts in the industry. Our statistics experts have diverse skills, expertise, and knowledge to handle any kind of assignment. They have access to all kinds of software to get your assignment done.
Law
Writing a law essay may prove to be an insurmountable obstacle, especially when you need to know the peculiarities of the legislative framework. Take advantage of our top-notch law specialists and get superb grades and 100% satisfaction.
What discipline/subjects do you deal in?
We have highlighted some of the most popular subjects we handle above. Those are just a tip of the iceberg. We deal in all academic disciplines since our writers are as diverse. They have been drawn from across all disciplines, and orders are assigned to those writers believed to be the best in the field. In a nutshell, there is no task we cannot handle; all you need to do is place your order with us. As long as your instructions are clear, just trust we shall deliver irrespective of the discipline.
Are your writers competent enough to handle my paper?
Our essay writers are graduates with bachelor's, masters, Ph.D., and doctorate degrees in various subjects. The minimum requirement to be an essay writer with our essay writing service is to have a college degree. All our academic writers have a minimum of two years of academic writing. We have a stringent recruitment process to ensure that we get only the most competent essay writers in the industry. We also ensure that the writers are handsomely compensated for their value. The majority of our writers are native English speakers. As such, the fluency of language and grammar is impeccable.
What if I don’t like the paper?
There is a very low likelihood that you won’t like the paper.
Reasons being:
- When assigning your order, we match the paper’s discipline with the writer’s field/specialization. Since all our writers are graduates, we match the paper’s subject with the field the writer studied. For instance, if it’s a nursing paper, only a nursing graduate and writer will handle it. Furthermore, all our writers have academic writing experience and top-notch research skills.
- We have a quality assurance that reviews the paper before it gets to you. As such, we ensure that you get a paper that meets the required standard and will most definitely make the grade.
In the event that you don’t like your paper:
- The writer will revise the paper up to your pleasing. You have unlimited revisions. You simply need to highlight what specifically you don’t like about the paper, and the writer will make the amendments. The paper will be revised until you are satisfied. Revisions are free of charge
- We will have a different writer write the paper from scratch.
- Last resort, if the above does not work, we will refund your money.
Will the professor find out I didn’t write the paper myself?
Not at all. All papers are written from scratch. There is no way your tutor or instructor will realize that you did not write the paper yourself. In fact, we recommend using our assignment help services for consistent results.
What if the paper is plagiarized?
We check all papers for plagiarism before we submit them. We use powerful plagiarism checking software such as SafeAssign, LopesWrite, and Turnitin. We also upload the plagiarism report so that you can review it. We understand that plagiarism is academic suicide. We would not take the risk of submitting plagiarized work and jeopardize your academic journey. Furthermore, we do not sell or use prewritten papers, and each paper is written from scratch.
When will I get my paper?
You determine when you get the paper by setting the deadline when placing the order. All papers are delivered within the deadline. We are well aware that we operate in a time-sensitive industry. As such, we have laid out strategies to ensure that the client receives the paper on time and they never miss the deadline. We understand that papers that are submitted late have some points deducted. We do not want you to miss any points due to late submission. We work on beating deadlines by huge margins in order to ensure that you have ample time to review the paper before you submit it.
Will anyone find out that I used your services?
We have a privacy and confidentiality policy that guides our work. We NEVER share any customer information with third parties. Noone will ever know that you used our assignment help services. It’s only between you and us. We are bound by our policies to protect the customer’s identity and information. All your information, such as your names, phone number, email, order information, and so on, are protected. We have robust security systems that ensure that your data is protected. Hacking our systems is close to impossible, and it has never happened.
How our Assignment Help Service Works
1. Place an order
You fill all the paper instructions in the order form. Make sure you include all the helpful materials so that our academic writers can deliver the perfect paper. It will also help to eliminate unnecessary revisions.
2. Pay for the order
Proceed to pay for the paper so that it can be assigned to one of our expert academic writers. The paper subject is matched with the writer’s area of specialization.
3. Track the progress
You communicate with the writer and know about the progress of the paper. The client can ask the writer for drafts of the paper. The client can upload extra material and include additional instructions from the lecturer. Receive a paper.
4. Download the paper
The paper is sent to your email and uploaded to your personal account. You also get a plagiarism report attached to your paper.
PLACE THIS ORDER OR A SIMILAR ORDER WITH US TODAY AND GET A PERFECT SCORE!!!
