References Using Current Apa Evaluation Of Advanc
Develop an 8-10 slide PowerPoint presentation that is suitable as training and evaluates the results of an analysis.
Introduction
This portfolio work project will help you evaluate the results of advanced analytics projects and identify potential errors or issues with the application of the methods or the alignment between methods and business problems, and propose possible solutions.
Scenario
Recently, the executive team in your organization has made some major business decisions based on the results of the analytics group’s projects and has seen mixed results. Some of the decisions made based on the analytics group’s results have been successful, but others have been huge failures and very costly for the organization. The executives are now questioning their trust in this group’s ability to analyze data appropriately to address business problems. They have put the analytics group into a probationary period of 90 days, after which they will decide whether to retain the advanced analytics group, or to disband the group. As head of the marketing department, they have placed you in charge of this group’s performance for the next 90 days, and have asked that you review all work that comes from this department prior to it being sent to the executives.
You will apply this scenario to either Option A or Option B described in the Requirements section.
Your Role
You are the head of the marketing department and have been placed in charge of the analytics group for their 90-day probationary period. You are now responsible for the quality, accuracy, and reliability of the results reported out from the analytics group, and are responsible for reviewing all work prior to it being presented to the executive committee.
Requirements
Choose one of the following options:
Option A
An analyst has conducted an A/B test to compare the revenue per visitor for the same banner ad media run on two different websites. The results of this analysis are included here. You have decided to evaluate the results and use it as an example in a training session for the analytics group on how to conduct a critical evaluation of results from an analysis.
Resources:
Option B
An analyst has run a regression analysis to attempt to predict whether someone will pre-pay their car loan (resulting in a loss of interest revenue for the organization). The results of this analysis are included here. You have decided to evaluate the results and use the evaluation as an example in a training session for the analytics group on how to conduct a critical evaluation of results from an analysis.
Resources:
For Either Option A or B
Using the data provided for the option you have selected, evaluate the results of the analysis, paying attention to the alignment of the method selected to the business problem being addressed, the testing of assumptions required to use the selected method, and potential issues with generalizations, and the usability of the results.
Create a training presentation that includes:
- Evaluate the alignment of the method selected to the business problem being addressed.
- Evaluate whether the requirements to use the selected method were checked. Were the assumptions met?
- Evaluate potential issues with the generalization and usability of the results. Were they included in the analysis results?
- Propose methods to address any issues that arise from the evaluation process.
Deliverable Format
Training presentation requirements:
- 8–10 slides outlining the evaluation process.
- Include additional details as slide notes.
- Title slide.
- References slide.
- APA-formatted references.
- At least 3 supporting resources.
Evaluation
By successfully completing this assessment, you will demonstrate your proficiency in the course competency through the following assessment scoring guide criteria:
- Competency 3: Analyze data using appropriate techniques to support business decision making.
- Evaluate the alignment of the analytic method to the business problem being addressed.
- Evaluate whether the requirements to use the method were checked.
- Evaluate potential issues with generalization and usability of the results of an analysis.
- Propose methods to address any issues that arise from an evaluation process.
- Competency 4: Present the results of advanced data analysis in clear and meaningful ways to multiple stakeholders in support of business decisions.
- Correctly format citations and references using current APA style.
- Develop a presentation that is well-organized and appropriate for the intended audience.
Faculty will use the scoring guide to review your deliverable as if they were a member of your team. Review the scoring guide prior to developing and submitting your assessment.
Criteria | Non-performance | Basic | Proficient | Distinguished |
---|---|---|---|---|
Evaluate the alignment of the analytic method to the business problem being addressed. | Does not evaluate the alignment of the analytic method to the business problem being addressed. | Explains the importance of the analytic method aligning to the business problem being addressed. | Evaluates the alignment of the analytic method to the business problem being addressed. | Evaluates the alignment of the analytic method to the business problem being addressed and explains how the method does or does not align to the business problem. |
Evaluate whether the requirements to use the method were checked. | Does not evaluate whether the requirements to use the method were checked. | Explains how to check the requirements to use the method. | Evaluates whether the requirements to use the method were checked. | Evaluates whether the requirements to use the method were checked and if assumptions were met. |
Evaluate potential issues with generalization and usability of the results of an analysis. | Does not evaluate potential issues with generalization and usability of the results of an analysis. | Explains potential issues with generalization and usability of the results of an analysis. | Evaluates potential issues with generalization and usability of the results of an analysis. | Evaluates potential issues with generalization and usability of the results of an analysis and explains why this information needs to be included with analysis results. |
Propose methods to address any issues that arise from an evaluation process. | Does not propose methods to address any issues that arise from an evaluation process. | Identifies methods to address any issues that arise from an evaluation process but does not propose specific methods. | Proposes methods to address any issues that arise from an evaluation process. | Proposes methods to address any issues that arise from an evaluation process and supports with relevant evidence. |
Correctly format citations and references using current APA style. | Does not correctly format citations and references using current APA style. | Uses current APA to format citations and references but with numerous errors. | Correctly formats citations and references using current APA style with few errors. | Correctly formats citations and references using current APA style with no errors. |
Develop a presentation that is well-organized and appropriate for the intended audience. | Does not develop a presentation that is well-organized and appropriate for the intended audience. | Develops a presentation that is disorganized and not written at the appropriate level for the intended audience. | Develops a presentation that is well-organized and appropriate for the intended audience. | Develops a presentation that is logical, well-organized, concise, and appropriate for the intended audience. |