OnlineNursingOwl
← All nursing posts

Psychology · Studypool

Evaluation of Technical Quality

Post ID: 3470970

Locate and summarize a minimum of two articles related to the technical qualities for each of three previously selected tests.

Collapse All

Introduction

Note: Synthesizing the evaluation of test technical quality requires specific steps that must be carried out in a certain order. Therefore, you must complete the assessments in this course in the order in which they are presented.

Professionals in the field must be able to administer and interpret tests to establish a diagnosis and determine a treatment plan. Before a test is selected, test users must be knowledgeable of the technical quality (reliability and validity) of the tests they use. Test users should only use instruments with adequate reliability and validity.

In this assessment, you will complete a deeper analysis of the technical quality of your three selected tests from Assessment 1 by focusing on reliability and validity evidence. To complete this assessment, you will draw upon your knowledge about psychometrics in general and reliability and validity in particular.

Preparation

Download the Assessment 2 Template: Evaluation of Technical Quality [DOCX] and use it as the basis of your assessment. The template contains instructions to guide you through each element of the assessment.

For this assessment, you will conduct a deeper analysis of the technical quality of the three tests you selected for Assessment 1.

Instructions

For Assessment 1, you selected three standardized tests from one category that have relevance to your specialization or a related profession. Assessment 1 focused on the purpose, contents and constructs assessed, norms, and required training of psychological tests. For this assessment, you will complete a deeper analysis of the technical quality of your three selected tests by focusing on reliability and validity evidence. To complete this assessment, you will draw upon your knowledge about psychometrics in general and reliability and validity in particular. You are encouraged to use the PSY-FP7610 – Tests and Measurements Library Guide to assist your search.

For each article:

  • List the APA reference for each journal article (a minimum of six).
  • Identify if the article addresses reliability or validity.
  • Discuss if the article addresses sources of error variance, reliability estimates, evidence of validity, or bias and fairness.
  • Identify the specific type of reliability or validity (for example, test-retest reliability, predictive validity, etc.).
  • Identify the overall results of the research, including any psychometric or statistical outcome.

Guidelines for Selecting the Literature

Use the most current sources you can find. You may cite older sources if they are classics, if you want to show the chronology of something, or if you have another good reason (i.e., the test was published more than eight years ago) If you choose to use older sources, you will need to explain why. Use current, peer-reviewed journal articles for more current tests. Do not use sources without an author or a publication date. Do not use quotes; use only your own words. Evaluate whether the results support the use of your test as appropriate for your field and populations to be served.

Note: The articles you need to complete this assessment should be available as part of the library collection. In future courses, you may use the Capella library's Interlibrary Loan service to obtain articles outside of the collection, but you should not have to use the service for this course. In the event that you cannot find articles covering a newer test edition, please refer to the List of Tests by Type [DOCX]. Note which tests have been designated as acceptable for searching prior test editions.

Note: Be sure to use the Assessment 2 Template: Evaluation of Technical Quality [DOCX].

Additional Requirements

Your assessment should meet the following requirements:

  • Template: Use the Assessment 2 Template: Evaluation of Technical Quality [DOCX] to complete the assessment.
  • References: A minimum of six peer-reviewed journal articles (textbooks, websites, literature reviews, and the MMY book reviews do not count for these references). Three of the articles must discuss reliability and three must discuss validity.
  • Length of paper: A minimum of six double-spaced pages of content, not including the title page or references (an abstract is not required).
  • Font and font-size: Times New Roman, 12 point.
  • APA format: Current APA format and style is required throughout. Refer to Academic Writer for guidance on APA style and format as you prepare all of your assessments for this course.

Competencies Measured

By successfully completing this assessment, you will demonstrate your proficiency in the following course competencies and scoring guide criteria:

  • Competency 2: Analyze key psychometric properties related to tests and measurement, with an emphasis on reliability and validity.
    • Review the reliability evidence for three tests and support the analysis by citing at least two peer-reviewed journal articles for each test.
    • Review the validity evidence for three tests and support the analysis by citing at least two peer-reviewed journal articles for each test.
    • Synthesize information from the articles to evaluate the current technical quality of three tests and their status as appropriate quality tools in the field.
  • Competency 7: Communicate in a manner that is scholarly, professional, and consistent with expectations for members of the psychological profession.
    • Communicate in a manner that is scholarly, professional, and consistent with the expectations for members of an identified field of study, using APA style and formatting. Use the resources linked below to help complete this assessment.Collapse All

      Mental Measurements Yearbook

      The following can help guide you through using the Mental Measurements Yearbook.

      Test and Instrument Reliability

      • Cohen, R. J., Schneider, W.J., & Tobin, R. (2022). Psychological testing and assessment: An introduction to tests and measurement (10th ed.). McGraw-Hill. Available in the courseroom via the VitalSource Bookshelf Link.
        • Chapter 5, "Reliability," pages 157–192.
          • This chapter includes information relevant to reliability.
      • Capella University Library Database: Mental Measurements Yearbook.
        • Reviews from this database provide information about the reliability of your chosen test/instrument.
      • Groth-Marnat, G., & Wright, A. J. (2016). Handbook of psychological assessment (6th ed.). John Wiley & Sons.
        • This text may provide reliability information about some specific tests or instruments.
      • Urbina, S. (2014). Essentials of psychological testing. John Wiley & Sons.
        • Chapter 4, "Essentials of Reliability," pages 127–164.
          • This chapter includes information relevant to reliability.
      • Salkind, N. J. (2007). Encyclopedia of measurement and statistics. SAGE.
        • The section "Concepts and Issues in Measurement" includes information relevant to reliability.
      • Capella media:
        • The following media pieces provide information on reliability and correlation:
          • Correlation: Measuring the Relationship Between Two Sets of Numbers.
          • Reliability.
          • Reliability Exercise.
      • Conybeare, D., Behar, E., Solomon, A., Newman, M. G., & Borkovec, T. D. (2012). The PTSD Checklist-Civilian version: Reliability, validity, and factor structure in a nonclinical sample. Journal of Clinical Psychology, 68(6), 699–713.
        • This article is an example of a study evaluating reliability of an instrument. Search Google Scholar or the Capella library for articles relevant to your chosen test/instrument.

      Test and Instrument Validity

      • Cohen, R. J., Schneider, W.J., & Tobin, R. (2022). Psychological testing and assessment: An introduction to tests and measurement (10th ed.). McGraw-Hill. Available in the courseroom via the VitalSource Bookshelf Link.
        • Chapter 6, "Validity," pages 193–220.
          • This chapter includes information relevant to validity.
      • Capella University Library Database: Mental Measurements Yearbook.
        • Reviews from this database provide information about the validity of your chosen test or instrument.
      • Groth-Marnat, G., & Wright, A. J. (2016). Handbook of psychological assessment (6th ed.). John Wiley & Sons.
        • This text may provide validity information about some specific tests or instruments.
      • Capella Media:
        • Validity.
      • Diener, E., Inglehart, R., & Tay, L. (2013). Theory and validity of life satisfaction scales [PDF]. Social Indicators Research, 112(3), 497–527.
        • This article is an example of a study reviewing the validity of an instrument. Search the Capella library or Google Scholar for articles relevant to your chosen test or instrument.

      Ethics of Tests and Instruments

      • Cohen, R. J., Schneider, W.J., & Tobin, R. (2022). Psychological testing and assessment: An introduction to tests and measurement (10th ed.). McGraw-Hill. Available in the courseroom via the VitalSource Bookshelf link.
        • Chapter 2, "Historical, Cultural, and Legal/Ethical Considerations," pages 41–84.
          • This chapter includes information relevant to legal and ethical issues in testing or assessment.
      • American Psychological Association. (2010). Ethical principles of psychologists and code of conduct. http://www.apa.org/ethics/code/index.aspx
        • Use sections 2 and 9 for information on ethical issues and assessment.
      • National Association of School Psychologists. (2010). Principles for professional ethics [PDF]. http://www.nasponline.org/
        • Ethical issues in this resource may overlap with issues relating to test user responsibilities.
      • Urbina, S. (2014). Essentials of psychological testing (2nd ed.). Wiley.
        • Chapter 7, "Essentials of ethical test use," pages 318–322.
          • This chapter includes information relevant to ethical assessment.
      • Salkind, N. J. (2007). Encyclopedia of measurement and statistics. SAGE.
        • The section "Ethical Issues in Testing" includes information that may be helpful.