Validity, Reliability, and Credibility in Research

Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research© 2014 John Wiley & Sons, Inc. All rights reserved.Learning ObjectivesExplain what a scholarly article isDifferentiate between CPR and LOAF elements of a scholarly articlesAnalyze the relative merits of various scholarly articlesUse various search engines to find scholarly articlesIdentify an area of research interestDiscriminate between scholarly articles and other publications© 2014 John Wiley & Sons, Inc. All rights reserved.Key TermsConcurrent validityConvergent validityConstruct validityContent validityCriterion validityCredibilityDependent variableDiscriminant validityEquivalent form reliabilityExternal validityFace validityGeneral validityGolem effectIndependent variableInstrumentationInstrument validityInternal consistency reliability© 2014 John Wiley & Sons, Inc. All rights reserved.Key Terms(cont’d)Internal validityIntervening variableInter-rater reliabilityModerating variableOperational definitionPredictive validityPygmalion effectReliabilityTestingTest-retest reliability© 2014 John Wiley & Sons, Inc. All rights reserved.Internal CredibilityBelievabilityTrustworthinessSpecificity© 2014 John Wiley & Sons, Inc. All rights reserved.ValidityContent validityFace validityConstruct validityCriterion validityPredictive validity Discriminant validity © 2014 John Wiley & Sons, Inc. All rights reserved.VariablesIndependent variableDependent variableConfounding (moderating) variableIntervening variableOperationalizing the variables© 2014 John Wiley & Sons, Inc. All rights reserved.ValidityInternalExternalGeneral validityInstrumental validityTo what extent can you apply the insights to other situations?© 2014 John Wiley & Sons, Inc. All rights reserved.Internal ValidityTo what extent is your research design really focused on the problem statement you have?Will you collect and analyze relevant and accurate information?How can you be sure that your design answers your research questions?What aspects of the design can you create to ensure validity?© 2014 John Wiley & Sons, Inc. All rights reserved.Forms of Instrument ValidityContent validityConstruct validityCriterion validityDiscriminant validityFace validityPredictive validity© 2014 John Wiley & Sons, Inc. All rights reserved.External ValidityTo what extent does the literature review place your expected findings within a broader context?Will you be able to generalize from what you find?What limitations or qualifications will you have to make about your results?How can you extend your findings and suggest opportunities for further research so that you protect its validity?How does previous research help you interpret your results?Does previous research provide a rationale for your research design and suggestions about the applicability of your findings?© 2014 John Wiley & Sons, Inc. All rights reserved.Threats to ValidityAmbiguityHistoryInstrumentationMortalityMaturationTesting© 2014 John Wiley & Sons, Inc. All rights reserved.ReliabilityTypesEquivalent form reliabilityInternal consistency reliabilityInter-rater reliabilityTest-retest reliability© 2014 John Wiley & Sons, Inc. All rights reserved.Review of Class SessionAnything unclear?One thing that I was amazed by in sampling is © 2014 John Wiley & Sons, Inc. All rights reserved.