NURSING RESEARCH CRITIQUE PROCESS FOR QUANTITATIVE STUDIES
I. COMPREHENSIONNURSING RESEARCH CRITIQUE PROCESS FOR QUANTITATIVE STUDIES
I. COMPREHENSIONNURSING RESEARCH CRITIQUE PROCESS FOR QUANTITATIVE STUDIES
I. COMPREHENSION
A. States the problem
1. Is the problem sufficiently delimited in scope without being trivial? 2. Is the problem significant to nursing? 3. Does the problem have a gender bias? B. States the purpose
1. Does the purpose narrow and clarify the aim of the study?
C. Examine the literature review 1. Are relevant previous studies and theories described? 2. Is the literature review organized to demonstrate the progressive development of ideas through previous research? 3. Is a theoretical knowledge base developed for the problem or purpose? 4. Does the literature review provide rationale and direction for the study? 5. Are the references current? 6. Is the current knowledge about the research problem described, including what is known and not known? 7. Is the literature review clearly linked with the research questions, theory and hypothesis? D. Study framework
1. Is the framework explicitly and clearly expressed? 2. Is the framework linked to the research purpose? 3. Is the framework based on substantive theory or a tentative theory? 4. Is the theory related to nursing’s body of knowledge? 5. Does the framework describe and define the concepts of interest, show relationships among the concepts, and relate them to the variables in the study?. 6. Is there a map that describes or represents the study’s framework? E. The research objectives, questions and hypothesis 1. Are they clearly listed and expressed clearly? 2. Do they match the framework established? 3. Are they logically linked to the research purpose and Framework? F. Study variables and concepts
1. What are the independent variables? 2. What are the dependant variables? 3. What are the research variables or concepts? 4. What are the extraneous variables and are they clearly identified? 5. Are the variables reflective of the concepts identified in the framework? G. The research design
1. What is the design if this study?
2. Is this the most appropriate design to obtain the needed data? 3. Does the design provide a means to examine all the objectives, questions, or hypothesis? 4. Is there a drawing of the design or can you do one from the description? 5. What is the treatment or intervention (if appropriate to the design), is it clearly described? 6. Have any threats to the design validity been minimized?
7. Was there or is a pilot study planned.? 8. Is the design logically linked to the sampling method and statistical analysis? H. The sample, population and setting.
1. What was the sampling criteria? 2. What was the sample size?, 3. How was the sample size determined and was a power analysis used?. 4. Is the size sufficient to avoid Type II error? 5. What are the characteristics of the sample? 6. Was there or will there possibility be any mortality to the sample and how might this influence the findings? 7. How was the sample obtained (or will be obtained) and is it adequate to produce a representative sample? 8. If there is more than one group is used, do the groups appear equivalent? 9. Is there sample consent form and does it meet the ethical and IRB standards.? 10. Is the setting used in the study typical of clinical settings? I. What were the measurement strategies? 1. What measurement approaches are being used? a. Scales and questionnaires b. Observation c. Interviews d. Physiologic measures 2. What tools were used and who were the authors? 3. What is the reliability and validity of the instrument or other methods to insure validity of the measurement techniques? 4. How was the instrument originally used? 5. Do the instruments or methods adequately measure the study variables? J. What are the data collection procedures? 1. Is the data collection process clearly described? 2. Are the data collection instruments adequate for the study ? 3. Are the forms used to collect data organized to facilitate computerizing the data? 4. Does the codebook reflect all the information to be collected by the data collection instruments and the study as a whole? 5. Are the data collection methods ethical? 6. Do the data collected address the research objectives, questions or hypothesis?
K. Is the statistical analysis plan provided? 1. Are the data analysis procedures appropriate to the type of data collected? 2. Are the data analysis procedures clearly described? 3. What statistical tools are planned (or done) for this study.? 4. Are the statistics descriptive or inferential? 5. List the statistical procedures for each research objective, question or hypothesis.? 6. Are the statistical analysis logically linked to the design? 7. Are the analysis interpreted appropriately (where applicable)? L. What are the study’s limitations?
M. How does the researcher plan to generalize the findings?
N. What are the implications for nursing?
O. What suggestions might there be for further studies?
P. Is this study sufficiently clear to replicate it?.
Q. Describe the researcher’s interpretation of the actual or potential findings? 1. Are the findings related back to the study framework? 2. Were the findings expected? 3. Are the findings consistent with previous research findings? II COMPARISON
A. Did the researcher follow the rules for an ideal study? B. How clearly did the researcher grasp the study situation? III ANALYSIS
A. Is there an overall flow of logic in the study? B. Does the problem provide background and direction for the statement of the purpose?. C. Are the variables identified in the purpose consistent with the variables identified in the research objective, questions or hypothesis.? D. Do the conceptual definitions provide an adequate basis for the development of the operational definitions.? IV EVALUATION
A. What rival hypothesis can be suggested for the findings? B. How much confidence can be placed in the study findings? C. To what populations can the findings be generalized? D. What questions emerge from the findings and are these identified by the researcher? E. What future research can be envisioned? F. Could the limitations of the study have been corrected? G. When the findings are examined based on previous studies, what is now known and not known about the phenomenon under study? V CONCEPTUAL CLUSTERING
A. Is the knowledge obtained summarized and organized theoretically? B. Can a map be drawn showing the concepts and relationships found in the study? C. Is there sufficient confidence in the findings to use them in nursing practice? D. How will patient outcomes be affected by utilization of the findings? E. Can meta-analysis be used on this and other similar studies to determine what is currently known about a phenomenon? A. States the problem 1. Is the problem sufficiently delimited in scope without being trivial? 2. Is the problem significant to nursing? 3. Does the problem have a gender bias? B. States the purpose 1. Does the purpose narrow and clarify the aim of the study? C. Examine the literature review 1. Are relevant previous studies and theories described? 2. Is the literature review organized to demonstrate the progressive development of ideas through previous research? 3. Is a theoretical knowledge base developed for the problem or purpose? 4. Does the literature review provide rationale and direction for the study? 5. Are the references current? 6. Is the current knowledge about the research problem described, including what is known and not known? 7. Is the literature review clearly linked with the research questions, theory and hypothesis? D. Study framework 1. Is the framework explicitly and clearly expressed? 2. Is the framework linked to the research purpose? 3. Is the framework based on substantive theory or a tentative theory? 4. Is the theory related to nursing’s body of knowledge? 5. Does the framework describe and define the concepts of interest, show relationships among the concepts, and relate them to the variables in the study?. 6. Is there a map that describes or represents the study’s framework? E. The research objectives, questions and hypothesis 1. Are they clearly listed and expressed clearly? 2. Do they match the framework established? 3. Are they logically linked to the research purpose and Framework? F. Study variables and concepts 1. What are the independent variables? 2. What are the dependant variables? 3. What are the research variables or concepts? 4. What are the extraneous variables and are they clearly identified? 5. Are the variables reflective of the concepts identified in the framework? G. The research design 1. What is the design if this study? 2. Is this the most appropriate design to obtain the needed data? 3. Does the design provide a means to examine all the objectives, questions, or hypothesis? 4. Is there a drawing of the design or can you do one from the description? 5. What is the treatment or intervention (if appropriate to the design), is it clearly described? 6. Have any threats to the design validity been minimized? 7. Was there or is a pilot study planned.? 8. Is the design logically linked to the sampling method and statistical analysis? H. The sample, population and setting. 1. What was the sampling criteria? 2. What was the sample size?, 3. How was the sample size determined and was a power analysis used?. 4. Is the size sufficient to avoid Type II error? 5. What are the characteristics of the sample? 6. Was there or will there possibility be any mortality to the sample and how might this influence the findings? 7. How was the sample obtained (or will be obtained) and is it adequate to produce a representative sample? 8. If there is more than one group is used, do the groups appear equivalent? 9. Is there sample consent form and does it meet the ethical and IRB standards.? 10. Is the setting used in the study typical of clinical settings? I. What were the measurement strategies? 1. What measurement approaches are being used? a. Scales and questionnaires b. Observation c. Interviews d. Physiologic measures 2. What tools were used and who were the authors? 3. What is the reliability and validity of the instrument or other methods to insure validity of the measurement techniques? 4. How was the instrument originally used? 5. Do the instruments or methods adequately measure the study variables? J. What are the data collection procedures? 1. Is the data collection process clearly described? 2. Are the data collection instruments adequate for the study ? 3. Are the forms used to collect data organized to facilitate computerizing the data? 4. Does the codebook reflect all the information to be collected by the data collection instruments and the study as a whole? 5. Are the data collection methods ethical? 6. Do the data collected address the research objectives, questions or hypothesis? K. Is the statistical analysis plan provided? 1. Are the data analysis procedures appropriate to the type of data collected? 2. Are the data analysis procedures clearly described? 3. What statistical tools are planned (or done) for this study.? 4. Are the statistics descriptive or inferential? 5. List the statistical procedures for each research objective, question or hypothesis.? 6. Are the statistical analysis logically linked to the design? 7. Are the analysis interpreted appropriately (where applicable)? L. What are the study’s limitations? M. How does the researcher plan to generalize the findings? N. What are the implications for nursing? O. What suggestions might there be for further studies? P. Is this study sufficiently clear to replicate it?. Q. Describe the researcher’s interpretation of the actual or potential findings? 1. Are the findings related back to the study framework? 2. Were the findings expected? 3. Are the findings consistent with previous research findings? II COMPARISON A. Did the researcher follow the rules for an ideal study? B. How clearly did the researcher grasp the study situation? III ANALYSISNURSING RESEARCH CRITIQUE PROCESS FOR QUANTITATIVE STUDIES
I. COMPREHENSION A. States the problem 1. Is the problem sufficiently delimited in scope without being trivial? 2. Is the problem significant to nursing? 3. Does the problem have a gender bias? B. States the purpose 1. Does the purpose narrow and clarify the aim of the study? C. Examine the literature review 1. Are relevant previous studies and theories described? 2. Is the literature review organized to demonstrate the progressive development of ideas through previous research? 3. Is a theoretical knowledge base developed for the problem or purpose? 4. Does the literature review provide rationale and direction for the study? 5. Are the references current? 6. Is the current knowledge about the research problem described, including what is known and not known? 7. Is the literature review clearly linked with the research questions, theory and hypothesis? D. Study framework 1. Is the framework explicitly and clearly expressed? 2. Is the framework linked to the research purpose? 3. Is the framework based on substantive theory or a tentative theory? 4. Is the theory related to nursing’s body of knowledge? 5. Does the framework describe and define the concepts of interest, show relationships among the concepts, and relate them to the variables in the study?. 6. Is there a map that describes or represents the study’s framework? E. The research objectives, questions and hypothesis 1. Are they clearly listed and expressed clearly? 2. Do they match the framework established? 3. Are they logically linked to the research purpose and Framework? F. Study variables and concepts 1. What are the independent variables? 2. What are the dependant variables? 3. What are the research variables or concepts? 4. What are the extraneous variables and are they clearly identified? 5. Are the variables reflective of the concepts identified in the framework? G. The research design 1. What is the design if this study? 2. Is this the most appropriate design to obtain the needed data? 3. Does the design provide a means to examine all the objectives, questions, or hypothesis? 4. Is there a drawing of the design or can you do one from the description? 5. What is the treatment or intervention (if appropriate to the design), is it clearly described? 6. Have any threats to the design validity been minimized? 7. Was there or is a pilot study planned.? 8. Is the design logically linked to the sampling method and statistical analysis? H. The sample, population and setting. 1. What was the sampling criteria? 2. What was the sample size?, 3. How was the sample size determined and was a power analysis used?. 4. Is the size sufficient to avoid Type II error? 5. What are the characteristics of the sample? 6. Was there or will there possibility be any mortality to the sample and how might this influence the findings? 7. How was the sample obtained (or will be obtained) and is it adequate to produce a representative sample? 8. If there is more than one group is used, do the groups appear equivalent? 9. Is there sample consent form and does it meet the ethical and IRB standards.? 10. Is the setting used in the study typical of clinical settings? I. What were the measurement strategies? 1. What measurement approaches are being used? a. Scales and questionnaires b. Observation c. Interviews d. Physiologic measures 2. What tools were used and who were the authors? 3. What is the reliability and validity of the instrument or other methods to insure validity of the measurement techniques? 4. How was the instrument originally used? 5. Do the instruments or methods adequately measure the study variables? J. What are the data collection procedures? 1. Is the data collection process clearly described? 2. Are the data collection instruments adequate for the study ? 3. Are the forms used to collect data organized to facilitate computerizing the data? 4. Does the codebook reflect all the information to be collected by the data collection instruments and the study as a whole? 5. Are the data collection methods ethical? 6. Do the data collected address the research objectives, questions or hypothesis? K. Is the statistical analysis plan provided? 1. Are the data analysis procedures appropriate to the type of data collected? 2. Are the data analysis procedures clearly described? 3. What statistical tools are planned (or done) for this study.? 4. Are the statistics descriptive or inferential? 5. List the statistical procedures for each research objective, question or hypothesis.? 6. Are the statistical analysis logically linked to the design? 7. Are the analysis interpreted appropriately (where applicable)? L. What are the study’s limitations? M. How does the researcher plan to generalize the findings? N. What are the implications for nursing? O. What suggestions might there be for further studies? P. Is this study sufficiently clear to replicate it?. Q. Describe the researcher’s interpretation of the actual or potential findings? 1. Are the findings related back to the study framework? 2. Were the findings expected? 3. Are the findings consistent with previous research findings? II COMPARISON A. Did the researcher follow the rules for an ideal study? B. How clearly did the researcher grasp the study situation? III ANALYSIS A. Is there an overall flow of logic in the study? B. Does the problem provide background and direction for the statement of the purpose?. C. Are the variables identified in the purpose consistent with the variables identified in the research objective, questions or hypothesis.? D. Do the conceptual definitions provide an adequate basis for the development of the operational definitions.? IV EVALUATION A. What rival hypothesis can be suggested for the findings? B. How much confidence can be placed in the study findings? C. To what populations can the findings be generalized? D. What questions emerge from the findings and are these identified by the researcher? E. What future research can be envisioned? F. Could the limitations of the study have been corrected? G. When the findings are examined based on previous studies, what is now known and not known about the phenomenon under study? V CONCEPTUAL CLUSTERING A. Is the knowledge obtained summarized and organized theoretically? B. Can a map be drawn showing the concepts and relationships found in the study? C. Is there sufficient confidence in the findings to use them in nursing practice? D. How will patient outcomes be affected by utilization of the findings? E. Can meta-analysis be used on this and other similar studies to determine what is currently known about a phenomenon? NURSING RESEARCH CRITIQUE PROCESS FOR QUANTITATIVE STUDIES
I. COMPREHENSION A. States the problem 1. Is the problem sufficiently delimited in scope without being trivial? 2. Is the problem significant to nursing? 3. Does the problem have a gender bias? B. States the purpose 1. Does the purpose narrow and clarify the aim of the study? C. Examine the literature review 1. Are relevant previous studies and theories described? 2. Is the literature review organized to demonstrate the progressive development of ideas through previous research? 3. Is a theoretical knowledge base developed for the problem or purpose? 4. Does the literature review provide rationale and direction for the study? 5. Are the references current? 6. Is the current knowledge about the research problem described, including what is known and not known? 7. Is the literature review clearly linked with the research questions, theory and hypothesis? D. Study framework 1. Is the framework explicitly and clearly expressed? 2. Is the framework linked to the research purpose? 3. Is the framework based on substantive theory or a tentative theory? 4. Is the theory related to nursing’s body of knowledge? 5. Does the framework describe and define the concepts of interest, show relationships among the concepts, and relate them to the variables in the study?. 6. Is there a map that describes or represents the study’s framework? E. The research objectives, questions and hypothesis 1. Are they clearly listed and expressed clearly? 2. Do they match the framework established? 3. Are they logically linked to the research purpose and Framework? F. Study variables and concepts 1. What are the independent variables? 2. What are the dependant variables? 3. What are the research variables or concepts? 4. What are the extraneous variables and are they clearly identified? 5. Are the variables reflective of the concepts identified in the framework? G. The research design 1. What is the design if this study? 2. Is this the most appropriate design to obtain the needed data? 3. Does the design provide a means to examine all the objectives, questions, or hypothesis? 4. Is there a drawing of the design or can you do one from the description? 5. What is the treatment or intervention (if appropriate to the design), is it clearly described? 6. Have any threats to the design validity been minimized? 7. Was there or is a pilot study planned.? 8. Is the design logically linked to the sampling method and statistical analysis? H. The sample, population and setting. 1. What was the sampling criteria? 2. What was the sample size?, 3. How was the sample size determined and was a power analysis used?. 4. Is the size sufficient to avoid Type II error? 5. What are the characteristics of the sample? 6. Was there or will there possibility be any mortality to the sample and how might this influence the findings? 7. How was the sample obtained (or will be obtained) and is it adequate to produce a representative sample? 8. If there is more than one group is used, do the groups appear equivalent? 9. Is there sample consent form and does it meet the ethical and IRB standards.? 10. Is the setting used in the study typical of clinical settings? I. What were the measurement strategies? 1. What measurement approaches are being used? a. Scales and questionnaires b. Observation c. Interviews d. Physiologic measures 2. What tools were used and who were the authors? 3. What is the reliability and validity of the instrument or other methods to insure validity of the measurement techniques? 4. How was the instrument originally used? 5. Do the instruments or methods adequately measure the study variables? J. What are the data collection procedures? 1. Is the data collection process clearly described? 2. Are the data collection instruments adequate for the study ? 3. Are the forms used to collect data organized to facilitate computerizing the data? 4. Does the codebook reflect all the information to be collected by the data collection instruments and the study as a whole? 5. Are the data collection methods ethical? 6. Do the data collected address the research objectives, questions or hypothesis? K. Is the statistical analysis plan provided? 1. Are the data analysis procedures appropriate to the type of data collected? 2. Are the data analysis procedures clearly described? 3. What statistical tools are planned (or done) for this study.? 4. Are the statistics descriptive or inferential? 5. List the statistical procedures for each research objective, question or hypothesis.? 6. Are the statistical analysis logically linked to the design? 7. Are the analysis interpreted appropriately (where applicable)? L. What are the study’s limitations? M. How does the researcher plan to generalize the findings? N. What are the implications for nursing? O. What suggestions might there be for further studies? P. Is this study sufficiently clear to replicate it?. Q. Describe the researcher’s interpretation of the actual or potential findings? 1. Are the findings related back to the study framework? 2. Were the findings expected? 3. Are the findings consistent with previous research findings? II COMPARISON A. Did the researcher follow the rules for an ideal study? B. How clearly did the researcher grasp the study situation? III ANALYSIS A. Is there an overall flow of logic in the study? B. Does the problem provide background and direction for the statement of the purpose?. C. Are the variables identified in the purpose consistent with the variables identified in the research objective, questions or hypothesis.? D. Do the conceptual definitions provide an adequate basis for the development of the operational definitions.? IV EVALUATIONNURSING RESEARCH CRITIQUE PROCESS FOR QUANTITATIVE STUDIES
I. COMPREHENSION A. States the problem 1. Is the problem sufficiently delimited in scope without being trivial? 2. Is the problem significant to nursing? 3. Does the problem have a gender bias? B. States the purpose 1. Does the purpose narrow and clarify the aim of the study? C. Examine the literature review 1. Are relevant previous studies and theories described? 2. Is the literature review organized to demonstrate the progressive development of ideas through previous research? 3. Is a theoretical knowledge base developed for the problem or purpose? 4. Does the literature review provide rationale and direction for the study? 5. Are the references current? 6. Is the current knowledge about the research problem described, including what is known and not known? 7. Is the literature review clearly linked with the research questions, theory and hypothesis? D. Study framework 1. Is the framework explicitly and clearly expressed? 2. Is the framework linked to the research purpose? 3. Is the framework based on substantive theory or a tentative theory? 4. Is the theory related to nursing’s body of knowledge? 5. Does the framework describe and define the concepts of interest, show relationships among the concepts, and relate them to the variables in the study?. 6. Is there a map that describes or represents the study’s framework? E. The research objectives, questions and hypothesis 1. Are they clearly listed and expressed clearly? 2. Do they match the framework established? 3. Are they logically linked to the research purpose and Framework? F. Study variables and concepts 1. What are the independent variables? 2. What are the dependant variables? 3. What are the research variables or concepts? 4. What are the extraneous variables and are they clearly identified? 5. Are the variables reflective of the concepts identified in the framework? G. The research design 1. What is the design if this study? 2. Is this the most appropriate design to obtain the needed data? 3. Does the design provide a means to examine all the objectives, questions, or hypothesis? 4. Is there a drawing of the design or can you do one from the description? 5. What is the treatment or intervention (if appropriate to the design), is it clearly described? 6. Have any threats to the design validity been minimized? 7. Was there or is a pilot study planned.? 8. Is the design logically linked to the sampling method and statistical analysis? H. The sample, population and setting. 1. What was the sampling criteria? 2. What was the sample size?, 3. How was the sample size determined and was a power analysis used?. 4. Is the size sufficient to avoid Type II error? 5. What are the characteristics of the sample? 6. Was there or will there possibility be any mortality to the sample and how might this influence the findings? 7. How was the sample obtained (or will be obtained) and is it adequate to produce a representative sample? 8. If there is more than one group is used, do the groups appear equivalent? 9. Is there sample consent form and does it meet the ethical and IRB standards.? 10. Is the setting used in the study typical of clinical settings? I. What were the measurement strategies? 1. What measurement approaches are being used? a. Scales and questionnaires b. Observation c. Interviews d. Physiologic measures 2. What tools were used and who were the authors? 3. What is the reliability and validity of the instrument or other methods to insure validity of the measurement techniques? 4. How was the instrument originally used? 5. Do the instruments or methods adequately measure the study variables? J. What are the data collection procedures? 1. Is the data collection process clearly described? 2. Are the data collection instruments adequate for the study ? 3. Are the forms used to collect data organized to facilitate computerizing the data? 4. Does the codebook reflect all the information to be collected by the data collection instruments and the study as a whole? 5. Are the data collection methods ethical? 6. Do the data collected address the research objectives, questions or hypothesis? K. Is the statistical analysis plan provided? 1. Are the data analysis procedures appropriate to the type of data collected? 2. Are the data analysis procedures clearly described? 3. What statistical tools are planned (or done) for this study.? 4. Are the statistics descriptive or inferential? 5. List the statistical procedures for each research objective, question or hypothesis.? 6. Are the statistical analysis logically linked to the design? 7. Are the analysis interpreted appropriately (where applicable)? L. What are the study’s limitations? M. How does the researcher plan to generalize the findings? N. What are the implications for nursing? O. What suggestions might there be for further studies? P. Is this study sufficiently clear to replicate it?. Q. Describe the researcher’s interpretation of the actual or potential findings? 1. Are the findings related back to the study framework? 2. Were the findings expected? 3. Are the findings consistent with previous research findings? II COMPARISON A. Did the researcher follow the rules for an ideal study? B. How clearly did the researcher grasp the study situation? III ANALYSIS A. Is there an overall flow of logic in the study? B. Does the problem provide background and direction for the statement of the purpose?. C. Are the variables identified in the purpose consistent with the variables identified in the research objective, questions or hypothesis.? D. Do the conceptual definitions provide an adequate basis for the development of the operational definitions.? IV EVALUATION A. What rival hypothesis can be suggested for the findings? B. How much confidence can be placed in the study findings? C. To what populations can the findings be generalized? D. What questions emerge from the findings and are these identified by the researcher? E. What future research can be envisioned? F. Could the limitations of the study have been corrected? G. When the findings are examined based on previous studies, what is now known and not known about the phenomenon under study? V CONCEPTUAL CLUSTERING A. Is the knowledge obtained summarized and organized theoretically? B. Can a map be drawn showing the concepts and relationships found in the study? C. Is there sufficient confidence in the findings to use them in nursing practice? D. How will patient outcomes be affected by utilization of the findings? E. Can meta-analysis be used on this and other similar studies to determine what is currently known about a phenomenon? A. What rival hypothesis can be suggested for the findings? B. How much confidence can be placed in the study findings? C. To what populations can the findings be generalized? D. What questions emerge from the findings and are these identified by the researcher? E. What future research can be envisioned? F. Could the limitations of the study have been corrected? G. When the findings are examined based on previous studies, what is now known and not known about the phenomenon under study? V CONCEPTUAL CLUSTERING A. Is the knowledge obtained summarized and organized theoretically? B. Can a map be drawn showing the concepts and relationships found in the study? C. Is there sufficient confidence in the findings to use them in nursing practice? D. How will patient outcomes be affected by utilization of the findings? E. Can meta-analysis be used on this and other similar studies to determine what is currently known about a phenomenon? A. Is there an overall flow of logic in the study? B. Does the problem provide background and direction for the statement of the purpose?. C. Are the variables identified in the purpose consistent with the variables identified in the research objective, questions or hypothesis.? D. Do the conceptual definitions provide an adequate basis for the development of the operational definitions.? IV EVALUATION A. What rival hypothesis can be suggested for the findings? B. How much confidence can be placed in the study findings? C. To what populations can the findings be generalized? D. What questions emerge from the findings and are these identified by the researcher? E. What future research can be envisioned? F. Could the limitations of the study have been corrected? G. When the findings are examined based on previous studies, what is now known and not known about the phenomenon under study? V CONCEPTUAL CLUSTERING A. Is the knowledge obtained summarized and organized theoretically? B. Can a map be drawn showing the concepts and relationships found in the study? C. Is there sufficient confidence in the findings to use them in nursing practice? D. How will patient outcomes be affected by utilization of the findings? E. Can meta-analysis be used on this and other similar studies to determine what is currently known about a phenomenon? A. States the problem 1. Is the problem sufficiently delimited in scope without being trivial? 2. Is the problem significant to nursing? 3. Does the problem have a gender bias? B. States the purpose 1. Does the purpose narrow and clarify the aim of the study? C. Examine the literature review 1. Are relevant previous studies and theories described? 2. Is the literature review organized to demonstrate the progressive development of ideas through previous research? 3. Is a theoretical knowledge base developed for the problem or purpose? 4. Does the literature review provide rationale and direction for the study? 5. Are the references current? 6. Is the current knowledge about the research problem described, including what is known and not known? 7. Is the literature review clearly linked with the research questions, theory and hypothesis? D. Study framework 1. Is the framework explicitly and clearly expressed? 2. Is the framework linked to the research purpose? 3. Is the framework based on substantive theory or a tentative theory? 4. Is the theory related to nursing’s body of knowledge? 5. Does the framework describe and define the concepts of interest, show relationships among the concepts, and relate them to the variables in the study?. 6. Is there a map that describes or represents the study’s framework? E. The research objectives, questions and hypothesis 1. Are they clearly listed and expressed clearly? 2. Do they match the framework established? 3. Are they logically linked to the research purpose and Framework? F. Study variables and concepts 1. What are the independent variables? 2. What are the dependant variables? 3. What are the research variables or concepts? 4. What are the extraneous variables and are they clearly identified? 5. Are the variables reflective of the concepts identified in the framework? G. The research design 1. What is the design if this study? 2. Is this the most appropriate design to obtain the needed data? 3. Does the design provide a means to examine all the objectives, questions, or hypothesis? 4. Is there a drawing of the design or can you do one from the description? 5. What is the treatment or intervention (if appropriate to the design), is it clearly described? 6. Have any threats to the design validity been minimized? 7. Was there or is a pilot study planned.? 8. Is the design logically linked to the sampling method and statistical analysis? H. The sample, population and setting. 1. What was the sampling criteria? 2. What was the sample size?, 3. How was the sample size determined and was a power analysis used?. 4. Is the size sufficient to avoid Type II error? 5. What are the characteristics of the sample? 6. Was there or will there possibility be any mortality to the sample and how might this influence the findings? 7. How was the sample obtained (or will be obtained) and is it adequate to produce a representative sample? 8. If there is more than one group is used, do the groups appear equivalent? 9. Is there sample consent form and does it meet the ethical and IRB standards.? 10. Is the setting used in the study typical of clinical settings? I. What were the measurement strategies? 1. What measurement approaches are being used? a. Scales and questionnaires b. Observation c. Interviews d. Physiologic measures 2. What tools were used and who were the authors? 3. What is the reliability and validity of the instrument or other methods to insure validity of the measurement techniques? 4. How was the instrument originally used? 5. Do the instruments or methods adequately measure the study variables? J. What are the data collection procedures? 1. Is the data collection process clearly described? 2. Are the data collection instruments adequate for the study ? 3. Are the forms used to collect data organized to facilitate computerizing the data? 4. Does the codebook reflect all the information to be collected by the data collection instruments and the study as a whole? 5. Are the data collection methods ethical? 6. Do the data collected address the research objectives, questions or hypothesis? K. Is the statistical analysis plan provided? 1. Are the data analysis procedures appropriate to the type of data collected? 2. Are the data analysis procedures clearly described? 3. What statistical tools are planned (or done) for this study.? 4. Are the statistics descriptive or inferential? 5. List the statistical procedures for each research objective, question or hypothesis.? 6. Are the statistical analysis logically linked to the design? 7. Are the analysis interpreted appropriately (where applicable)? L. What are the study’s limitations? M. How does the researcher plan to generalize the findings? N. What are the implications for nursing? O. What suggestions might there be for further studies? P. Is this study sufficiently clear to replicate it?. Q. Describe the researcher’s interpretation of the actual or potential findings? 1. Are the findings related back to the study framework? 2. Were the findings expected? 3. Are the findings consistent with previous research findings? II COMPARISON A. Did the researcher follow the rules for an ideal study? B. How clearly did the researcher grasp the study situation? III ANALYSIS A. Is there an overall flow of logic in the study? B. Does the problem provide background and direction for the statement of the purpose?. C. Are the variables identified in the purpose consistent with the variables identified in the research objective, questions or hypothesis.? D. Do the conceptual definitions provide an adequate basis for the development of the operational definitions.? IV EVALUATION A. What rival hypothesis can be suggested for the findings? B. How much confidence can be placed in the study findings? C. To what populations can the findings be generalized? D. What questions emerge from the findings and are these identified by the researcher? E. What future research can be envisioned? F. Could the limitations of the study have been corrected? G. When the findings are examined based on previous studies, what is now known and not known about the phenomenon under study? V CONCEPTUAL CLUSTERING A. Is the knowledge obtained summarized and organized theoretically? B. Can a map be drawn showing the concepts and relationships found in the study? C. Is there sufficient confidence in the findings to use them in nursing practice? D. How will patient outcomes be affected by utilization of the findings? E. Can meta-analysis be used on this and other similar studies to determine what is currently known about a phenomenon?