Premium Essay

Quantitative Research Methods in Educational Planning

In:

Submitted By raqs08
Words 14672
Pages 59
Quantitative research methods in educational planning
Series editor: Kenneth N.Ross

Module
John Izard

7

Trial testing and item analysis in test construction

UNESCO International Institute for Educational Planning

Quantitative research methods in educational planning
These modules were prepared by IIEP staff and consultants to be used in training workshops presented for the National Research Coordinators who are responsible for the educational policy research programme conducted by the Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ). The publication is available from the following two Internet Websites: http://www.sacmeq.org and http://www.unesco.org/iiep.

International Institute for Educational Planning/UNESCO 7-9 rue Eugène-Delacroix, 75116 Paris, France Tel: (33 1) 45 03 77 00 Fax: (33 1 ) 40 72 83 66 e-mail: information@iiep.unesco.org IIEP web site: http://www.unesco.org/iiep

September 2005 © UNESCO

The designations employed and the presentation of material throughout the publication do not imply the expression of any opinion whatsoever on the part of UNESCO concerning the legal status of any country, territory, city or area or of its authorities, or concerning its frontiers or boundaries. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means: electronic, magnetic tape, mechanical, photocopying, recording or otherwise, without permission in writing from UNESCO (International Institute for Educational Planning).

Graphic design: Sabine Lebeau Typesetting: Sabine Lebeau Printed in IIEP’s printshop

Module 7

Trial testing and item analysis in test construction

Content
1. Introduction 2. Preparing for trial testing
Content analysis Test blueprint Item review Other review issues Review of trial test,

Similar Documents

Premium Essay

Fundamental Research

...Fundamentals of Research Dallas Anderson BSHS/382 March 11, 2013 Instructor: Angels Colistra Fundamentals of Research The research field plays a large role in human services assisting the human service workers in making decisions for the client daily. In this paper there will be a definition of the scientific method and how it relates to the human service field. There will a discussion of the steps in the process of scientific method along with why the steps are important to the human service field. The terms qualitative and quantitative research will be defined and discussion on how they differ, and they relate to the human service profession. Mixed method research will also be discussed and when it would be a good time to apply this method in human services. Finally a brief summary will be included, in which research will support the function of a human services manager. Scientific Method The use of scientific method is essential in the human service field. When using the observing ad experiments method a human service worker can understand and learn much more information about his or her client. The scientific method is defined as method of investigation, which a problem is identified first and observations, experiments, or other relevant data is useable to test or construct hypotheses to solve a problem (Creswell, 2008). The following step of the scientific method consist of first identifying the research problem...

Words: 993 - Pages: 4

Premium Essay

Human Service and Research Methods

...Human Service and Research Methods Throughout the numerous human service fields, research is necessary from determining risk to providing solutions. The correct research method increases the ability to make the proper decisions for each situation. The scientific method is one many people learn early in life because this method increases understanding and answers many questions throughout the numerous fields. As a social science many questions need answers, the scientific method assists researchers in discovering these answers. A clear comprehension of the quantitative and qualitative methods allows researchers to know when to use what method. At times both these methods are necessary, knowledge about how and when to incorporate the mixed method is essential. An understanding of the different methods and how they can influence the functions within the human service field is crucial. Scientific Method “The scientific method is the basic method, guide, and system by which we originate, refine, extend, and apply knowledge in all fields,” (Edmund, 2011, What is the Scientific Method, Para. 4).  The text (Creswell, 2008, p. 51) sums these stages into six areas of focus; “identifying the research question, reviewing the literature, specifying a purpose, collecting data, analyzing data, and evaluating research.” The scientific method allows researchers to address many common questions, reach beyond other conclusions, and by using empirical reasoning to decide what is true, (Rosnow...

Words: 1409 - Pages: 6

Premium Essay

Fundamentals of Research

...Fundamentals of Research Anna Albright BSHS/382 May 19, 2014 Fundamentals of Research Describe the Scientific Method The scientific method is compiled of a standard set of techniques that can be used to increase knowledge by making valid observations, interpreting results and simplifying those results. By using the scientific method researches are able to tests pre-existing results as well as modify and refine them or open up prior research for debate. According to Anol Bhattacherjee “the scientific method must satisfy four characteristics: replicability, precision, falsifiability and parsimony.” (Bhattacherjee, 2012) The definition of replicability is in the word meaning the research should be able to be replicated or repeated by other researchers and yet acquire similar or the same results. Precision means that although theoretical concepts can be difficult to measure they must be explained with intense precision that other researchers will be able to use the same explanations to measure the same concepts and test that same theory. According to Anol Bhattacherje “ the definition of falsifiability is that a theory must be stated in a way that it can be disproven. Theories that cannot be tested or falsified are not scientific theories and any such knowledge is not scientific knowledge.” (2012) If a theory consists of ideas that are not accurately measurable or cannot be tested it cannot be deemed as scientific. “Parsimony occurs when there are multiple explanations...

Words: 803 - Pages: 4

Premium Essay

Fundamentals of Research

...Running Head: FUNDAMENTALS OF RESEARCH Fundamentals of Research Tawni Romero University of Phoenix BSHS 382 Research and Statistics Tina Henderson May 2, 2011 Fundamentals of Research The text defines scientific method as a “general expression for the methodology of science, or a systematic research approach or outlook emphasizing the use of empirical reasoning” (Rosnow & Rosenthal, 2008, p. 424). Within this paper there will be a discussion on the scientific method and how it relates to research in the human services field. This paper will review the steps in the scientific inquiry process. This paper will define quantitative and qualitative research and explain how they relate and differ each to the human services field and the scientific method. The paper will determine whether to use a quantitative or qualitative research methodology, and provide examples of what sort of study is appropriate for each methodology and why. The paper will define mixed method research with descriptions and strengths included. Examples of when it is appropriate to apply mixed method research in the human services field will also be examined. In conclusion, there will be a summary of how scientifically sound research supports the function of the human services manager. The Scientific Method The six steps to conducting research are “1) identifying a research problem, 2) reviewing the literature, 3) specifying a purpose for research, 4) collecting data, 5) analyze and interpreting...

Words: 1150 - Pages: 5

Premium Essay

Early Childhood Cirruclum

...Importance and Benefits of Conducting Research What is research method? Research method is defined as “the term method in the entire research process or project can be considered as tool or technique which help researcher obtain, collect and analyze data or different types of information” Saundra et al. (2003). Research methods are used by all students, teachers, and professionals in every aspect . There are several different methodsto use when conducting research in which data to be collected when doing research. The most effective methods used are by observation, interviews and questionnaires. According to Saunders et al. (2003), there are two types of observation and each of them is responsible for collecting different types of data. The first observation type is participant observation which is primarily employed to acquire qualitative data and focus much of effort on identifying the particular meaning behind each action and behavior. Compared with participant observation, the other types of observation is are structured observation which is quantitative-based and concentrates more on the frequency of each action and behavior. In this observation phase, however, the researcher was using structured observation in terms of data collection. Gill and Johnson (1997) mentioned that participant observation requires researcher to fully participate into the life and environment of their targeteding group and activities, not just simply to observe it but try to feel it. ...

Words: 590 - Pages: 3

Premium Essay

Education

...Research is the systematic investigation into existing or new knowledge.[citation needed] It is used to establish or confirm facts, reaffirm the results of previous work, solve new or existing problems, support theorems, or develop new theories. A research project may also be an expansion on past work in the field. In order to test the validity of instruments, procedures, or experiments, research may replicate elements of prior projects, or the project as a whole. The primary purposes of basic research (as opposed to applied research) are documentation,discovery, interpretation, or the research and development of methods and systems for the advancement of human knowledge. Approaches to research depend on epistemologies, which vary considerably both within and between humanities and sciences. There are several forms of research: scientific, humanities, artistic, economic, social, business, etc. Contents  [hide]  * 1 Forms of research * 2 Etymology * 3 Definitions * 4 Steps in conducting research * 5 Scientific research * 6 Historical method * 7 Research methods * 8 Publishing * 9 Research funding * 10 Original research * 10.1 Different forms * 11 Artistic research * 12 See also * 13 References * 14 Further reading * 15 External links | ------------------------------------------------- [edit]Forms of research Scientific research relies on the application of the scientific method, a harnessing of curiosity. This research provides scientific information...

Words: 3518 - Pages: 15

Premium Essay

Fundamentals of Research Paper

...Fundamentals of Research Paper This paper will discuss the fundamentals of research and how it can be applied in the field of human services. Example of scientific methods related to the human services will also be provided. A brief description explaining the differences of quantitative research and qualitative research models and how they relate to field of human services and the scientific method will also be given. Also the concerns of quantitative and quality research methodology will be addressed. A brief summary of how scientifically sound researches supports the function of a human services manager will be discussed as well. According to dictionary.com scientific methods is defined as a method of research in which a problem is identified, relevant data are gathered, a hypothesis if formulated from these data, and the hypothesis is empirically tested (dictornary.com). In other words scientific methods are steps that researchers follow in order to test, acquire, and describe different options during the planning stage. Research is needed in the human service field. Let say that there is a large rapid increase child abuse or homeliness, the rapid increase requires results to the question of why the rapid increase. By the use of research the answer to these questions can be answered by the collection of data, observation, and experiment can offer assistance in the field of human services. Scientific inquiry is a way to investigate...

Words: 1020 - Pages: 5

Premium Essay

Application of Qualitative and Quantitave Techniques of Management

...APPLICATIONS OF QUALITATIVE AND QUANTITATIVE TECHNIQUES OF MANAGEMENT IN ADMINISTRATIVE/ACADEMIC DECISION-MAKING IN INSTITUTIONS OF HIGHER EDUCATION IN VIRGINIA by Carlos A. Valero Dissertation submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of DOCTOR OF EDUCATION in Educational Administration APPROVED: ______________________ Don G. Creamer, Chairman __________________________________ ____________________________ Karl T. Hereford _________________________ Stephen R. Parson January, 1997 Blacksburg, Virginia David J. Parks ____________________ John W. Dickey APPLICATIONS OF QUALITATIVE AND QUANTITATIVE TECHNIQUES OF MANAGEMENT IN ADMINISTRATIVE/ACADEMIC DECISION-MAKING IN INSTITUTIONS OF HIGHER EDUCATION IN VIRGINIA by Carlos A. Valero Educational Administration Don G. Creamer, Chair Abstract The purpose of this study was to examine the status and extent to which administrators of colleges and universities in the state of Virginia apply qualitative and quantitative techniques of management in planning, directing, reporting, and controlling activities for enhancing their administrative and academic decision-making capability. The study was directed to the top and operative organizational levels in two categories of administrators (nonacademic and academic) to determine the types of managerial techniques used, degrees of familiarity with these techniques, frequency of...

Words: 49968 - Pages: 200

Premium Essay

Fundamentals of Research

...Fundamentals of Research University of Phoenix Karan Normand BSHS 382 March 14, 2012 Staci Lowe Fundamentals of Research Research makes many things possible in life. Business owners use research for marketing purposes. Consumers use research for the best purchases and so on. The scientific method is considered the most effective way to test data. “Research is a process of steps used to collect and analyze information to increase understanding of a topic or issue” (Cresswell, 2008). Scientific Method The scientific method is a method of investigating. The scientific method is done in steps starting with defining a question. One need to understand exactly what it is that is to be examined. Otherwise the direction of the experiment is chaos and no determination of the research can be made. The next is to make a guess or develop a hypothesis as to what is believed to be found during the research. Then we need to gather the data so we have some information to go by. This can be done with surveys, testing, or any resources that can give the necessary information. The next step is to test the hypothesis. It must be logical and unbiased for the experiment to be accurate. The conclusion is based on the design of the experiment and the results. It may or may not agree with the hypothesis. Human Services can use the Scientific method to research homelessness in a certain area. For this project a mixture of quantitative and qualitative research should be considered...

Words: 787 - Pages: 4

Premium Essay

Fundamental Research

...Fundamentals of Research in Human Services Yolanda M. Long BSHS/382 Research and Statistics for the Social Sciences March 17, 2014 Michael A. Keitler, MA Fundamentals of Research in Human Services This paper will define the term scientific method and how it relates to research in human services. The process to evaluate the research must incorporate steps needed to identify the problem, analysis the data, and finally form a conclusion. The paper will further explore and define the differences between quantitative and qualitative research in the human services field and the scientific method behind the research. An example depicting a quantitative research, qualitative research, and mixed method research will be covered as well as how scientifically sound research can support the functions of a human service professional. Scientific Method and how it Relates to Human Services Research The Institute Innovation in Health and Human Services at James Madison University defines Scientific Method as the collection of quantitative and/or qualitative date for studies that incorporate logical design and are replicable. The measures, procedures, and analysis are informed by best practices in the field, and the findings are interpreted within the context of the extant research literature (para. 5). Scientific method is important to the field of human services as professionals try to assist clients through reliable data previously captured. If a client is dealing with abuse issues...

Words: 1112 - Pages: 5

Premium Essay

Fundamentals of Research

...Fundamentals of Research University of Phoenix BSHS 381 Fundamentals of Research Research is an important part of our lives. Everything around us and what we know involves research. Based on the readings there are several research methods. The most common one is the scientific method. The scientific method refers to the ways of investigating a fact by gathering new information and old information (Rosnow, Rosenthal, 2008). In order for it to be scientific one must follow and gather observable, empirical and measurable, evidence to the principle of reasoning (Rosnow, Rosenthal, 2008). According to Rosnow and Rosenthal, for scientific research, information must be gathered threw observing, experimenting and formulating, the information to come up with a hypothesis. Then the hypothesis must be test. There is also Sander Peirce beliefs, which he called The Fixation of Beliefs. His three approaches are the method of tenacity, the method of authority, and a priori method(Rosnow, Rosenthal, 2008). The Oxford English Dictionary says that scientific method is: "a method of procedure that has characterized natural science since the 17th century, consisting in systematic observation, measurement, and experiment, and the formulation, testing, and modification of hypothesis." When the word science is said what comes to mind is natural science like biology, or chemistry. The human services field is a science also. Scientific method is used in the human service field to answer...

Words: 777 - Pages: 4

Premium Essay

Fundamentals of Research

...Performing research helps to justify what we know about human nature from what we only think we know. Discovering suitable solutions to the current status quo of experimental outcomes involve exploring data analysis. The concept of research is based on the scientific method researchers use to learn, scrutinize, and explain scientific conclusions interpreted in data collected by conducting experiments, addressing questions, or creating ideas. Understanding the process of the scientific method in research involves many steps that generate evidence that can answer many problems in the human services field. Following the steps of scientific inquiry includes identifying a problem, formulating a hypothesis, performing an experiment, and finally analyzing the data from the experiment. Philosopher Hans Reichenbach’s idea of scientific inquiry included two phases. “Reichenbach’s discovery phase of scientific inquiry includes coming up with a testable idea (in the form of a working hypothesis), crafting the research materials, and developing a study design and a plan to implement it. The justification phase creates the rationale for the plan of study and the data analysis, as well as the logic behind conclusions put forward” (Rosnow & Rosenthal, 2008, Chapter 2). Each step must be included to support the scientific method to discover legitimate statements made and provide a foundation for improving choices about personal health and the health of our community. A human services...

Words: 633 - Pages: 3

Premium Essay

Project Topic

...uses, see Research (disambiguation). "Researcher" redirects here. For the oceanographic research ship, see NOAAS Researcher (R 103). Basrelief sculpture "Research holding the torch of knowledge" (1896) by Olin Levi Warner. Library of Congress, Thomas Jefferson Building, Washington, D.C.Research comprises "creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of knowledge to devise new applications."[1] It is used to establish or confirm facts, reaffirm the results of previous work, solve new or existing problems, support theorems, or develop new theories. A research project may also be an expansion on past work in the field. To test the validity of instruments, procedures, or experiments, research may replicate elements of prior projects, or the project as a whole. The primary purposes of basic research (as opposed to applied research) are documentation, discovery, interpretation, or the research and development (R&D) of methods and systems for the advancement of human knowledge. Approaches to research depend on epistemologies, which vary considerably both within and between humanities and sciences. There are several forms of research: scientific, humanities, artistic, economic, social, business, marketing, practitioner research, etc. Contents 1 Forms of research 2 Etymology 3 Definitions 4 Steps in conducting research 5 Scientific research 6 Historical...

Words: 4251 - Pages: 18

Premium Essay

Quantitive and Qualitative Research Paper

...Quantitive and qualitative research paper BSHS/435 January 11 2016 Quantitive and qualitative research paper Introduction In this essay, I will define appropriate academic research and what that means, I will describe quantitative research, and qualitative of research explaining how they are different and how they relate to one another, human service field, and a scientific method. I will also describe how to decide whether to use quantitative or qualitative research mythology I will provide examples of what sort of study is appropriate for each mythology and I will explain why I chose those examples. I will also define mixed method research and describes drinks, overbite an example of what is appropriate to apply mixed methods research in the human service field I will also identify an ethical issue in research. Appropriate academic research "Research is a systematic process of collecting, analyzing, and interrupting information parentheses data parentheses in order to increase our understanding of a phenomenon about which we are into interested or concerned" (Leedy, P. D., & Ormrod, J. E. (2010). As students will use academic research to answer the questions that we do not know to have a better understanding for a topic and clarity on subjects that we are learning in school. The research allows us not to make assumptions about something that we do not know, but it said have clarity on what it truly is. I could not make research improve the knowledge for students...

Words: 1071 - Pages: 5

Premium Essay

Analyzing the Research

...Analyzing the Research Anne Marie Wouapet Walden University NURS 4000 Section 07, Research and Scholarship for Evidence-based Practice June, 21, 2015 Analyzing the Research Introduction In both the two educational research materials, it is evident that there are two research approaches – the qualitative and the quantitative methods displayed. Researchers who employ these two paradigms of research are considered as either qualitative or quantitative researchers. Studies reveal that these researchers at no instance cross into employing another research method into their work. For instance, a qualitative researcher cannot cross into the confines of the quantitative researchers and vice versa. The rationale behind this is mainly attributed to the fact that both research paradigms have axiological and epistemological assumptions that are considered distinct. This paper, therefore, seeks to identify some research components within a research project, and evaluating the results of these projects by assessing the studies strengths and weaknesses of the study articles, within the qualitative and quantitative paradigms. The two principal articles of this study include; Impact of a smoking cessation educational program on nurses interventions, and the conceptualizations of culture and cultural care among undergraduate nursing students. Overview of Quantitative Article Vandenberg & Kalischuk (2014) in their article titled, “Conceptualizations of culture and cultural care among undergraduate...

Words: 2212 - Pages: 9