PhD Methodology Sample: Evaluating the effectiveness of evidence-based management 

3.1. Introduction

This chapter presents a comprehensive overview of the research methodology used in the current study to examine the effectiveness of evidence-based management. While evidence-based management was initially used in the healthcare industry, today it is used for critical decision-making by different industries and companies (Rousseau & Gunia, 2016). This is because it allows stakeholders to integrate scientific and professional knowledge to improve the overall workflow (Barends & Rousseau, 2018). The research design follows the systematic framework of the Research Onion developed by Saunders et al. (2019).

The Research Onion model, when adapted for corporate evidence-based management, provides a systematic approach for decision-making and organizational practices. It can act as a template to capture the best practices in business and ensure the actionability of evidence for business management. Saunders et al. (2019) defined research as a process of increasing knowledge and discovering new things in a systematic way. The model will not only provide a structured approach to research methodology but also guide the current research process through multiple layers. The aim of this chapter is to demonstrate how each layer of the Research Onion can be effectively applied in business contexts to enhance evidence-based practices in both medium and large companies.

3.2. Research Onion

The Research Onion Model suggested by Saunders et al. (2019) is considered a significant methodological approach that represents the different aspects of research methodology as an onion. Similar to an onion, research methodology has different layers that can be described as the stages involved in a research study. The Research Onion framework offers a coherent and consistent research design by addressing six key methodological layers. These include research philosophy, research approach, methodological choice, research strategy, time horizon, and techniques and procedures.

Each layer of the Research Onion has been carefully considered and aligned with the research objectives of this study. Aiming to understand how companies use evidence-based management for improving their human resource practices in a fast-moving landscape. The different layers of the Research Onion Model indicate that different elements of research have to be implemented at each stage in a progressive way to reach the innermost layer (Melnikovas, 2018). By peeling every layer of the Research Onion, researchers can develop a suitable research design.

3.3. Research Philosophy

The outermost layer of the Research Onion Model refers to research philosophy. Research philosophy is an overarching theme that sets the context for further analysis and investigation. It also acts as the foundation for the second layer of the framework. Burrell and Morgan (2016) stated that knowingly or unknowingly, a researcher will make numerous assumptions while working on a research study. These assumptions can be categorized as ontological assumptions based on the reality of research, epistemological assumptions associated with existing knowledge, and axiological assumptions that are made under the influence of the researcher’s values on the research process.

Saunders et al. (2019) argued that these assumptions contribute to the five major research philosophies, namely positivism, critical realism, interpretivism, postmodernism, and pragmatism. This study uses the positivist philosophical approach as it aligns with the objective nature of evidence-based management research. Positivism highlights the various phenomena of business processes and relies on factual data to produce credible and meaningful results. Additionally, it can assist researchers in testing hypotheses derived from an existing theory by focusing on key variables of research, generating detailed observations, and producing generalizable results that can contribute to the field of evidence-based research (Creswell & Creswell, 2017). The positivist approach also supports the study’s goal of examining relationships between business variables and testing hypotheses related to evidence-based management effectiveness in companies of different sizes.

3.4. Research Approach

The second layer of the Research Onion framework aims at choosing the appropriate research approach. Here, the research approach refers to the stage of developing a hypothesis that tries to verify the research statement. Crowther and Lancaster (2012) categorized research approaches into two main types: inductive and deductive. Positive researchers are more likely to use a deductive approach because positivist research philosophy assumes that researchers concentrate only on facts. As a result, by using a deductive approach, they are able to test evidence-based facts obtained from research hypotheses of existing theories. On the contrary, the inductive approach is popular among researchers who focus on inducing new theories that explain how individuals behave in specific situations.

In this study, a deductive research approach has been adopted as it aligns with the positivist philosophy. The deductive research approach is used for developing hypotheses based on existing theory, designing a research strategy to test these hypotheses, collecting empirical data, and analyzing results to confirm or reject hypotheses (Robinson & McCartan, 2016). In evidence-based management, the deductive approach is particularly appropriate because it supports researchers in testing the existing theories of evidence-based management. Furthermore, it allows researchers to examine the relationships between different variables and facilitates the generalization of research findings.

3.5. Research Strategy

The third layer of the Research Onion demonstrates the research strategy that is used to collect and analyze data. It shows how the researcher intends to carry out the work (Saunders et al., 2019). The research strategy can include multiple approaches, such as experimental research, action research, case study research, grounded theory or middle ground approach, interviews, surveys, or a systematic literature review (Merriam, 2002). This study used the survey strategy as the primary research strategy. This strategy was implemented using structured questionnaires aimed at 400 key stakeholders working at different companies selected for the research. Using a survey strategy not only helps in the collection of standardized data from a large population but also assists in the examination of relationships between different research variables. Moreover, it generates representative findings that can be applied to a bigger platform.

The research survey was designed following guidelines provided by Beam (2017). The survey consisted of clear questions that helped in collecting appropriate responses from the research participants. All the questions were arranged in a logical sequence to understand the thought process followed by business leaders in making decisions to retain employees and attract new talent in a fast-paced environment. To develop the questionnaire, the researchers conducted an extensive literature review and identified key elements of evidence-based management in top companies.

3.6. Methodological Choice

Saunders et al. (2019) defined research choices based on the use of quantitative and qualitative research methods. Their Research Onion Model also included simple research methods, a complex mix of multi-methods, and the use of mono-methods. Qualitative research methods are ideally used for studies involving numbers and mathematical operations. On the other hand, qualitative methods focus on the collection and analysis of descriptive data. Mono-method approach is particularly used when the research is focused on either quantitative or qualitative data collection. Whereas, the mixed methods approach uses a combination of quantitative and qualitative data within the same research to achieve different aims.

As this research aims at collecting survey data from a sample of 400 respondents, it uses a quantitative mono-method design. This design is suitable for collecting numerical data from a single source and integrating it into the analysis procedure. It focuses on quantification of data and requires statistical analysis to test hypotheses. Moreover, quantitative mono-method design also aligns with both positivist philosophy and deductive approach. Due to the nature of evidence-based research, mono-method design can be considered a highly reliable approach to study the chosen sample size of 400 survey participants.

3.7. Time Horizon

Time horizons in research refer to the time periods to be studied in longitudinal or chronological order.  It helps in covering multiple events or changes that may occur at a time. Iovino & Tsitsianis (2020) argued that the research question and the nature of the study play a crucial role in determining the time horizon of a study. Furthermore, Saunders et al. (2019) classified time studies in terms of time horizon as cross-sectional studies and longitudinal studies.

A cross-sectional time horizon was chosen for this study because it involves collecting data at a single point in time. Considering the nature of evidence-based research, this study depends on survey data to get an insight into the current employee practices of different companies. The study focuses on the action plan adapted by companies to overcome the challenges faced in retaining existing employees and attracting new talent in a rapidly changing business environment. As a result, keeping the time constant makes it easier to compare different variables or approaches used by companies. The choice of cross-sectional time horizon was also influenced by the research objectives, which focus on examining relationships at workplaces rather than changes over time. Additionally, the nature of research questions does not require participants to suggest results obtained in the past, but only focuses on current strategies.

3.8. Data Collection and Analysis

The sixth and innermost layer refers to techniques and procedures used in a research study. This final layer of the onion pushes the research design further. It uses all the previous choices to identify appropriate methods for data collection and analysis required to answer the research question.

The study employed a sample size of 400 respondents associated as key stakeholders in both medium and large companies. The participants were randomly selected and approached through an online pilot questionnaire, which helped in understanding their demographics and interests. A series of structured interviews was conducted, and the final list of participants was created. Based on the research aim and objectives, a survey questionnaire was designed. This questionnaire included questions to understand the strategies adapted by them to improve their human resource practices. To improve the accuracy of responses, each question had responses that could be measured using a Likert scale.

Keeping the time constant helped in understanding other variables used in the research. These included relationships between employees and management, the influence of managerial practices on employee turnover, company culture, work flexibility, monetary benefits, and growth opportunities. All the research participants were contacted through email and were asked to complete the survey. The data was collected over a period of two months and analyzed using structural equation modeling (SEM). This helped in the simultaneous examination of multiple relationships at the workplace and also provided a comprehensive framework to test the research hypothesis.

3.9. Research Limitations

While the above research approaches used for this study help in answering the research question, the study has certain limitations. For example, the cross-sectional nature of the study limits the ability to establish causal relationships between different variables. Although the study can be used to identify correlations between variables, determining causality requires longitudinal data collected over a specific time period. Additionally, it uses predetermined responses on a Likert scale. This may affect the accuracy of the data as the participants are more likely to provide answers that match the specific response patterns.

Similarly, the research is limited to a specific demographic of the sample population and only involves people working in managerial positions in the companies. This may lead to bias in responses. A comprehensive study focusing on the responses of both employees and employers can give a better understanding of the research question from different perspectives. Since this study is focused on a specific set of variables related to evidence-based management techniques used in companies, there might be a need to consider external factors influencing the effectiveness of evidence-based practices at the workplace.

3.10. Ethical Considerations

The research was conducted in accordance with ethical guidelines set by the university. To ensure adherence to ethical considerations, informed consent was collected from all participants after explaining to them the nature of the research. Additionally, the identity of respondents is kept confidential to maintain anonymity. The responses collected were encrypted to enhance data security and reduce the chances of privacy breaches.

3.11. Conclusion

The chapter outlines the theoretical framework of the research methodology used in this study. By focusing on the positivist paradigm, the chapter explains how the Research Onion framework shapes the overall research design. By progressing through each layer of the Research Onion, the chapter provides justification for the methodological choices made at each stage. The chapter also includes detailed discussions of sampling procedures, data collection methods, and the analytical techniques employed, with an emphasis on SEM. Finally, it addresses ethical considerations and acknowledges the limitations of the chosen methodology.

References

Barends, E., & Rousseau, D. M. (2018). Evidence-based management: How to use evidence to make better organizational decisions. London: Kogan Page Publishers.

Beam G (2017). The Problem with Survey Research. New Brunswick, NJ: Routeledge. 

Burrell, G., & Morgan, G. (2019). Sociological paradigms and organisational analysis: Elements of the sociology of corporate life. London: Routledge.

Creswell. J.W. and Creswell, J.D. (2017). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4th Edition, Newbury Park: Sage.

Crowther, D., & Lancaster, G. (2012). Research methods. London: Routledge.

Iovino, F., & Tsitsianis, N. (2020). The methodology of the research. In Changes in European energy markets. Bradford: Emerald Publishing Limited.

Melnikovas, A. (2018). Towards an Explicit Research Methodology: Adapting Research Onion Model for Futures Studies. Journal of futures Studies, 23(2), 29-44.

Merriam, S. B. (2002). Introduction to qualitative research. Qualitative research in practice: Examples for discussion and analysis, 1(1), 1-17.

Robinson, C. & McCartan, K. (2016).  Real-world research (3rd ed.). London: John Wiley & Sons.

Rousseau, D. M., & Gunia, B. C. (2016). Evidence-based practice: The psychology of EBP implementation. Annual review of psychology, 67(1), 667-692.

Saunders, M., Lewis, P., Thornhill, A., & Bristow, A. (2019). Research methods for business students. London: Pearson.