Evaluation Table Sample Template

Table title: Evaluation Table

Citation Study Purpose Conceptual Framework Design/Method Sample Setting Major Variables Studied and Their Definition Measurement of Major Variables Data Analysis Study Findings Worth to Practice

LOE

Strengths/Weaknesses

Feasibility

Conclusion

Recommendation
Huygens, M. W., Vermeulen, J., Swinkels, I. C., Friele, R. D., Van Schayck, O. C., & De Witte, L. P. (2016). Expectations and needs of patients with a chronic disease toward self-management and eHealth for self-management purposes. BMC health services research, 16(1), 1-11. DOI 10.1186/s12913-016-1484-5 To evaluate how eHealth is used to support patients in self-management especially in chronic care. Chronic patients need round the clock monitoring due to their chronic condition. eHealth has the capability of monitoring and sending timely messages to nurses and doctors concerning the condition of each patient that use the technology. Investigating the expectations of patients with chronic ailments and their willingness to use eHealth for self-management purposes. Five focus groups comprising individuals with diabetes (n=14) and heart disease (n=9) were used. The researchers also used a separate focus group from patients with chronic conditions. The researchers examined chronic disease impacts on life, patient opinion regarding self-management, and needs and expectations regarding the use of eHealth. The researchers adopted conventional content analysis to understand the data. Groups of people suffering from COPD (n=9), diabetes (n=14), were recruited from four primary care centers around Netherlands. All patients were adults (18 years and above) eHealth- the technology used in monitoring the health of patients with chronic conditions. COPD- Chronic obstructive pulmonary disease-an inflammatory disease that affects the lungs and obstructs air flow to the organ.  Measuring of symptoms and the effects of the condition on daily life A verbatim transcription of was done for all focus groups. The verbatim transcription was checked against the audio recordings for discrepancies. Researchers independently evaluated each transcript from COPD, diabetes, and heart disease. 30 participants between 50 and 80 years old participated in the focus group. Two groups evaluated people with diabetes, another 2 groups analyzed COPD. Most COPD participants had mild to severe case of COPD. 4 participants had high cholesterol and high blood pressure There were different expectations from different patient groups concerning eHealth and self-management. The use of eHealth greatly depended on the willingness of the participants to use it.

The researchers found that there were big differences in the needs and the expectations of patients meaning that the implementation of eHealth technology should be tailored for each group. Based on these differences, there cannot be a ‘fits-all’ solution for everyone hence the need to tailor the eHealth for each group.
Bashir, A., & Bastola, D. R. (2018). Perspectives of nurses toward telehealth efficacy and quality of health care: Pilot study. JMIR Medical Informatics, 6(2), e35. https://doi.org/10.2196/medinform.9080 The purpose of this study is to evaluate the effect of telehealth technology on the quality of service delivered by nurses. The study seeks to analyze the evolving roles of nurses as they assume new responsibilities occasioned by the use of information technology. A survey was conducted from nurses through a survey instrument to evaluate the quality of service when telehealth is used.

This study is important because it highlights the role that telehealth plays in the provision of quality care for patients.

 Data was collected from nurses from a home care agency using interview questions. The researchers did follow-up interviews to ascertain and validate the interview questions. The Visiting Nurse Association-VNA of Omaha was the study site. 13 members of VNA telehealth nursing staff participated in the study. Positive facilitators of telehealth were the major variables in the study. The key variables include; responsiveness, reliability, assurance, and empathy. Measuring these parameters helped the researchers to evaluate the link between the quality of telehealth. Measurement of the variables was scored on the level of responsiveness of the participants.

The perceived services and consumer expectations is the major component of the study and is measured by the willingness of consumers to use telehealth.  

 The study provided weblink for the survey which was given through email to all the VNA participant nurses. 13 nurses took part in the survey.

The survey was generated using a Web-based software tool; Survey Monkey was used to generate a web-based software tool for the study. . The data were processed through SPSS version 22. The gaps, expectations, and perceptions, were calculated.

 The results of the study were positive based on the mean differences between perception and expectation.

In the past, SERVQUAL tools have been found as a reliable and valid measure of SQ. This is because of factors such as the dimensionality, item compositions, validity, and disconfirmation paradigm used in its measurement. The “type of technology” has a direct effect on barrier reduction, attitudes, and quality and quantity of communication.

 SERVQUAL instrument proved to be the best criterion for assessing TNSQ. This tool not only estimated the level of satisfaction but also identified situations where perceptions exceeded expectations.

 
Shea, S., Weinstock, R. S., Teresi, J. A., Palmas, W., Starren, J., Cimino, J. J., Lai, A. M., Field, L., Morin, P. C., Goland, R., Izquierdo, R. E., Ebner, S., Silver, S., Petkova, E., Kong, J., & Eimicke, J. P. (2009). A Randomized Trial Comparing Telemedicine Case Management with Usual Care in Older, Ethnically Diverse, Medically Underserved Patients with Diabetes Mellitus: 5 Year Results of the IDEATel Study. Journal of American Medical Information Association, 16(4), 446–456. doi:10.1197/jamia.m3157  To find out if telemedicine technology can offer chronic patients with an effective case management service. Today, patients have an array of hospital-based technology from which they can get information on health matters. Through telemedicine and other technologies, patients have access to personal health records that they can directly access and utilize. The researchers performed a randomized and controlled test that compares telemedicine to the usual care services.  A total of 1,665 recipients of medicare suffering from diabetes participated in the study. The participant chosen for the study were all aged 55 years and above. They were drawn from the federally designated areas of New York that are underserved medically. Diabetes was chosen as the ideal clinical target for the IDEATEL. The results would be determined by the consumption of the technology and how much it contributed to the health of the patients. Measuring the variable depended on how much information the participants gathered about their condition. The more information a participant had, the better the outcome of their health improvement. Covariance was used to determine and adjust appropriately the baseline values used in the clustering process. The heterogeneity of groups and all other residual variances were modeled to accommodate model assumptions.  The researchers found that the usual care groups together with the intervention did not bear much difference to the baseline demographic. The researchers found that case management of diabetes delivered through telemedicine greatly improved the hemoglobin level.

 

 

 

 

 

 

 

 

 The study took into consideration the comparison between treatments delivered through telemedicine and in-person delivery of diabetes treatment. The design of the study allowed it to be feasible given the expansive geographic span of New York.
 

 

 

*Table may be in font size 9

References

  • Bashir, A., & Bastola, D. R. (2018). Perspectives of nurses toward telehealth efficacy and quality of health care: Pilot study. JMIR Medical Informatics, 6(2), e35. https://doi.org/10.2196/medinform.9080
  • Huygens, M. W., Vermeulen, J., Swinkels, I. C., Friele, R. D., Van Schayck, O. C., & De Witte, L. P. (2016). Expectations and needs of patients with a chronic disease toward self-management and eHealth for self-management purposes. BMC health services research, 16(1), 1-11. DOI 10.1186/s12913-016-1484-5
  • Shea, S., Weinstock, R. S., Teresi, J. A., Palmas, W., Starren, J., Cimino, J. J., Lai, A. M., Field, L., Morin, P. C., Goland, R., Izquierdo, R. E., Ebner, S., Silver, S., Petkova, E., Kong, J., & Eimicke, J. P. (2009). A Randomized Trial Comparing Telemedicine Case Management with Usual Care in Older, Ethnically Diverse, Medically Underserved Patients with Diabetes Mellitus: 5 Year Results of the IDEATel Study. Journal of American Medical Information Association, 16(4), 446–456. doi:10.1197/jamia.m3157