User-centered evaluation of the Vietnam National Immunization Information System: Challenges and benefits
By Nguyen Xuan Cam Tu, Program Officer, PATH
Jul 30, 2021
Posted in Monitoring & Evaluation, Products
Photo credit: PATH. A health care worker at a fee-based immunization facility inputs data into NIIS.
This blog originally appeared on the TechNet-21 Forum.
Electronic immunization registries (EIRs) are defined as confidential, computerized, population-based systems that collect and consolidate vaccination data from vaccination providers for better immunization strategies. Evidence suggests that EIRs can help increase vaccination coverage. This is mainly related to their ability to facilitate several things:
- Individual follow-up of vaccination status;
- Tracking defaulters (people who are overdue for a vaccine dose);
- Automatically generating messages for recalls to alert people about overdue doses and for reminders to alert people about upcoming doses;
- Provider assessment and feedback; and
- Vaccination clinical decision support.
This is in addition to facilitating the informed management of immunization programs. These are all parts of the daily activities of immunization staff, which EIRs are ultimately designed to support.
However, systems that suit their intended users don’t just happen. They are products of a user-centered development process and a user-centered attitude during the development. Since the emergence of information systems more than two decades ago, a great deal of effort has been given to facilitate the development and implementation of usable systems—systems that support and engage users, rather than get in the way and hinder them. Likewise, the Vietnam National Immunization Information System (NIIS) has continued evolving to stand the test of time and bear the weight of users’ criticism. PATH has worked with the Vietnam National Expanded Program on Immunization on the design, development, and implementation of NIIS since 2012, when testing its predecessors—ImmReg and VaxTrak—led to the idea for NIIS. PATH worked closely with immunization staff at all levels at piloted locations to identify and focus on real users and their needs, goals, context of use, abilities, and limitations to drive the development. It has been a decade-long process of growth, adaptation, learning, and overcoming challenges from both the NIIS and the immunization staff to bring about a system that truly serves users, not only on their daily tasks but also on the overall national immunization program.
The Introducing Digital Immunization Information Systems–Exchange And Learning from Vietnam (IDEAL-Vietnam) project, funded by the Bill & Melinda Gates Foundation, in collaboration with the National Expanded Program on Immunization, has conducted a rapid evaluation of NIIS from the immunization staff perspective. The evaluation explored staff challenges from the initial introduction to the system, and how they overcame them, as well as how the system impacted workload and efficiency.
Overcoming the challenges and adoption for new users in electronic immunization registry implementation – a case study from Vietnam
This case study presented the context of EIR implementation in Vietnam. Within that context, it featured immunization staff at the facility level of a commune health center, fee-based immunization facility, hospital, and clinic with a birthing room, as well as at the management level of a district, provincial, regional, and national Expanded Program on Immunization. Their challenges ranged from the insufficient infrastructure, lack of computer skills, excessive workloads, frequent system updates, challenges around interoperability, and resource and data management. Along with the challenges, the immunization staff also shared their effort to overcome these barriers and remain determined to transfer to a paperless system.
These findings emphasized again that tight collaboration among stakeholders with the user-centered approach to system design, development, and improvement was the key to successful EIR implementation and sustainability in Vietnam.
Photo credit: PATH. Health care workers in Son La on their way to an outreach site for immunization.
Electronic immunization registry in workload reduction and efficiency enhancement for the immunization program in Vietnam
In an effort to reduce the burden of administrative tasks for immunization staff, many countries have implemented the EIR system. It is important to understand how deployment of an EIR impacts the workloads of health care workers. This case study explores and compares the workloads and efficiency of immunization staff at different levels before and after the NIIS in Vietnam, aiming to present concrete examples for other countries with similar context.
This case study points out that it is essential to plan for the increased workload of immunization staff during the introduction and transition phase to build an appropriate timeline and allocate sufficient resources.
For more information as well as publications on IDEAL-Vietnam, please visit our TechNet-21 landing page.