GENERAL INFORMATION
- Developer Name : MedAZ.Net, LLC
- Product Name : Med A-Z
- Version : 202001
- Certification number : 15.05.05.3150.MDAZ.01.00.1.230616
- Plan ID : 20241114maz
- Developer Real World Testing Plan Page URL: https://www.medaz.net/RWT.html
-
Certified Criteria:
170.315 (b)(3) Electronic prescribing
170.315 (b)(10) Electronic health information export
170.315 (c)(1) Clinical Quality Measures – Record and Export
170.315 (c)(2) Clinical Quality Measures – Import and Calculate
170.315 (c)(3) Clinical Quality Measures – Report
170.315 (f)(1) Transmission to immunization registries
170.315 (f)(2) Transmission to PHA – syndromic surveillance
170.315 (g)(7) Application access – patient selection
170.315 (g)(10) Standardized API for patient and population services
Justification for Real World Testing Approach
This plan was formulated to collect a holistic image of how the system is used over about one calendar year. Due to a smaller than expected data volume and sample size, we will be largely carrying forward last year’s testing methodology.
Med A-Z has contacted customers and is setting up mirrored production environments. Data from the end of the previous business day will be used for test scenario evaluations, conducted by internal testing staff. This approach will enable simulation of actual volumes specifically for low-usage scenarios within the mirrored environment.
Over the course of the year, we intend to count the number of gross successes and failures, as defined in the measures section below, to establish baseline reliability scores (successes/ (successes + failures)) to each measure. The reliability score will be on a scale of 0 to 1. At each quarterly review, the running reliability scores will be tabulated, and systems with lower scores will be reviewed and revised. Using this framework will allow us to view all data trends globally and target any potential weaknesses in a systematic manner.
Standards Updates (SVAP and USCDI)
Standard (and Version) | N/A |
Updated certification criteria and associated product number | N/A |
CHPL Product Number | 15.05.05.3150.MDAZ.01.00.1.230616 |
Method used for standard update | N/A |
Date of ONC ACB Notification | N/A |
Date of customer notification (SVAP Only) | N/A |
Conformance Measure | N/A |
USCDI updated certification criteria (and USCDI version) | N/A |
Measures Used in Overall Approach
Measurement Methodology:
The primary modes of measurement for measures b3, b10, f1, f2, g7 and g10 are server-side logs kept in the Med A-Z system. All logs from the data collection period will be examined and the number of successes and failures as defined below for each measure will be counted. For measures c1, c2, and c3, which involve file creation, success and failure will be determined manually based on the definitions below.Metric Name:
Reliability score = Gross Successes / (Gross Successes + Gross Failures)For all measures, a reliability score will be calculated from the gross successes and gross failures. Reliability Score = Gross Successes/ (Gross Failures + Gross Successes).
For each measure, gross success and gross failure will be defined below.
Measures:
Associated Criteria:170.315 (b)(3) Electronic Prescribing
● Workflow:- NewRx - New prescriptions
- RxChangeRequest and RxChangeResponse - Requests and responses to change prescriptions
- CancelRx and CancelRxResponse - Requests and responses to cancel prescriptions
- RxRenewalRequest and RxRenewalResponse - Requests and responses to renew prescriptions
- RxFill - Responses with fill status notifications, when fill status is requested by client
- RxHistoryRequest and RxHistoryResponse - Requests and responses to medication histories
- Gross Successes – The count of Surescripts confirmation or waiting responses in server logs.
- Gross Failures – The count of error messages in the server logs
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate, and potentially determine any spot trends during the scheduled review sessions.
● Relied upon Software: SureScripts
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria:170.315 (b)(10) Electronic Health Information Export
● Workflow:There are two workflows to export EHI. They are:
- Single patient EHI export: An administrator can export EHI for a single patient.
- Patient population EHI export. An administrator can select any of the information stored in authorized patients’ records to use as criteria for a population and then export the population of patients who meet those criteria.
We recognize that not all customers use the full functionality of the certification criteria made available in the EHR. If Med A-Z is unable to identify customers that use the (b)(10) criterion as defined in the regulation, then testing will be done using the mirrored client databases and reflected in the results report.
● Measurements:- Gross Successes – The count of “Export files created” success messages in server logs.
- Gross Failures – The count of “file creation failure” error messages in the server logs
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate, and potentially determine any spot trends during the scheduled review sessions.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria:170.315 (c)(1) Clinical Quality Measures – Record and Export
● Workflow:There are two steps for recording and exporting CQMs in Med A-Z:
- Record. Providers discreetly document clinical data elements as part of their existing clinical documentation. In some cases, data elements are automatically mapped to discrete standard terminologies, and in other cases, organizations have the flexibility to map their workflows to standard terminology.
- Export. Users generate and export documents containing data elements that are discretely mapped to standard terminologies in QRDA 1. Administrative users can generate documents for all eligible patients or for individually identified patients.
- Gross Successes – The manual count of successful QRDA1 file creation.
- Gross Failures – The manual count of QRDA1 file rejections
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria:170.315 (c)(2) Clinical Quality Measures – Import and Calculate
● Workflow:There are two steps for importing and calculating CQMs in Med A-Z:
- Import. Users can import quality reporting patient data files in QRDA 1 format to use for subsequent quality reporting. Users import externally created files through an incoming interface, permitting the organization to report on data from within their own system as well as from external sources.
- Calculate. Both imported data and data entered in Med A-Z are used in measure calculation when evaluating patient outcomes.
- Gross Successes – The manual count of times where data is read and imported correctly into Med A-Z System.
- Gross Failures – The manual count of “file read failure” error messages in the server logs.
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria: 170.315 (c)(3) Clinical Quality Measures – Report
● Workflow:Eligible Clinician QRDA Category III Documents, which are aggregated documents, are required to be generated and exported. Administrative users can generate documents for all eligible patients or for individually identified patients.
Exported data files support the electronic clinical quality data submission requirements specified under CMS rules. Organizations upload these files to CMS web portals to report on quality programs.
● Measurements:- Gross Successes – The manual count of successful file submissions to CMS.
- Gross Failures – The manual count of QRDA3 file rejections
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria: 170.315 (f)(1) Transmission to Immunization Registries
● Workflow:Med A-Z provides bi-directional interfaces (VXU/QBP) for transmitting and receiving historical immunization information to immunization registries, where available. The scenarios include:
- Administer: When a provider administers a new immunization, an electronic message (VXU) is automatically sent to any immunization registry with which the organization has a connection.
- Document historical administration: An electronic message is automatically sent to immunization registries configured to receive information on historical administrations.
- Gross Successes – The count of “transmission successful” success messages in server logs.
- Gross Failures – The count of “transmission failure” error messages in the server logs
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate, and potentially determine any spot trends during the scheduled review sessions.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria: 170.315 (f)(2) Transmission to Public Health Agencies – Syndromic Surveillance
● Workflow:If the public health agency supports reporting from ambulatory settings, the ADT Syndromic Surveillance information is automatically sent for qualified patients.
● Measurements:- Gross Successes – The manual count of confirmation messages from CDC.
- Gross Failures – The manual count of non-responses from CDC.
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria: 170.315 (g)(7) Application Access – Patient Selection
● Workflow:Med A-Z facilitates the provision of patient identifiers and USCDI data through APIs:
- Authorization. Patients can authorize third-party applications to access their health information using APIs. The app requests information for the patient, and the system identifies the patient and responds with a unique patient identifier, an access token, and a refresh token that the app can use to access the patient’s information.
- Data retrieval. After a patient grants access to a third-party application, the app can access and retrieve the patient’s data within the USCDI using standard APIs.
- Revocation. Patients can revoke an authorized app’s access by removing app access within the patient portal.
-
Data sharing for providers and backend systems. Med A-Z’s FHIR and OAuth 2.0 APIs enable several different use cases for securely sharing USCDI data with third-party applications. Sample use cases are described below.
- SMART on FHIR EHR launch. Providers use third-party apps with contextual EHR integration and FHIR APIs using the SMART on FHIR EHR Launch workflow. This launches a third-party app from within the software, making it available for the provider to use without needing to re-enter credentials. The app can then use FHIR APIs to query for data as necessary for the provider’s workflows. This allows providers to use FHIR applications that are integrated directly into their workflows.
- Bulk FHIR APIs. Third-party systems can access USCDI data for a population of patients using Bulk FHIR APIs.
- Gross Successes – The count of “Connection Successful” success messages in server logs.
- Gross Failures – The count of “Connection Failure” error messages in the server logs.
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate, and potentially determine any spot trends during the scheduled review sessions.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Associated Criteria: 170.315 (g)(10) Standardized API for Patient and Population Services
● Workflow:Med A-Z facilitates the provision of patient identifiers and USCDI data through APIs:
- Authorization. Patients can authorize third-party applications to access their health information using APIs. The app requests information for the patient, and the system identifies the patient and responds with a unique patient identifier, an access token, and a refresh token that the app can use to access the patient’s information.
- Data retrieval. After a patient grants access to a third-party application, the app can access and retrieve the patient’s data within the USCDI using standard APIs.
- Revocation. Patients can revoke an authorized app’s access by removing app access within the patient portal.
-
Data sharing for providers and backend systems. Med A-Z’s FHIR and OAuth 2.0 APIs enable several different use cases for securely sharing USCDI data with third-party applications. Sample use cases are described below.
- SMART on FHIR EHR launch. Providers use third-party apps with contextual EHR integration and FHIR APIs using the SMART on FHIR EHR Launch workflow. This launches a third-party app from within the software, making it available for the provider to use without needing to re-enter credentials. The app can then use FHIR APIs to query for data as necessary for the provider’s workflows. This allows providers to use FHIR applications that are integrated directly into their workflows.
- Bulk FHIR APIs. Third-party systems can access USCDI data for a population of patients using Bulk FHIR APIs.
- Gross Successes – The count of “Connection Successful” success messages in server logs.
- Gross Failures – The count of “Connection Failure” error messages in the server logs.
● Care Setting: Med A-Z EHR is used in a variety of ambulatory care settings. Data from these settings will be recorded
● Justification: By using this measure, we hope to establish a gross success rate, and potentially determine any spot trends during the scheduled review sessions.
● Relied upon Software: N/A
● Expected Outcomes: We are expecting reliability scores of .9 or higher for all measures, meaning that they operate reliably 90% of the time or greater.
Timeline and Milestones for Real World Testing CY 2025
Milestone | Target Date |
Begin data collection as laid out in RWT Plan |
January 15 2025 |
Quarterly review 1 | April 15 2024 |
Quarterly review 2 | July 15 2025 |
Quarterly review 3 | Oct 17 2025 |
End data capture for all measures | December 20 2025 |
Review data collected for all measures, and finalize results for report |
December 28 2025 |
Prepare results report | January 2026 |
Submit Real World Testing Results to ACB |
January 2026 |
Developer Attestation
Attestation
This Real-World Testing plan is complete with all required elements, including measures that address all certification criteria and care settings. All information in this plan is up to date and fully addresses the health IT developer’s Real World Testing requirements.Authorized Representative Name: | Vasu Iyengar |
Authorized Representative Email: | medazsupport@medaz.net |
Authorized Representative Phone: | +1 (609) 716-6991 |
Authorized Representative Signature: | Vasu Iyengar |
Date: | 10/22/2024 |