PDF Accessibility Checker
Role
UX/UI Designer, Research
Case Study
Software PDF Accessibility Checker
Categorie
Software
Tools
Figma, FigJam, Zoom
Challenge
After an extended period with the same design, Axes4 saw the need for a product refresh. The existing PAC (PDF Accessibility Checker) had usability and functionality issues, and the UI needed to be revitalized, leading to user problems and low usage. The primary objective of this project is to rejuvenate the product's user interface and enhance its overall user-friendliness.
My Role
In my role as a UX Designer, my responsibilities included:
Aligning and communicating with different stakeholders (developers, Head of Development)
Responsible for research
Design from strategy to implementation
I closely collaborated with the Head of Development to consolidate the project's vision and value proposition, identify crucial end-user needs, and emphasize the significance of our offerings to our users.
I was involved in multiple stages of the project.
Understanding the value, validating the concept, and testing the 2021 version.
Identifying product features and setting requirements.
Design wireframes and prototypes to show to the rest of the team and to develop.
Before stepping into the redesign, I wanted to get a first-hand understanding of the problems users were facing with the current PAC. My goal was to observe these problems directly, empathically putting myself in their shoes, to gain valuable insights into their pain points and challenges while using the product. This user-centric approach was one of the foundations for the redesign efforts, ensuring that we addressed the most pressing issues to create a more user-friendly and effective solution.
User Test
1. Understand PAC2021
Aiming to have an in-depth understanding of the functions, features, and benefits of PAC2021, I used some resources available on the web where I found an in-depth explanation. Here are some of the resources I employed:
2. User Test Goals
The goal of these usability testing is to understand how users interact with PAC2021 — specifically any difficulties they encounter; this will help improve the product by enabling us to identify friction and optimize the user experience. The goals for this user test are the following:
Identify if users can successfully download PAC2021.
Identify if users can upload a PDF document to be analysed.
Identify if users distinguish if the document is PDF/UA or WCAG compliant.
Identify if participants know the meaning of PDF/UA or WCAG.
Find out if the participants understand the functions of the different features.
Identify if the participants find the product user-friendly.
3. Test Strategie
Testing Calendar
User test was made between the 1st and 12th of August 2023.
Duration
Each user test had a duration of 20 minutes, the objective is to obtain as much relevant information from each participant.
Tools
Zoom
PAC2021
4. Participants
In order to have a diverse opinion and approach, participants for this test must be over 18 years old, work in government offices, or private companies, or require generating official documentation, not be focused on one single geographical region.
Participants
Age
Gender
Profession
Geographic region
A) Download PAC2021
B) Analyze PDF compliance
C) Understand features
A) Download PAC2021
“About” section
We have introduced a new image in the About section with the aim of providing a refreshed visual experience. Additionally, this window serves as a gateway for users to access the PAC and Axes4 websites directly.
Extra Information
Information regarding boat usage has been incorporated to appear when the user hovers over the buttons. This aims to prevent frustration, particularly for new users, by providing guidance on how to effectively use the program.
3
+18
2 F, 1 M
private companies
Western Europe and North America
5. Running the Test
Test escenario
“You have heard about PAC2021 and want to download it to give it a try.”
Research objectives
Identify if users can successfully download PAC2021.
Task:
Download and open PAC2021
Questions
Please download PAC2021 to your computer.
Where do you need to click to open?
Test escenario
“Imagine that after creating a document you are interested in checking if your PDF document meets the accessibility standards.”
Research objectives
Identify if users can upload a PDF document to PAC2021.
Understand if users can identify if the document is PDF/UA or WCAG compliant.
Identify if users know the meaning of PDF/UA or WCAG.
Task:
Upload a PDF and identify whether the document is PDF/UA or WCAG compliant.
Questions
How would you upload an existing PDF document?
Is the document PDF/UA or WCAG compliant?
Do you understand the meaning of PDF/UA or WCAG?
How would you test another document?
Test escenario
“After identifying if the document is not compliant, imagine that you want to know the areas to be corrected.”
”Research objectives
Identify if users can find where to go to see where the areas are to be corrected.
Identify if users understand the meaning of the 4 buttons below.
Task:
Show where to go to identify the mistake to be corrected in the document.
Questions
Where would you go to identify where is the error in the document?
Where would you click to find that result?
Do you understand the meaning of the 4 buttons below?
6. Test Results
Overall, the users were confused about how to install PAC2021, they were not able to do it smoothly, and they were overwhelmed with the number of documents inside the file.
“I clicked .exe document and nothing happens, where do I need to go?”
“Can you help me to install it?”
“Is this the right way?”
“Do I need to actualize my computer?”
B) Analyze PDF compliance
All the participants were able to identify whether the PDF is compliant or not however, none of them could tell me the meaning of PDF/UA or WCAG.
2 of 3 users were able to identify where to upload a PDF document, however, they employed some time to find out how to do it.
The participant clicks the “about” icon to upload PDF, then tries to click on the header.
“The upload icon should be different or if I pass the mouse over it (hover) I would like to see an instruction.”
1 of 3 users when asked to upload another document were not able to perform the task.
C) Understand features
None of the participants were able to find where to go to see the areas to be corrected in the document, only after a time and with frustration were able to find the solution.
None of the participants understand the meaning of the 4 buttons/features.
D) Users Final Comments
“In general, it was a little bit complicated to use.”
One of the participants thinks download instructions are not clear and with mistakes.
“I think this software is not for users without basic knowledge of accessibility.”
“I would like to see question marks (?) in some terms/words because I don’t understand what it is referring to.”
“Icons are not what I am used to (referring to upload)”
Wireframing and Prototype
After gathering insights from user test feedback, the Head of Development emphasized the significance of preserving a clear product design evolution path to prevent user frustration. In response, I started crafting various wireframes with different levels of fidelity. This iterative process continued until I arrived at the ultimate and refined design, ensuring a smooth and frustration-free user experience.
Drop In/ Open PDF
Based on the feedback from user testing, we identified that simply dropping in a document for analysis was not intuitive enough for participants. While we have retained the option to do so, we have also introduced an alternative method. Now, users can click on the document space, and the system will enable them to search through different files to find and download the desired document.
Results in Detail
This function is important as it allows users to view the detailed information analyzed by PAC upon clicking the button. It's noteworthy that clicking on errors enables users to pinpoint the exact problem requiring attention. To address participants' confusion in understanding errors, we have incorporated a title on the right side specifying the issue, accompanied by a "?" icon. The intention is to provide users with access to relevant information on the evaluated topic.
Functions
The presentation of buttons for other functions, namely Logical Structure, Screen Reader Preview, and Document Statistics, has been revised. Given that these functions are not deemed as crucial, only the title is now displayed when the user hovers over the buttons.
