Skip to content

Chapter 5 of 7

Research, Testing, and Analytics

Because internal logic almost never matches real user expectations precisely, IA decisions should be tested with users. Card sorting is the foundational research method: participants group topics or items into clusters that reveal intuitive category structures. Open card sorting asks participants to create their own category names — best for discovering categories from scratch — while closed card sorting hands them predefined categories and is best for validating an existing structure. A hybrid approach offers predefined categories plus the option to add new ones, balancing discovery and validation. A typical study recruits 15–30 participants per audience segment, since returns diminish quickly beyond roughly thirty. Results are summarized in a dendrogram, a tree diagram showing how items cluster, and agreement scoring — often using the Jaccard index — measures how consistently participants grouped items together.

Tree testing validates whether users can find items inside a proposed navigation structure without any visual design to distract them; participants click through a plain text tree to locate targets. Two metrics matter most: success rate (the percentage who choose the correct destination on the first try) and directness (whether they reached it without backtracking — high directness signals clear paths). First-click testing asks where users click first on a rendered page, and research shows that first clicks correlate strongly with overall task success. The "one-second rule" complements these methods: if a new user cannot get a sense of where they are within about one second of arrival, the IA needs work. User mental models — the internal representations people have of how a system or domain is organized — should be compared against the domain model (the actual underlying structure), and IA succeeds when the two align.

Before reorganizing, a content inventory or content audit is the foundation. A quantitative audit counts pages, types, traffic, and age to give a fast picture of scale and patterns, while a qualitative audit evaluates quality, voice, and relevance to decide what should change. A ROT analysis — flagging redundant, outdated, and trivial content — is a typical first step before restructuring. Expert review still has value: a heuristic evaluation against established principles finds many issues cheaply without users, and an IA score rubric can surface weak areas for improvement.

Several of Nielsen's ten usability heuristics map directly onto IA: the match between system and the real world (use familiar concepts, not internal jargon), user control and freedom (clear ways back, including back-button safety), recognition rather than recall (visible navigation over hidden menus), and consistency and standards (use platform conventions so existing user knowledge transfers). Beyond evaluation, an IA workshop is a facilitated session that aligns stakeholders around content priorities, audience needs, and navigation structure. Inputs are often synthesized through an affinity diagram that groups ideas by similarity, while a user journey map shows the full experience over time and a service blueprint aligns user-facing IA with backstage processes. Click depth, navigation analytics, and site search analytics together provide ongoing signals: which navigation paths users actually take, what they search for, and what zero-result queries keep recurring.

All chapters
  1. 1Foundations of Information Architecture
  2. 2Organization Systems and Vocabularies
  3. 3Navigation Design
  4. 4Labeling and Language
  5. 5Research, Testing, and Analytics
  6. 6Search, Findability, and Wayfinding
  7. 7Content, Governance, and Delivery

Drill it

Reading is not remembering. These come from the Information Architecture deck:

Q

What is information architecture?

Information architecture is the practice of organizing content, navigation, and labeling so users can find and understand information easily.

Q

Why does information architecture matter?

Good IA reduces confusion, improves discoverability, and makes interfaces feel easier to use.

Q

What is a navigation hierarchy?

A navigation hierarchy is the structure of categories, sections, and pathways users move through to reach content.

Q

What is labeling in information architecture?

Labeling is the naming of menus, sections, links, and content so users can predict what they will find.