Chip Li李鸿铭

Gainesville, FL

Where should people stay in control? · ARCHED · LOGEN AI · 2024–2025

One AI proposes, another explains, the educator decides

How do educators stay the decision-maker when AI drafts their learning objectives?

My role
First author and lead developer. Designed the ARCHED framework and built LOGEN AI, its public implementation.
Method
Framework design, then evaluation: AI-versus-expert agreement on 120 learning objectives, a blind comparison of 30 AI-written and 30 human-written objectives, and feedback from two instructional design experts.
Key insight
Educators valued choosing which AI objectives to keep over receiving a finished set. A separate evaluator that shows its reasoning makes AI output checkable.
Outcome
AI objectives matched human-written ones on all five quality criteria in a blind review. The framework has since been featured by the OECD, assigned in a Routledge textbook, and used as a reference point by the Online Learning Consortium.
ARCHED three-phase workflow: initial generation, collaborative refinement with the analysis engine, and assessment development, with an iterative refinement loop

Problem

AI can write a lesson plan in seconds. That is the problem.

AI tools now produce complete instructional materials that look competent, are often thin on pedagogy, and say nothing about why. When AI writes everything, the educator’s job shrinks to approving it.

We wanted the opposite: AI that widens an educator’s options while the educator stays the decision-maker, grounded in Bloom’s taxonomy so every suggestion can be checked against a framework teachers already use.

Design

Separate the AI that writes from the AI that checks

ARCHED (AI for Responsible, Collaborative, Human-centered Education Instructional Design) is the framework; LOGEN AI is the public tool that implements it. Its three phases are shown at the top of this page: generate, refine, then build assessments, with the educator able to loop back at any point. The core move is splitting the AI in two, and giving every decision to the educator:

  • The educator sets the frameGrade level, subject, and the cognitive level they want, before anything is generated.
  • A generator proposesThree to five candidate objectives, never a final set.
  • An evaluator explainsA separate agent classifies each objective’s cognitive level, scores measurability and clarity, and says why.
  • The educator curatesEdit, keep, or discard each one. Nothing is saved without an explicit choice.
LOGEN AI quality analysis showing the Bloom level distribution and grade-level appropriateness
The evaluator’s report: distribution across Bloom levels and grade fit, with reasons.

Evaluation

Is the evaluator right, and is the output good enough?

Most disagreements were between adjacent levels in the middle of the taxonomy, the same places human experts disagree.

κw .83evaluator vs. expert on 120 objectives
30 vs 30AI vs. human objectives, rated blind
5 of 5quality criteria rated alike for AI and human objectives
“Having the freedom to select which objectives align with student needs and course goals, rather than accepting all generated content, helps maintain instructional control while leveraging AI assistance.”Instructional design expert, pilot feedback
Confusion matrix of AI versus expert Bloom levels, strongest at Remember and Create
Evaluator vs. expert across Bloom levels: near-perfect at the extremes, adjacent-level confusion in the middle.

Impact

From framework to a public tool

LOGEN AI is live at logen.viablelab.org with a tutorial video. Later versions let educators edit an objective directly inside the quality report, with a prompt to re-check it, and rebuild reports only when objectives change. One request is still open: experts asked for integration with learning management systems.

LOGEN AI main interface with configuration, preview, and saved objectives panels
The public tool: configure, preview, and save, with the educator choosing at every step.

Reach

A workshop paper that became a reference point

ARCHED was a spotlight paper at a AAAI 2025 workshop. Within a year and a half, people outside our lab started using the name itself, not just citing the paper: an international policy report explains it, a textbook assigns it, and newer frameworks define themselves against it.

  1. Mar 2025
    iRAISE workshop, AAAI 2025 ↗Venue

    Spotlight paper, published in PMLR vol. 273. Travel scholarship.

  2. May 2025
    Online Learning Consortium ↗Professional body

    Its AI Course Compass framework names “existing frameworks like OLC’s AI Strategy, ETHICAL Principles, and ARCHED” and defines what it adds beyond them. Republished by Texas A&M–Corpus Christi.

  3. Jun 2025
    Interactive AI Magazine (AAAI) ↗Professional body

    The AAAI 2025 workshop report picks ARCHED as its example of human-AI collaboration in instructional design.

  4. Aug 2025
    Worcester Polytechnic InstituteVenue

    Invited guest lecture on ARCHED for the graduate User Modeling course.

  5. Jan 2026
    OECD Digital Education Outlook 2026 ↗Policy report

    Chapter 3 gives ARCHED its own box (Box 3.1), explains the generator and analysis engine, and returns to it on transparency, human oversight, and future teacher authoring tools.

  6. 2026
    Routledge, Streamlined ID (textbook) ↗Textbook

    Listed as a chapter resource in two chapters of an instructional design textbook.

  7. Jul 2026
    Discover Artificial Intelligence (Springer) ↗Scholarship

    A new framework, ALT-ED, positions itself as the run-time complement to ARCHED’s design-time workflow and compares the two directly.

if I ran it again

Two expert reviewers and one evaluator make a pilot, not proof. Next: a study with practicing teachers on their own courses, measuring how often they keep, edit, or discard AI objectives, and whether the evaluator’s explanations change their choices. I would also remove a choice I made: the quality check shows four progress stages for what is really two model calls. It looks thorough, but it is not honest.