Products & Tools

How AI smart glasses lifted a mock exam score from 28 to 87

In a 200-question mock certified appraiser exam, Hankook Ilbo reporter Byun Eun-saem averaged 28 without glasses and 87 with Rokid glasses linked to ChatGPT, finishing in 50 minutes.

This is what taking exams with smart glasses can feel like
This is what taking exams with smart glasses can feel likeRamdlon / pixabay
By Sophie Lindqvist6 min read

Why it matters

  • Byun Eun-saem averaged 28 without smart glasses and 87 with them on the same 200-question mock exam.
  • Her completion time fell from 1 hour 37 minutes to 50 minutes.
  • The first-stage exam has 200 questions, five subjects and a 200-minute limit.
  • The qualification’s final pass rate is 7.23 percent, and candidates typically prepare for around three years.
  • The Rokid glasses cost 990,000 won ($680); passing required 40 per subject and a 60 overall average.

By Sophie Lindqvist

Hankook Ilbo reporter Byun Eun-saem averaged 28 on a 200-question mock certified appraiser exam without assistance, then 87 with Rokid smart glasses, cutting her time from 1 hour 37 minutes to 50 minutes.

The result matters because the qualification’s final pass rate is 7.23 percent and candidates typically prepare for around three years. Hankook Ilbo said the prospect of relatively stable income attracts young people, while a high-stakes exam cheating scandal had pushed AI-assisted cheating into the national spotlight.

The test also captures a wider shift toward computer-based testing, or CBT. The certified appraiser exam still uses paper, but national qualification tests and medical licensing exams have moved toward CBT, according to the report.

What did the mock exam measure?

Byun took the same 200-question set twice on a computer: first without assistance, then with Rokid smart glasses connected to ChatGPT through her smartphone. The first-stage test has a 200-minute limit and five subjects:

  • Civil law
  • Principles of economics
  • Principles of real estate studies
  • Laws and regulations related to appraisals
  • Accounting

According to Hankook Ilbo, a candidate must score at least 40 in each subject and 60 overall to pass. Byun did not take the real qualification, but her mock used its questions and scoring structure.

One question established the difficulty. It asked: “A owns X land, which B leases and on which B owns building Y. B enters into an agreement with C to establish a right of lease on a deposit basis over building Y. Which of the following statements is incorrect?”

The five options added hypotheticals about partial destruction, an auction application and C’s efforts to monetize the property. Byun, who has a humanities degree, spent eight minutes on that first question and said she found the relationships among A, B and C impossible to untangle.

Takeaway: The mock reproduced a high-volume test with strict subject-level and overall thresholds.

Why was the exam hard without assistance?

Byun said unfamiliar legal and economic terms soon piled up: expropriation by adjudication, neighboring land relations, corner lots along medium-sized roads and the Cobb-Douglas production function. Because she did not know the material, she sometimes picked the option that seemed most unethical.

By question 30, she said her concentration was fading and she was looking toward the glasses beside her. She finished all 200 questions in 1 hour 37 minutes, averaged 28 points and failed every subject.

Her scores stayed in the 20s and 30s whether she reasoned through a question or guessed. Byun noted that each subject was worth 100 points and every question offered five choices, so random guessing carried an expected score of 20.

Takeaway: Without AI, unfamiliar material quickly consumed both attention and time, even with a full 200 minutes available.

How did the glasses deliver answers?

Byun learned the Rokid controls in 15 minutes. The glasses cost 990,000 won ($680), and she borrowed them from the office of Democratic Party of Korea Rep. Kim Moon-soo, who proposed legislation against exam cheating after the recent scandal.

Hankook Ilbo reported that similar devices had repeatedly appeared in cheating attempts on national technical qualification exams and the Test of English for International Communication (TOEIC), with several cases resulting in detection.

When Byun said, “Hi, Rokid,” green text appeared on the lenses like movie subtitles, with the display reflected like a hologram. She could adjust its brightness, angle and audio volume to keep nearby people from seeing or hearing it. A faint square outline remained visible from the front, but long hair or a lowered head could conceal it.

Byun touched a protruding part of the frame with two fingers and said, “Give me the answer to the question in front of me as text.” The glasses photographed and uploaded the question within two seconds. Another three seconds brought back the answer and its explanation.

The legal question that had taken eight minutes returned in five seconds. Byun said the display made each party’s position clear and lifted the frustration that had built during the unaided attempt. From there, she only had to take clear pictures and select answers.

Takeaway: A short voice command and a fast image upload turned the glasses into a live answer sheet, while adjustable displays reduced obvious visibility.

When did the speed shortcut take over?

After about 10 questions, Byun started photographing two at once and requesting both answers together. The sheet filled quickly, but longer questions took more than five seconds to load. That delay began to feel tedious, so she changed the command to: “Give me the answer to the question in front of me as text within three seconds.”

At first, Byun read every explanation, hoping to recover the understanding that had failed her in the first attempt. Gradually, she decided that understanding no longer mattered and added: “Skip the explanation.”

She also learned which angle produced a usable image. By the end, she kept her head still and transcribed answers as the glasses dictated them. The source described a change in goal: she moved from using AI to explain difficult material to using it only to produce results.

Takeaway: The workflow trained Byun to value faster output over learning, after only 10 assisted questions.

Where did the glasses slow down?

Accounting remained the hardest subject. Its questions ran longer and contained more mathematical formulas, so Byun struggled to capture both the question and all five choices in one shot. She repeatedly adjusted the camera angle, and the image sometimes became blurred.

The glasses returned a direct warning: “The text on the screen is blurry, making it difficult to identify the question accurately. Please move the camera closer to the screen or clean the lens and try again.” Photography and loading stretched to 10 seconds for some items.

Byun said the repeated head movements would draw attention in an actual exam room. That helped her understand why Han, the tax accountant exam candidate at the center of the cheating scandal, had obtained a separate miniature camera. Clear, accurate images were the essential part of the system, she concluded.

Even so, Byun finished the mock in 50 minutes with an 87 average. She scored 68 in civil law because she was still adjusting to the glasses, and between 80 and 90 in the other subjects. In accounting, she got only one question wrong despite repeatedly retaking pictures.

Takeaway: Better hardware solved the speed bottleneck, but image quality and visible camera movement remained practical weak points.

What does the experiment mean for exam security?

Hankook Ilbo reported that Han, a top-performing tax accountant exam candidate identified only by his surname, had cheated on a high-stakes test. The revelation drew national attention, and the report also said allegations had surfaced that cheating occurred in that year’s certified appraiser test.

Kim Moon-soo’s proposed legislation aims to prevent cheating on exams. The policy stakes will grow as CBT expands, because Byun’s mock combined computer-based questions with glasses that can photograph a screen, display text, conceal part of the interface and produce answers in seconds.

Byun drew a blunt conclusion: “There may be people who have never cheated using AI, but those who do are unlikely to stop after just one attempt.”

Her 15-minute learning curve shows why exam policy cannot focus only on hardware. The workflow produced accurate answers in five seconds and became faster as the reporter stopped reading explanations.

Takeaway: As more qualifications move online, exam security must address a workflow that can produce a correct answer in five seconds after a 15-minute setup.

Source: feed.koreatimes.co.kr

Share this article:

More from Sophie Lindqvist

Sophie Lindqvist

Show full bio

Staff writer covering regulation, policy and their impact on artificial intelligence and machine learning at AI In Context.

749 articles

Related articles

  1. AI Glasses Solved Four CSAT Math Questions in Ten Seconds
  2. Korea adds 8,400 staff for AI-cheating safeguards at CSAT
  3. Korea to Cut Wi-Fi at College Entrance Exam Sites Over AI Cheating
  4. South Korea Cracks Down on AI Cheating Before Thursday’s CSAT
  5. Top Tax Exam Scorer Admits Using Miniature Camera and AI to Cheat

« Previous articleNext article »