ProfessionalPro EducationEdu Store Sign In User Profile 0

Hardware Software Cloud Documentation Community ForumDiscordProject HubArduino DayUser Groups Blog About Sign In Back Profile My Courses My Plans Sign Out User Profile

ExoKit is a novice-friendly foundation for building powered exoskeletons VIGOR fuses fashion and technology in an avant-garde wearable Blog Home

单个 RGB 相机将手掌变成混合现实交互的键盘

Arduino Team — May 9th, 2025 混合现实中的交互是一个挑战。没有人想拿着笨重的控制器,并一次一个地点击大虚拟键进行打字。但人们也不想携带专用的物理键盘设备,只是为了偶尔打字。这就是为什么来自中国清华大学的一组计算机科学家开发了一种名为 Palmpad 的交互技术,该技术仅使用单个 RGB 相机和一个 Arduino 即可实现打字。

这并不是一个新想法,但其执行方式非常出色。它的工作原理是将相机对准用户的手。在混合现实中,用户会看到一个小的键盘投影在他们的手掌上。然后,他们用另一只手的食指敲击虚拟键。相机跟踪食指指尖相对于手掌的运动,以确定用户触摸了哪些虚拟键。

其他人先前尝试实施此方法但成功有限,原因有两个:不可靠的指尖跟踪和较差的触摸检测。

清华大学团队通过复杂的视频帧处理技术(例如运动提取)以及为此目的训练的卷积神经网络 (CNN) 解决了第一个问题。他们的系统能够非常准确地确定指尖相对于手掌的位置。

他们通过使用一个 Arduino UNO Rev3 监测从一只手传递到另一只手的电信号解决了第二个问题。这些信号来自波形发生器,该波形发生器以 12.5MHz 的频率产生两个非常低电流、低电压的交流信号。一个是参考信号,另一个是从一只手上的电极传递到另一只手上的电极的信号。 Arduino 通过模拟乘法器和低通滤波器来监测这些信号,检测阻抗变化,表明手指与手掌接触。

用户指尖在那一刻所处的位置被注册为“点击”。该团队报告触摸识别准确率为 97.0%,这使得 Palmpad 非常可靠。

有关 Palmpad 的更多详细信息,可以在研究人员的论文中找到图片来源:He and Wang et al. Boards:Uno Categories:Arduino

Back to top Trademark Contact Us Distributors Careers Help Center Whistleblowing Digital Services Act

Newsletter

Please insert a valid email Subscribe

FOLLOW US

Trademark Contact Us Distributors Careers Help Center Whistleblowing Digital Services Act Terms Of Service Privacy Policy Security Cookie Settings © 2025 Arduino Terms Of Service Privacy Policy Security Cookie Settings Help

Title

Arduino Newsletter

We care about the privacy and personal data of our users. To continue, please give us your consent:

Sign up

Thank you for subscribing!

Curious to learn more?

Are you also a teacher , student , or professional that loves using Arduino in your day-to-day activities? Then keep up-to-date with either our STEM or Professional monthly newsletters. Arduino weekly newsletter (already subscribed)

Subscribe

Arduino Survey

We'd like to get to know you little better. Please help us improve by answering this super short optional survey. What is your profession?

Which categories best describe your interests?

Select your country (optional) Skip Survey Submit logo × Notice We use cookie for technical purpose and, with your consent, also for analytical and profiling purpose as specified in our cookie policy. You can express your consent by selecting the cookies you intend to accept by clicking “Configure”. If you wish to continue browsing without cookies that are not strictly necessary, you can deny consent by clicking on “Reject” or by closing this banner by clicking the x in the upper right corner. Press again to continue 0/1 CONFIGURE REJECTACCEPT