Telepresence Robot For “Doing The Rounds”

October 3, 2021 by Danie Conradie 10 Comments

When you are responsible for maintaining devices at a client’s location, software tools like remote desktop and SSH are great, but sometimes they are not enough. For some problems, you need to get eyes and hands on the device to figure out what’s going on and fix the problem. This is a challenge [Will Donaldson] from EDM Studio is all too familiar with. They develop and maintain interactive museum exhibits all over the world, so they created Omni, a modular telepresence robot for inspection, maintenance, and a variety of other tasks.

The Omni uses a set of three omni-wheels under its base, powered by DC geared motors with encoders, each controlled by a separate motor driver and Arduino Nano. A similar arrangement was used by Mark Rober for his domino art robot. The main controller is a Raspberry Pi 4 running ROS2 (Robot Operating System), which takes inputs from a 360 LIDAR sensor, high-quality camera module, and IMU.

All the components are mounted on a series of plates separated using threaded rods. This arrangement allows for maximum flexibility and space, especially the open-top plate, which has a grid of holes machined in to allow almost anything to be mounted. In this case, a robotic arm is mounted for manipulating the environment. Another neat feature is the charging station connector, consisting of two parallel metal strips on the outside of the robot.

Omni’s mission is very similar to that of Spot, the robotic dog from Boston Dynamics intended, among other things, for Industrial Inspection. What practical purposes would you use Omni for? Let us know in the comments below.

This Horrifying Robot Is Here To Teach You A Lesson

July 1, 2021 by Tom Nardi 8 Comments

No, despite what it might look like, this isn’t some early Halloween project. The creepy creation before you is actually a tongue-in-cheek “robot” created by the prolific [Nick Bild], a topical statement about companies asking their remote workers to come back into the office now that COVID-19 restrictions are being lifted. Why commute every day when this ultra realistic avatar can sit in for you?

OK, so maybe it’s not the most impressive humanoid creation to ever grace the pages of Hackaday. But if you’re looking to spin up a simple telepresence system, you could do worse than browsing through the Python source code [Nick] has provided. Using a Raspberry Pi 4, a webcam, and a microphone, his client-server architecture combines everything the bot sees and hears into a simple page that can be remotely accessed with a web browser.

Naturally this work from home (WFH) bot wouldn’t be much good if it was just a one-way street, so [Nick] has also added a loudspeaker that replays whatever he says on the client side. To prevent a feedback loop, his software includes a function that toggles which direction the audio stream goes in by passing the appropriate commands to the bot over SSH; a neat trick to keep in mind for your own, less nightmarish, creations.

If you’re looking for something a bit more capable and have some cardboard laying around, this DIY telepresence mount for your phone might be a good place to start.

Continue reading “This Horrifying Robot Is Here To Teach You A Lesson” →

OPARP Telepresence Robot

August 31, 2020 by Brian McEvoy No comments

[Erik Knutsson] is stuck inside with a bunch of robot parts, and we know what lies down that path. His Open Personal Assistant Robotic Platform aims to help out around the house with things like filling pet food bowls, but for now, he is taking one step at a time and working out the bugs before adding new features. Wise.

The build started with a narrow base, an underpowered RasPi, and a quiet speaker, but those were upgraded in turn. Right now, it is a personal assistant on wheels. Alexa was the first contender, but Mycroft is in the spotlight because it has more versatility. At first, the mobility was a humble web server with a D-pad, but now it leverages a distance sensor and vision, and can even follow you with a voice command.

The screen up top gives it a personable look, but it is slated to become a display for everything you’d want to see on your robot assistant, like weather, recipes, or a video chat that can walk around with you. [Erik] would like to make something that assists the elderly who might need help with chores and help connect people who are stuck inside like him.

Expressive robots have long since captured our attention and we’re nuts for privacy-centric personal assistants.

Continue reading “OPARP Telepresence Robot” →

Nightmare Fuel Telepresence ‘Bot May Become Your Last Friend

May 9, 2020 by Kristina Panos 15 Comments

After this pandemic thing is all said and done, historians will look back on this period from many different perspectives. The one we’re most interested in of course will concern the creativity that flourished in the petri dish of anxiety, stress, and boredom that have come as unwanted side dishes to stay-at-home orders.

[Hunter Irving] and his brother were really missing their friends, so they held a very exclusive hackathon and built a terrifying telepresence robot that looks like a mash-up of Wilson from Castaway and that swirly-cheeked tricycle-riding thing from the Saw movies. Oh, and to make things even worse, it’s made of glow-in-the-dark PLA.

Now when they video chat with friends, TELEBOT is there to make it feel as though that person is in the room with them. The Arduino Uno behind its servo-manipulated vintage doll eyes uses the friend’s voice input to control the wind-up teeth based on their volume levels. As you might imagine, their friends had some uncanny valley issues with TELEBOT, so they printed a set of tiny hats that actually do kind of make it all better. Check out the build/demo video after the break if you think you can handle it.

Not creepy enough for you? Try building your own eyes from the ground up.

Continue reading “Nightmare Fuel Telepresence ‘Bot May Become Your Last Friend” →

Robot Allows Remote Colleagues To Enjoy Office Shenanigans

October 17, 2019 by Anool Mahidharia 3 Comments

[Esther Rietmann] and colleagues built a Telepresence Robot to allow work at home teammates to have a virtual, but physical presence in the office. A telepresence robot is like a tablet mounted on a Roomba, providing motion capability in addition to an audio/video connection. Built during a 48 hour hackathon, it is a bit crude under the hood and misses out on some features, such as a bidirectional video feed. But overall, it pretty much does what is expected from such a device.

The main structure is build from cheap aluminium profiles and sheets. A Raspberry Pi is at the heart of the electronics hardware, with a servo mounted Pi-camera and speaker-microphone pair taking care of video and audio. The two DC motors are driven by H-bridges controlled from the Pi and an idle swivel caster is attached as the third wheel. The whole thing is powered by a power bank. The one important thing missing is an HDMI display which can show a video feed from the remote laptop camera. That may have been due to time constraints, but this feature should not be too difficult to add as a future upgrade. It’s important for both sides to be able to see each other.

The software is built around WebRTC protocol, with the WebRTC Extension from UV4L doing most of the heavy lifting. The UV4L Streaming Server not only provides its own built-in set of web applications and services, but also embeds a general-purpose web server on another port, allowing the user to run and deploy their own custom web apps. This allowed [Esther Rietmann]’s team to build a basic but functional front-end to transmit data from the remote interface for controlling the robot. The remote computer runs a Python control script, running as a system service, to control the drive motors and camera servo.

The team also played with adding basic object, gesture and action recognition features. This was done using PoseNet – a machine learning model, which allows for real-time human pose estimation in the browser using TensorFlowJS – allowing them to demonstrate some pose detection capability. This could be useful as a “follow me” feature for the robot.

Another missing feature, which most other commercial telepresence robots have, is a sensor suite for collusion avoidance, object detection and awareness such as micro switches, IR / ultrasonic detectors, time of flight cameras or LiDAR’s. It would be relatively easy to add one or several sensors to the robot.

If you’d like to build one for yourself, check out their code repository on Github and the videos below.

Continue reading “Robot Allows Remote Colleagues To Enjoy Office Shenanigans” →

Double 3: Your Instant Physical Presence Anywhere, No Matter Where You Are

August 31, 2019 by Maya Posch 18 Comments

Telepresence is one of those futuristic buzzwords that’s popped up a few times over the decades; promising the ability to attend a meeting in New York City and another in Tokyo an hour later, all without having to leave the comfort of your home or office. This is the premise of Double Robotics’ Double 3, its most recent entry in this market segment, as the commercial counterpoint to more DIY offerings.

More than just a glorified tablet screen.

Looking like a tablet perched on top of a Segway, the built-in dual 13 megapixel cameras allow the controller to get a good look at their surroundings, while the 6 beamforming microphones should theoretically allow one to pick up any conversation in a meeting or on the work floor.

Battery life is limited to 4 hours, and it takes 2 hours to recharge the built-in battery. Fortunately one can just hop over to another, freshly charged Double 3 if the battery runs out. Assuming the $3,999 price tag doesn’t get in the way of building up a fleet of them, anyway.

Probably the most interesting aspect of the product is its self-driving feature, which has resulted in a whole range of sensors and cameras (Intel RealSense D430 stereo vision depth sensors) being installed. To handle the processing of this sensor data, the system is equipped with an NVidia Jetson TX2 ARM board, running Ubuntu Linux, which also renders the mixed-reality UI for the user with way points and other information.

Currently Double Robotics accepts sign-ups for the private beta of the Double 3 API, which would give developers access to the sensor data and various autonomous features of Double 3’s hardware. Co-founder of Double Robotics, [Marc DeVidts] stated to Hackaday that he is looking forward to seeing what people can build with it. Hopefully this time people will not simply take the thing for a joyride, like what happened with a predecessor of the Double 3.