Modern competitive games have a great deal of anti-cheat software working to make sure you can’t hack the games to get a competitive advantage. [Kamal Carter] decided to work around this by building a physical aimbot for popular FPS Valorant.
The concept is straightforward enough. [Kamal] decided to hardmount an optical mouse to a frame, while moving a mousepad around beneath it with an off-the-shelf Cartesian CNC platform, but modified to be driven by DC motors for quick response. This gave him direct control over the cursor position which is largely undistinguishable from a human being moving the mouse. Clicking the mouse is achieved with a relay. As for detecting enemies and aiming at them, [Kamal] used an object detection system called YOLO. He manually trained the classifier to detect typical Valorant enemies and determine their position on the screen. The motors are then driven to guide the aim point towards the enemy, and the fire command is then given.
The system has some limitations—it’s really only capable of completing the shooting range challenges in Valorant. The vision model isn’t trained on the full range of player characters in Valorant, and it would prove difficult to use such a system in a competitive match. Still, it’s a neat way to demonstrate how games can be roboticized and beaten outside of just the software realm. Video after the break.
I don’t understand why you use a mechanical device to interface with a physical mouse. Why not just replace this with a simple HID enabled MCU like a cheap Arduino with HID support? Then you can send mouse coordinates without any complex moving parts. You could still implement some randomness to emulate a human.
I’m pretty sure you could also mount a small lcd screen under the mouse’s camera sensor and move a grid of pixels around simulating movement. Pretty sure the sensor would pick it up, if you use the right colors.
That’s a pretty cool idea
Only very old mice with red LEDs. Nowadays computer mice CMOS-Sensors are sensitive for IR (800-900nm) only.
then why are they still using red led lighting on it? normal spectral halfwidth of a red LED is nowhere near wide enough for that to be an effective illuminator if what you said is true.
I can’t remember the last time I saw a mouse sensor glow in visible light.
I am pretty sure that has already being done using a rPiPico. I wonder if this is going to lead to requirind “signed” peripherals to play competitevely and if people will start spoofing those too.