Hacker News new | past | comments | ask | show | jobs | submit

Mouseless – keyboard-driven control of macOS/Linux/Windows

https://mouseless.click
All of these seem like the wrong solutions to the problem. Crowbar solutions. The problem is: "How do I click stuff without the mouse.". "Overlay a grid that you can address with the keyboard" cannot be the elegant answer. A keyboard that IS a mouse, on demand, seems better. The machine thinks it's a mouse. You just control it with keys. It's butter-smooth. The UHK has a mouse layer and it's crazy fast, intuitive and I hardly touch my mouse ever. https://uhk.io/uhk60
I prefer ShortCat's model:

https://shortcat.app/

Similar to Vimium, but for the whole OS. Apparently Homerow is similar, judging from comments I'm seeing here.

I really wish I knew an equivalent for Linux. I might even leave Gnome behind if a different DE has a good model for this.

loading story #48415029
ShortCat has a beautiful slogan:

"Manipulate macOS masterfully, minus the mouse."

I used to use (and love) ShortCat, but it got too slow on my ancient MacBook Pro. I switched to Mouseless, and I actually prefer it now.
loading story #48415030
This is purrrfect ;)

I've been looking for something like this

loading story #48415455
I guess it can solve the problem of navigating mouse for AI agents as keys are more objectively determinant.
Wow, as cool as this is, it's kind of a shame that we need to say "use coords to show where the mouse should click" instead of designing interfaces that keep pointing-device-free users in mind.
With Windows in particular, you absolutely can navigate Windows + Office keyboard only. I do it every day.

Now, third party software, is always going to be all over the place. Stuff that was largely built on Win32 components works fine, but "modern" stylized applications rarely have strong support.

loading story #48412103
loading story #48412163
loading story #48412919
> designing interfaces that keep pointing-device-free users in mind.

Agreed. Using keyboard keys to emulate a mouse cursor seems like it ought to be a last resort for graphical applications that lack proper accessibility affordances.

Contrast that with command palettes, accessibility controls, syntax tree navigation, and other approaches that rely on the names, content, and document structure that users already know rather than a special mode that displays two letter codes that must be read each time or memorized. Many of these other approaches also allow users to activate buttons, menu items, and links that are outside the current viewport or hidden in menus which reduces the overall number of "clicks" required to perform those actions. The downside is that they can take longer to type than a two-letter code. Still, my guess is that for most people it would be overall more efficient to optimize for cognitive load than pure speed.

(Though in the long run, I suspect that improvements in eye-tracking will lead to hybrid systems that are both lower cognitive load and faster than any of these.)

A tiled window manager with Qutebrowser and it's vimium style shortcuts is the closest I have come to this.
loading story #48413370
I'm curious if there's a program that uses a simple detection model for UX components to locate clickable areas. This would allow for global navigation similar to VimiumC
loading story #48412566
I think it's ok that hardware and software are designed with the 99% in mind. After that you probably run into competing interests/trade-offs anyway (a system built for ergonomics probably looks different from a system built for speed).
loading story #48413874
I think the controller interfaces for FFXIV is worth a study in this. They designed an interface that is workable for an MMORPG with both mouse and controller (in this case, the controller can act as a proxy for our keyboard).
> interfaces that keep pointing-device-free users

There's plenty of TUIs for the dozens of you to use.

Is it really faster though? I’ve built PoC of something similar and a test game to check how much faster it was to use keyboard. To my surprise mouse was consistently faster ( by a lot).
loading story #48416293
If you wanted to go in the other direction, you could achieve more productivity with faster mouse skills. The competitive FPS genre has spawned a bunch of aim training tools[0] to improve muscle memory.

[0] https://www.3daimtrainer.com/

As someone who went down the keyboard only blackhole, I've rebounded all the way to mouse maximization. Mice are nice! Another tip that really helped me is embracing good mouse acceleration (i.e. not the Windows or Mac built in garbage). This tool has honestly made using a mouse at least 3x better for me: https://github.com/RawAccelOfficial/rawaccel
RIP my hand by RSI
loading story #48413375
If you wanted to go in the other direction, you could achieve more productivity with faster mouse skills.

I was always in the camp that believed that the keyboard was always faster than mouse for complex workflows.

Then a couple of weeks ago I spent most of a day in a hospital emergency room with someone, and couldn't believe the way those E.R. nurses fly through the menus and options in Epic using just a mouse.

I'm now closer to believing that "muscle memory is muscle memory." But I suspect it only works if the windows appear in the exact same place all the time.

loading story #48416070
Some existing similar tools for those who might be curious.

For vim, there's easymotion or hop.nvim.

For tmux, there's Morantron/tmux-fingers.

For Chrome, there's Vimium.

You can also flash your keyboard to have mouse controls (https://docs.qmk.fm/features/mouse_keys).

loading story #48415018
It's interesting, it's true that once you get used to the key combinations everything is more natural and faster, I always used browser shortcuts but never system shortcuts.
IMHO, the best I’d seen of mouseless UI was the pentadactyl/vimium/vimperator model (possibly originating with (lynx or elinks somehow) where a hot key was pressed and everything clickable was overlayed with a number allowing a direct click. Obviously simpler than what is being proposed here, but it was my preferred way of using the browser for some time.
loading story #48415785
Related. Others?

Mouseless – fast mouse control with the keyboard - https://news.ycombinator.com/item?id=42396336 - Dec 2024 (120 comments)

Opensource alternatives:

- https://github.com/moverest/wl-kbptr

- https://github.com/petoncle/mousemaster

- https://github.com/y3owk1n/neru

- https://github.com/mjrusso/scoot

- https://github.com/jbensmann/mouseless

- https://github.com/rvaiya/warpd (not really maintained anymore)

https://github.com/msolomon/griddle

This one is recursive-grid for Hammerspoon users on macOS, and is probably the easiest of the open source implementations to fully customize. (I made it years ago)

> https://github.com/y3owk1n/neru

...which supports Vimium-style hints mode as well as the grid-based approach shown in this "Mouseless (app) explained in 80 seconds" video. It also has a very responsive maintainer.

Personally I like vimium's approach much better than the grid. Unfortunately not everything has a good accessibility tree (Zed sadly doesn't), but I just realized loading neru's page that I'm behind in versions. I haven't tried the "Native Vision OCR" addition to hints mode yet.

I also like having a trackpad right on the keyboard (using a SoflePLUS2 right now though I'm not totally sold on column stagger). Then I can use a real pointing device with only a slight movement of one hand. In the Mouseless video, the creator has tried to minimize the distance by putting the mouse between the halves of his keyboard, but I think he's both compromised the keyboard position to ease using the mouse (arms wide and parallel with wrists turned inward rather than arms converging toward a more splayed keyboard with somewhat closer halves, untented to minimize vertical separation compared to the mouse) and might have an uncomfortably small mousepad to avoid doing this even more. Not a compromise I'd want to make.

Shortcat is the one I found I was willing to adopt without much effort: https://shortcat.app
{"deleted":true,"id":48412359,"parent":48412125,"time":1780666544,"type":"comment"}
warpd, properly configured, was working perfectly for me. until i realized i 99% needed it for web surfing. so i switched to kinkHints in firefox, which is covering my link clicking need.
Another new one is stochos: https://github.com/museslabs/stochos

Disclaimer: I'm one of the authors/maintainers.

Looks kinda similar to https://github.com/rvaiya/warpd/ , which is open source and free software. Always worked very well for me on Wayland, but seems to be working on Xorg and macOS as well.
I recently installed https://www.neverclick.com/ (windows only), which also offers an "intelligent" mode that detects possible clickable zones
loading story #48415315
Using closed source software to drive my OS doesn't sound that appealing to me.
Then don't buy it. Not everything in the world needs to be made free just for you.
loading story #48412328
loading story #48414975
If you're on Linux, mouseless [0] may work well for you.

[0] https://github.com/jbensmann/mouseless

loading story #48415085
Yeah, feels kinda weird to think about using a mouse pointer utility with licensing DRM.
I've tried to use software like this and it looks awesome but it wasn't ultimately the solve for me when it comes to ergonomics.

I used a logitech mx mouse with the palm shape or whatever it's called and I realized that it stopped me from putting more of my hand on the desk, pin pointing the pressure of my hand onto the mouse instead of the desk. What helped dramatically was getting a smaller mouse without that thumb/palm shape (the logitech M720 Triathlon), that distributed more of the pressure onto my desk and I haven't had an issue since.

I hope that helps for anyone having similar ergonomic issues!

loading story #48416191
I think I prefer the approach that Homerow uses: https://www.homerow.com/

It's like vimium but for your entire mac. It hooks into the macOS accessibility APIs.

lol, it's Vimium for the OS! that's pretty cool
I still have a keyboard with a track point

I don't understand why they are not popular at all and only a few manufacturers build them.

It doesn't replace a mouse for me, but the track point is between the G H B keys and can be reached without moving the fingers away from the typing position. So it's great for some simple mouse commands.

The trackpoint is the main reason I find it so hard to move away from Lenovo Thinkpads. The buttons under the spacebar alone are super convenient.
loading story #48415411
loading story #48413493
loading story #48413487
loading story #48413519
> I don't understand why they are not popular at all and only a few manufacturers build them.

Because they are ugly, just like ThinkPads that include them.

loading story #48413836
loading story #48413498
For a total opposite tool, there is mousemux (Windows only). You can get multiple mice on the same machine and you can attach a keyboard to each and lock it to a window or a screen.
Whoa! Now that's interesting! I wonder if that would be possible on other OSes...
Does Mouseless support multiple monitors?

I have been trying out similar software for a few years but haven't seen one that would let me "click" outside the main monitor on Windows.

Wow, this brings back the memories of a Byte (I think it was Byte) article about how a person used this strange thing (don't know if it was called "mouse" yet) to keep on working after his keyboard died.

I've been using a "hamster" for some time now. Its top surface is a track pad - nice.

I've been building the same thing for a while https://github.com/huytd/octocmd It has everything you need to throw away the mouse: keyboard tab switching, search and click, vim-style clicking, keyboard scrolling.
I'm on Linux and totally going to give this a try. I switched from multiple monitors years ago to just a laptop and am in permanent portable mode.

I use the pointer stick exclusively so don't have to reposition my hands on the keyboard like with a track pad, but the pointer stick does keep my hardware choice limited, currently a X1 Yoga. If Mouseless would be faster, then I could get a Framework (no pointer stick available).

I'd gladly pay the $50 for lifetime.

Amiga Workbench could be used mouseless by using key combinations to move the mouse around. It was cumbersome, but just good enough to let you use the system if your mouse was broken, or you had plugged a second joystick into the mouse port and couldn't be bothered swapping them to launch a game. Later there were add-ons like Reqtools and MCP which let you use keys more, e.g. Escape to close a window, or Return (Enter) to hit OK on a dialog box.
Anyone interested in this should really try out Homerow (https://www.homerow.app)

(not affiliated, just a happy user for years now)

How do you handle apps that don't have great accessibility support?

Hell - after installing, it shows a slider to help adjust the label size of each element - but I can't slide it because (surprise) Homerow doesn't support horizontal slider elements like this.

I also can't highlight text on the screen etc.

Struggling to find a usecase for Homerow that isn't just navigating chrome or my filesystem.

But that is Mac only.
loading story #48415568
I've had "mouseless" on every system since getting a keyboard that supports it (in my case the Ultimate Hacking Keyboard). It's changed my compute experience and I can never go back (so I hope they don't go out of business)
I’ve never seen anything like this. Really cool to see a UX that is totally novel.
saying it is for Linux made me think it would be open source as there are already lot of things people can do without mouse...

There is an extensive list of window managers, like Sway or I3, file managers like Vifm and Ranger and browsers like Luakit.

fwiw Ive been using mouseless for a while now and I've been enjoying it! I like how i can remember the regions on the screen and the hotkeys are consistent. I also like that it makes the whole screen clickable not just what the app is able to recognize as a button.
When I first tried OpenAI’s Atlas browser, I found it incredibly slow at moving the mouse. This could be a perfect use case for agents that need computer use.
There is something to be said for the split mechanical keyboard in the demonstration video and the sound the switches make when 'moving the mouse'.
Does anyone use a trackpoint and has still compared to this? I get it’s faster then reaching to mouse, but faster then trackpoint?
Sometimes when I am too tired, I lean back in my chair and click through Hacker News or something similar. I use Vimium in my browser and HN is great to navigate with it, but that's the not the point - the whole point is I don't want to sit above my keyboard with my hands on the home row.

I consider myself a "keyboard power user" if this is a thing anyway, and I really dig the home row thing (Vimmer for 20+ years now), but frankly having my hands on the keyboard ALL the time throughout the day is really tiring. So, I actually like my mouse for a change of posture, the cursor that I can follow with my eyes, etc.

P.S. I have to admit, though, that I love even more the interfaces that don't require a mouse in the first place. It's a shame we stopped adding well-thought tab stops in the UI and keyboards shortcuts are just a free-for-all in the apps.

i3wm with bindings in config to use xdotool to move and click the mouse is what i use.
Vimium for the browser solves most of the mouse needs. I dont see it helping with drawings.

Did anyone notice the use of the mouse at the end?

https://www.homerow.com/

Homerow is like vimium but for your entire mac.

Indeed or https://tridactyl.xyz
loading story #48412701
This just made me realize my desktop monitor needs to be a touchscreen
Thanks, but I'm too old to switch - will wait for the Neuralink implant.
I was literally just thinking about the desire to have a mouseless keyboard solution yesterday.
i use this! it actually comes in handy when i'm too lazy to move my hands from my keyboard. on my ultrawide, the click zones are larger and easier to digest/hit.
I use a trackpad to avoid virtually all of the issues created by a mouse. The trackpad gestures in macOS are magical.
I have a small Logitech laser mouse with a few auxiliary buttons, horizontal click scroll, and an unlock able wheel for fast scrolling. One button opens up workspace view (four fingers up), side scroll switches between works spaces (four fingers sideways). When my laptop is setup on my desk at home with monitor and keyboard attached this is much more comfortable and efficient than using the track pad. That’s said, MacBook track pads are magic.
What are the issues that a mouse creates?
Has anyone real-life experience with these tools?
Committed Mouseless user, here. I use a split keyboard that has a mouse layer, but I almost never use it, let alone an actual mouse or trackpad. Mouseless is so much more efficient for me. It did take a day or two to get used to using it (and to get used to comments from people who see your screen when it's active).
loading story #48415200
Pretty cool, would have been great before the trackpad.
you know what's efficient? controlling a computer with one hand rather than two.
Sure, you can play with yourself and scroll porn that way. I don't know if I'd call that efficiency.
This is a helpful method for visually grounding LLMs to take actions on the screen such as clicking. For humans though, hell no.
doesnt work with multiple monitors
just in case you didnt know, theres a kb shortcut to switch the overlay to the next/previous monitor.
nice - stick that video in the header
I was trying to scroll with mouse wheel but the website did not react at all. Then it started scrolling with 1 frame per second.
Waiting for the AutoHotKey or AHK with an LLM, GUI automation, and screenshots. Someone else develop it because it will be ignored if I do it.
Can someone who hates/chooses not to use a mouse please explain to me why.

Like I can understand people with disabilities that makes sense so that’s not what I’m talking about

I’m talking about people who are actively choosing to be keyboard only, especially in extremely technical roles

Or you could use tab, arrow keys, page up/down, enter...
well, you should be able to, at the OS level use only keyboard shortcuts. Windows once was great with tab, enter, escape, but browsers make things more complicated than dialog boxes, and MacOS really isn't good at keyboard shortcuts. I would prefer the solution was not Mouseless and the others, but no mouse.
That's OK in menus and the OS in general but if you're working on a web app or big form tabbing through it can be a PITA.
loading story #48412377
loading story #48412476
I've never seen anything more ridiculous than this in my life.
At least your are living a fulfilling life ridiculing others, that is awesome. /s