Are we stuck with the same Desktop UX forever?

This talk focuses on that evil little term “UX/UI,” which is responsible for so much confusion and tension in open-source projects. Not only does it unnecessarily pit programmers against designers, but it also limits our vision of what we could be doing. In this talk, Scott Jenson gives examples of how focusing on UX -- instead of UI -- frees us to think bigger. This is especially true for the desktop, where the user experience has so much potential to grow well beyond its current interaction models. The desktop UX is certainly not dead, and this talk suggests some future directions we could take.

About Scott Scott Jenson has been a leader in UX design and strategic planning for over 35 years. He was the first member of Apple’s Human Interface group in the late '80s, and has since held key roles at several major tech companies. He served as Director of Product Design for Symbian in London, managed Mobile UX design at Google, and was Creative Director at frog design in San Francisco. He returned to Google to do UX research for Android and is now a UX strategist in the open-source community for Mastodon and Home Assistant.

Edit: One reddit user send me this part of another video. And say:

Your last post in r/linux makes me thing of the "GUI should be better" video by Ross Scott, specifically this part:

https://youtu.be/AItTqnTsVjA?t=2061

This is also a good video.

  • Free Software has the advantage of offering multiple visions all at once.

    Chances are, if you don't like the default your distribution offer, you can try something radically different.

    It’s also a disadvantage, releasing software for others on Linux is a miserable task in my experience. Don’t get me wrong, I love Linux and writing tools for myself is great.

    Which is why limiting to 1 or at most 2 output channels is important, ideally the one you use and flathub. If there is enough demand, people will take care of the rest

    Which is why the open-source thing is pretty important. Share the code and anybody who cares can port it, such as distro maintainers. 

    not really relvant or usefull for the general user tho.

    It doesn't need to be. You don't have to know how to build a car to drive one.

    while you are fully right, the reality is a mess.

    there arent standards in foss UI:

    gnome reinvents the wheel whenever they feel like it and they manage to make it worse.

    KDE/plasma while pretty suffee from what all linuxes suffer: no standards.

    the gui is pretty but it changes how you do things.

    you learned to mount a drive 30years ago? it still works across all linuxes thanks to posix and what not.

    how do you mount a drive on the UI is dependent on which WM you use and that changes whem they feel like it.

    KDE does not even have a full set of UI elements and uses gnome elements for a bun h of things fully breaking the „experience“…

    linux UX is a mess

    you can „theoretically“ just switch from gnome to kde, they are just packages, right? theoretically applies here.

    windows does UX half assedly but better…

    Apple mastered it

    KDE/plasma while pretty suffee from what all linuxes suffer: no standards.

    You will make Nate Graham cry if you suggest there are no standards. I've seen how hard he works at writing and explaining the very standards that KDE and its apps abide by.

    https://develop.kde.org/hig/

    KDE does not even have a full set of UI elements and uses gnome elements for a bun h of things fully breaking the „experience“…

    I would love for you to tell me what exactly KDE uses of GNOME's.

    how do you mount a drive on the UI is dependent on which WM you use and that changes whem they feel like it.

    Well that's..nonsense. Different desktops and distributions have different default tools for configuring disk mounts, yes. You can just install whatever tool you want for it though.

    KDE does not even have a full set of UI elements and uses gnome elements for a bun h of things fully breaking the „experience“…

    This makes no sense. It of course has a full set of UI elements. Are you talking about running Gnome apps in KDE?

    gnome reinvents the wheel whenever they feel like it and they manage to make it worse.

    Some of us actually like it..

    Was gonna say, the automatic creation and easy management/usage of virtual desktops that GNOME has is the single most useful and interesting UX concept that any major DE has in my opinion, and nothing else comes close to being as good at it. GNOME has its faults, but complaining it only makes things worse is insane.

    windows does UX half assedly but better…

    Apple mastered [UX]

    Speaking as a very long-time Mac user, they most definitely have not mastered UX — or UI.

    From the incredibly irritating "unibrow" menu system requiring a bloody safari from app window to desktop apogee every time you need a menu option, through the abortion of the "magic mouse" with the charging port on the freaking bottom requiring an actual work stoppage to recharge the cursed thing (oh, and it still doesn't properly handle right+left button operations on the touch surface), to the kindergarten-esqe flattening and insipid pastelization of the system UI and application icons, Apple is madly deficient in both UX and UI.

    And speaking of UX in the broader sense, it's not a great User Experience when they stop supporting perfectly good — and expensive — hardware long before it would otherwise become obsolete, either.

    What Apple is insanely good at is marketing. And the Mac and iPhone hardware. It's great stuff. Which is why I have several Mac Pros... running linux.

    Or implement it and submit a PR.

  • "We don't need another window manager"

    Funny because niri (with dankmaterialshell) just entirely changed my desktop experience.

    I just wish they would find a way to let me spawn a new window in the same column

    This and proper restoration of something you make floating or full screen is all I need

    you can..., i think you mean that you wish you could find

    With what command? It’s even listed in the FAQ that you can’t do there. You have to spawn then consume.

    and why can't you make a script to spawn and consume and bind that to a key...?

    I’d rather not have to run a script to do that, should be a native function. There are various corner cases.

    then just use mangowc? it has horizontal scrolling, vertical scrolling, tiling, etc etc per tag (workspace)

    I’ll have a look thanks. Either way, it’s wild that you accused me of being too dumb to read the docs then said “just build it yourself”

    well it has a IPC for a reason, it can't cover every single niche case, but if you seek something else and don't want to write a simple script then ya..

    not accusing you of being too dumb, but you are acting like it's something you can't easily do

    A script is fine for me. The whole thing is scriptable and you have complete freedom choosing what to exclude / include.

    Looked that up because of this comment and damn that's a cool and fresh take on the desktop. I like it.

    Ok, that's it, I'm going to search Niri.

    Because of Niri, I'm now able to work on a single 42" monitor. I love it so much. With traditional tiling window managers, I still felt the need for two monitors, and I'd get a lot of neck pain looking back and forth.

    Niri reminds me of an old-school infinite zoom desktop. Was Plan9 or similar but could never find the name, anybody knows?

    Niri seems cool but until there is any other serious implementation of HDR outside of KDE I’m kinda stuck with it.

    I just switched from Sway to Niri and I love it. The scrollable tiling somehow makes my single laptop screen feel way bigger than it actually is.

  • As someone who still runs XFCE4 and likes it: I hope so. 🙂

    I've been on xfce for ten or fifteen years. Is it not cool anymore?

    I've been using Linux for 12 years and I think XFCE was said to be rock solid, but a little dated and boring even when I was starting out. I personally love it, but I also don't use it because I'm a WM guy(i3)

    Yeah, I used to use XFCE with i3. It was a nice combo. I eventually tired of the TWM paradigm, but that setup worked great for what it was.

    I just don't need a DE on my workstation. I still distrohop on my laptop, and when I do use XFCE, I use Kwin as my window manager so I can get fun KDE effects. I need my wobbly windows(when I'm using a DE)

    Been on it for over 25 myself. I don't care if it's cool or not, I think it's the best for me.

    Its fast, its sane, its pretty and it works.

    This is not cool the year 2025. You need a hulking mass of unperformant dogshit to be cool.

    Same, also love XFCE. I'm glad there are options because e.g. GNOME trying to reinvent the wheel is unusable to me lol.

    Coming from a Windows-only background to GNOME was so irritating that I quickly switched to Plasma. 😅

    I've been using WindowMaker since 99, and I just started moving to hyprland because it's become apparent that Wayland is both mature and the future.

    I wish someone would refactor WindowMaker for Wayland, but I'm happy enough with hyprland.

    For some reason I always end up running WM on my BSD systems (the ones that have a gui, at least). I feel like they updated and released a new version like 10-15 years ago, so maybe in another 10-15 years they'll refactor it for Wayland!

    There is a wayland project that is "inspired" by WindowMaker, wlmaker, but it is both very early, and not a real port/refactor. I'd think you could just put Weston under it, refactor WING or GNUStep for Wayland, and the rest of the stack just works. I'm not good enough at C to do it myself, but I'd hope someone that is and a fan does.

    I'm not either, and the use cases I have for wmaker wouldn't really benefit hugely (or be any different either way) with Wayland. So I have not motivation to do it myself, but as you say, maybe someone else will.

    I used wmaker a whole lot back in the day, so it's always got a soft spot in my heart.

    There is a project I follow on GH, called wlmaker, from a guy at Google, a Wayland compositor like windowmaker, I haven't tried a lot but seems capable and progressing quickly https://github.com/phkaeser/wlmaker

    I tried it, and found it lacking, I might come back to it when it matures. I didn't know it was a Google Dev, and I wish them all the best, but I think their approach is backwards. I think you should put Weston under WindowMaker and refactor WING / GNUStep to wayland, then all of the code on top of that "just works". I'd really like to just keep my GNUStep folder as is and invoke the new GUI and just go.

    I have several scripts that generate submenus, and I like using the scroll wheel on the root to switch virtual desktops. Also have a lot of custom keybinds for window positioning that wlmaker doesn't support.

    Yeah, I read GNUStep has preliminary Wayland support some years ago but development is slow I think

  • One of the most appealing things to me about Linux and other *nixes is the fact that I can pick and choose my desktop and how it works.

    I like KDE Plasma as someone who has primarily operated in Windows environments for most of their life. It gets updated frequently and new features are always being added.

    On the other end of that spectrum you have stuff like XFCE whose desktop UI has been unchanged for at least a decade. Which is also good! I like XFCE a lot actually. I had a really cool skeuomorphic skin for XFCE and it was so much fun.

    Then you have tiling WMs that really breaks the mold of what a desktop is. And I’m not really a fan of any of those projects because I’m used to a Windows/MacOS floating window style system. But they exist and that’s great.

    I guess the point is. What makes the “free desktop” great is that I have choice. Which is why I don’t get people who argue about KDE vs GNOME or whatever. Just use what works for you!

  • My biggest problem with modern UX is that we've become too comfortable letting designers run amok. I don't want all these apps with their own design language. I want plain looking apps that use exactly the toolkit and color theme I choose.

    Uh ok. So you are saying that we should not be so focused UX?

    The opposite. We need to focus more on UX than making it look "pretty". For example, wasted space and hiding options behind a gesture or hidden menu.

  • Jesud, this comment section is sad. How can you be against better UX?! "I want to keep using my outdated badly designed UI and everyone who wants something else can suck it." you cannot be serious...

    And of course no one watched the video

    Most people don't think their UI is outdated or badly designed, and when they hear someone say we need to try something new and "better", they hear the echo of the GNOME developers that said the same thing, but then delivered a new UI that was a horrible regression in their opinions.

    They don't think what they're using is broke, and if it's not broke, don't "fix" it...

  • I use openbox because I don't want a new UX. I just want my computer to do what I want, I never understood people who want it to change constantly.

    Whatever growth beyond current interaction models they are referencing, I want no part of. Everyone either wants to take options away and dumb things down, or display 5 separate programs on screen at once in the name of "productivity" when normal human beings simply do worse work when they multitask.

  • Change, or "improve" whatever you like, but let me keep what I've been using and like. I see so much horrible UX over the past 10 years from what I assume are simply just bored UX designers. They'll take something that works extremely well and just start throwing clicks at it. Drives me nuts.

    I worked as a PM and ops director at a pm agency for 10 years and I can't count the number of ridiculously dumb shit that came from our UX staff that I had to go back and make them change. Most of it was "new" way of doing things.

    We were building an internal time tracking app and the UX designer insisted on no "submit" button. He said it was too many clicks. I asked "then how will I know if they are done entering time". He said "if there's time in there then it's done".

    I cannot tell you the depth of my detestation for settings dialogs that don't have an "OK" or "Apply" button, but insist on just applying changes immediately. They drive me INSANE.

    ...and on Windows 11 it's inconsistent. Some have apply buttons, some do not. If they do, it's not always in a consistent place (i.e., bottom of the window). You always have to look around.

  • I think people might be missing the point of the post a little bit. I don't think it's talking about the specifics of how your desktop environment is set up, it's talking about the desktop environment at a conceptual level. They all basically work the same way. My interpretation is that Scott Jenson is asking whether there's a better way to do things at a fundamental, i.e. completely change how a desktop environment works.

    Well as long as programs are stuff that pops up on a 2d screen there is not much else to try, they all just manage windows in a certain way because that's the issue to be solved in a 2d screen, idk maybe something crazy will pop up in VR but from what we have seen from Apple it's just desktop enviroment pinned to 3d space lol, you might forget a program running inside your bathroom, i don't see how that's better.

    I don't feel like there is a universally intuitive way to do stuff or a correct 'user experience', it's just what you are used to, Apple people will praise their OSs for their intuitiveness but give it to anyone that's lived with Windows/Linux/Android and it's literally unusable, it's full of dark patterns and hidden stuff and gestures and long presses and swipes from certain places with no indicator, same goes the other way around.

    The best 'user experience' is the experience the user already knows, and this is why the desktop has been the same for the longest time.

    If you wanna go for 'most clear on how to use' it's CLI, like it or not, at any time you can run man or --help and you know exactly what you can and cannot do, there is nothing hidden 5 menus deep, there is no long press, no swipes, no gestures, no button saying 'do X' and in the background it does x, y and z, there is no attention stealing 80px font, everything is there in front of you, in plain text.

    Cars all work fundamentally the same way. They all have steering wheels, an accelerator on the right and a brake pedal to the left of that (and if you drive a stick-shift, a clutch to the left of that.)

    Is that the optimal way of controlling a car? Probably not.

    Is it worth changing? Oh, hell no! Because it's good enough and everyone's familiar with it. The disruption is simply not worth it.

    I suspect UI/UX designers who try to change things radically will learn this the hard way.

    I remember a UX design back in the day build around physicality (physics modeled file objects in space). As a young kid it seemed so cool but with age I agree… not worth the change.

    That said… I think we are trending back to typing commands since computers can understand us far better without precision of yester-year.

    Yours is probably not a popular opinion here, but I think it's pretty obvious that the input part of UI/UX (what we consider it now) won't matter a whole lot in the future. The vast majority of it will be natural language, whether typed or spoken.

    I agree. For me, the huge advantage of a windowing system is the ability to have lots of terminal emulators. 🙂

    I’m just thinking about COSMIC, Gnome, Windows, MacOS… maybe KDE? (Rusty memory)… all of them let you press a button and start typing what you want. That’s perfection for UI/UX. One input and you decide how to steer response… you don’t have to look for the place the command is. You just type what you want. Not quite there but some day like Scotty we will say… a keyboard how quaint.

  • It will remain like it is now, with slight variations of the same thing, slowly converging until someone comes up with a new interface to replace touch and keyboard and mouse.

    There were a lot more variation fifteen to twenty years ago, but everyone seems to have agreed on a few core common concepts that work well.

    Now, if we get AR and a new input method, then that changes the constraints. It will be crazy for a while until we figure it what works, and then it will all look mostly the same again.

    I don't think voice or vision will be the thing. The most promising thing right now that I'm aware of is that ring thing meta is working on. But the learning curve and what I assume will be strain it will put on your finger I think limits it.

    I have thoughts, and it would be super interesting to speak to someone who's in the know about the R&D going on with AR and interfaces, but I suspect I'll just have to wait and see what people come up with.

    In ten to twenty years or so. I don't think the tech for glasses or anything around them is there yet. 

    Was gonna make my own opinion but you nailed it. Most folks just use their OS as a tool, and have been used to the design since Windows 95 or before. I found a WM + keybind based workflow that works better for me, but that's because I'm passionate about extending my DE experience. It shouldn't be expected for 50 year old directors at a random FAANG company that don't give a damn about what OS they're using to interrupt their workflow to try a new tool

    You have to introduce a total paradigm breaker like the smartphone to break that trend

  • I totally feel "suspicious" when people use UX/UI as a catch it all term.

    User flows, research, prototyping, steps to get an action done are completely different from making a design system, defining the right composition, white space, typeface, hierarchy, accessibility. Of course, those two overlay in certain areas, but having constant wars on if rounded corners are cooler than square ones has nothing to do with either or not the software gets the task done concisely.

    Unsure if you're saying this with or without having watched the video. In case you didn't, the speaker actually has a very similar rant about half way through.

  • GNUstep. The services are the pipe of graphical user interfaces.

  • Does it need changing and what would it benefit?

  • With Linux you get the most variety, this is the OS where this discussion is least relevant, there are DEs/WMs for everyone, you can get any combination of touch first, mouse first, keyboard first, floating, tiling, stacking, kiosk mode, bars, panels, widgets, docks, applets that your hearth may desire.

    What the videos you linked boil down to is:

    - Detach the core system from the GUI to give developers freedom.

    - Literally try anything and everything and see what sticks.

    And this is literally what Linux does.

    And in general those videos just bash on Windows 10 and how Gnome looked like in 2007, it's irrelevant here.

    And just talking about Gnome because i feel like it and it's what i use:

    Gnome is deeply keyboard centric and their team tries the most unhinged stuff, and i love it, you can literally do ANYTHING with spr key + arrows and pgup/down, but people bash on it because it also works fine on a touchscreen and somehow that makes it worse? idk sometimes it's not like the UI/UX is stuck but just people not wanting to try new stuff, they prefer to spend 5 hours setting up hyprland to end up with the same shortcuts and loosing the touchscreen usability because idk, cool internet points i guess..

    Yeah it was also weird to me at the beginning to not have stuff on the desktop, or a minimize button, or a 'taskbar' or dock that's always there, but after using it for literally 5 days your understand how it's supposed to be used and realize that all those things were just extra stuff that was never needed and added extra steps. Why would yo minimize something to then maximize another program? just maximize the second one and the first one gets covered. Stuff on the desktop? pointless, it just gives you a second non-standard way to interact with files outside the file explorer and it ends up with users just putting everything there instead of using the home folder the way it's supposed to be used.

    Once you understand that the 'desktop' just literally just a background image meant to look nice when nothing is open (1% of the time because what are you even doing at the computer if nothing is open) then the way the Gnome desktop does thing just feels natural, it's just you and whatever program you are using, the desktop doesn't try to get in the way or give you new ways to do stuff that other programs already do, it just presents programs in a clean way and add some useful stuff like a clock, calendar and notification tray.

    Stuff on the desktop? pointless

    Wrong. The point is fast, custom (as in the idea of "favorites") access. You may want to always navigate through your file manager, but that's your personal preference, not a universal efficiency gain for everyone. Same goes for desktop widgetry like clocks, weather, stock tickers, etc. One hotkey to expose the desktop and we can get to info that is right there. Another tap and we're back doing whatever.

    I want UI options galore so I can configure ny systems to work the way I want to, not the way someone else thinks I should.

    well then you can use another desktop, literally the first line says:

    With Linux you get the most variety, this is the OS where this discussion is least relevant

    Everything else is just my personal take on why i think Gnome is great.

    Or just install an extension to add Desktop icons... You are manufacturing an issue that doesn't exists just to complain about it.

  • Kind of lost me when I found out Scott Jenson worked on Mac's UX. Maybe it's just me, but I do not like working on a Mac. It's a totally convoluted mess in my opinion. I especially hate the fact that when you quit a program in a Mac, it's doesn't quit. You have to go to the "task bar" (or whatever it's called on a Mac) and right-click on the applications icon and choose quit again. What's the point of the minimize button in this scheme is closing an application just minimizes it? Also Finder seems about worthless to me.

    I also don't like the Menu bar for applications at the top of the screen instead of connected directly to the application. if you've inadvertently lost mouse focus on the application you're working with, you've got to click on the application and then go back to the top of screen to find its menu entries.

    I also don't like the Windows buttons on the left, or the fact you can't customize them to the right. I asked if there was a way to change this on a Mac and was told, "If you don't like the way a Mac works, uses Windows." So much for customization.

    Admittedly I haven't used Macs much, but these are a few things I hope Linux never makes standard. If this is good "UX" I don't want it.

  • As somebody who as to train many high schoolers (and some doctors) on how to use a Linux desktop, I would say we are right now in a very unique time where we can try something completely different. I don't think this can be understated: iOS and Android has completely changed how end users think about navigating around their virtual space. The concept of "Window Management" is practically missing with current teens and I doubt the next generation will have the same expectations of how to control a desktop environment as most people do right now. The expectation for things to work exactly the way they did back in the 90's has never been lower.

    I'm not saying we need to throw away all the current desktop paradigms but I think the time is ripe for anybody to just throw away the expectation of how a window or widget works and try something from left field and see if anybody likes it. Of course, since it's Linux, we can all have the choice if we want to use it or not.

  • Why not just post the transcript, rather than linking to youtube?

    I am neither good at reddit nor english writing. It say I must write 300 charecters. And I copied transcript.

    I thought if product is opensource transcript is also opensource.

    If it is illegal. I will change.

  • Are we stuck with the same writing system forever? Are we stuck with the same mathematical notation forever? Are we stuck with the same musical notation forever? Because the Latin alphabet isn't perfect, and modern mathematical notation isn't perfect, and musical notation isn't perfect either, but you know what these things all have in common? They're good enough. We accept that replacing those systems with theoretically better alternatives would not be worth the disruption it would cause and we deal with it, because perfect is the enemy of good. I eagerly await the day "UX" people learn this lesson.

    In fact, writhing, math notation and musical notation are things that change a lot or new way of doing these are added (without overhaul the system). The think is, these changes happens in a high time scale than one life, so you don't are going to notice without studying story.

    This. We've already seen car manufacturers realize that maybe touchscreens weren't such a good idea and that old-fashioned physical knobs have their advantages.

    give me the touchscreen BUT also let me use that touchscreen to configure the physical buttons!

    In fact, writhing, math notation and musical notation are things that change a lot or new way of doing these are added (without overhaul the system). The think is, these changes happens in a high time scale than one life, so you don't are going to notice without studying story.

    I wish I had the confidence to declare that I know more than a whole industry of highly trained and hard working professionals. I eagerly await that day.

    I'm just busting your balls, but seriously did you actually watch the video? He isn't talking about throwing out everything we have or disposing of the foundations of desktop UX or anything as dramatic as switching our writing system. He said many times that it's good to copy what works, and he showed examples of subtle changes that result in much better user experiences.

    As for your examples, I would say that the writing system has changed quite a bit. Pretty sure the ancient Romans didn't use the at sign, ampersand, or emojis for example. Things change to better serve our needs, and that's a good thing. Now if Reddit could invent a way to force commenters to read/watch the original posts, that would be amazing. Maybe I'll submit that to their UX designer.

  • As someone that uses only window managers, yes!

  • The biggest issue of desktop interfaces is precisely because there are so many ways to interact with them, mouse, keyboard, touchpad, stylus, touchscreen and etc. And part of the issue of the experience is interfaces trying to "work for all of them" which leads to compromises.

    The real advantage of linux is precisely that there is different DEs/Windows managers so the experience can be custom tailored towards the input method. Instead, we see the experience moving towards making it more generic which leads to a compromised experience for everyone.

  • That guy has some interesting perspective about usability. And I think we already have some tools that are going to explosively change the desktop experience once someone finds a clever way to use them and market them that appeals to users. For example, we already have things like eye tracking and programmable display buttons that have a lot of potential but not a lot of uptake.

    I'd also disagree on how I use a desktop has not changed in 20 years. I didn't watch this video, I read the automatic transcription, except the part where he demonstrated his combined WM/clipboard which has a visual component. Autotranscription is relatively new and powerful—if still occasionally inaccurate. I didn't scroll through the lines using a scroll wheel, I used the multitouch scrolling gesture of the trackpad which wasn't practically available in 2005 (I'm going to guess 2008 is when it was available in mass-market). I used a NFC token to log in to my google or github account, then I used OAUTH2 to log into other services instead of passwords. Windows users have "Windows Hello" biometric unlock and fingerprint readers have gone from a specialty corporate security item to available on almost every laptop. There's hundreds of little details that have changed.

  • Love tiling and scrolling window managers

  • Gnome Tweaks

  • have you met awesome wm? there's lots of weird efficient solutions but they just aren't widely adopted

  • Oh look a mega corp UX designers contribution is saying we need more UX design... maybe he is unaware that on Linux we can just do things (Compiz, Hyprland, etc)

    Maybe you are unaware that you completely missed the point because you didn't watch one minute of the video

    Maybe you are unaware that you completely missed the point because doing stuff does not require pointless bureaucracy like UX designers. Never has any amazing technology been attributed to such a role.

    Found the developer

  • As long as we stick with existing input devices: Keyboard, mouse and touch panel, the optimal UX stays the same.

    Now that LLM-based AI technology is rapidly increasing its performance, we may have smart natural language voice command UX that works 99% of time in near future, but I don't know we can still call it "Desktop UX".

    Voice UIs will suck. Imagine a sea of cubicles with every office worker speaking to their computers...

    If this is what it takes to get office walls back maybe I can live with it

    Hehe, good point... but I suspect walls are not going to be forthcoming.

    Hmm. Could be trivial to solve. Good headset so you dont hear anyone else. 

    "Please recite your password..."

    Better hope everyone else is wearing their headset.

    passwords are not meaningful security at this stage. PKE + MFA is where its at.

    The fact you can't say the secret out loud without giving it away should clue you in on the key weakness of short character based passwords.

    Did you know that we can take a few samples of audio recording of your typing and use machine learning to work out what a given new character sequence is? That is, its literally possible to overhear someone typing their password these days.

    And yet passwords are ubiquitous. I don't see that changing any time soon.

    Sure, in theory you can figure out what I'm typing using the methods you mention. There are easy counter-measures (e.g., type your password slowly and only with your left-hand pinkie finger.)

    I actually probably could say most of my passwords out loud without giving away the secret unless someone was recording me, because I use 32-character randomly-generated passwords like XOleCxdoHv1GccDn9JsGX6FA9l6RqYic

    But most people don't.

    unless someone was recording me

    Probably not a safe assumption, given recording devices are ubiquitous. 

    I mean... you did write "overhear".

    LLMs have more of a use on mobile and similar small devices, where input can still be a bit awkward.

    I can do a lot on a phone currently, and LLMs can make that experience better. But when I sit down at a desktop (or laptop) it's to do desktop things.

    Oh god no. Everyone yapping against their machines every single minute of the day, making a hellish din. Meanwhile letting flesh and blood people sitting on unread. We already have all the dystopia we need. Please don't add voice controlled computers to it.

  • The GNOME project has completely rethought the user experience, and many GNOME users complain about it incessantly, clamoring for extension to GNOME that will make it less GNOME-like and more like the much older, more standard experience (app menu, dock, etc.). Those who embrace the UX as intended by the developers tend to find it to be an elegant and beautiful experience. I use "vanilla" GNOME, with no extensions installed to change its functionality (save for a system tray, used primarily as a notification). GNOME is intended to be heavily keyboard-centric, which is very similar to a touch interface. The superkey is what unlocks the beauty and simplicity of the UX, though many still prefer to navigate the system with a mouse.

    The point is this: we're not stuck with the same desktop UX forever, for we have a vastly different design already, and it's the default on most distributions. The problem is many insist on using it like the older metaphor for the desktop rather than the way it was designed to be used. So yes? We're stuck, but by choice?

    I don't see why it should be a problem. We've come to expect certain forms and functionalities from, say, car interfaces -- a steering wheel, pedals, a dashboard, possibly a gear stick -- and everybody is happy to provide and use the familiar "metaphor". Why would a similar situation in the UI/UX area be a bad thing? There's no inherent value in breaking the familiar mould.

    The GNOME devs have a fairly strong idea for their desktop experience. The problem is many users want a more traditional desktop experience and so they complain that GNOME doesn't have x or y, when what they really want is a different environment. I personally love GNOME and fully embrace the GNOME workflow; this is why I run vanilla GNOME without extensions to change functionality.

    My entire point was made to address the OP's question: are we stuck with the same desktop UX? I think we may be, for the reasons just outlined, namely, the most popular desktop environment has already massively changed the user experience and people complain all the time. I'm not arguing for or against GNOME's UX (which I happen to love) or for yet another model. I'm simply pointing out that there IS an alternative and many don't like it.