In our January Mark II Update, we highlighted the five areas that were in progress. All five have been making changes and improvements, but it’s been a slow journey for the hardware and we’ll have much more to say in March. Fortunately, we have been able to push forward quickly with development for the Mark II graphics software and now, you can get a head start!
The Mycroft GUI architecture has been built around the cross-platform KDE Plasma technologies and a network communication protocol. This creates several opportunities to allow the devs to continue refining the graphical interface on independent development hardware.
Additionally, the architecture allows the connection of off-device screen displays which I expect we will be exploring more in the future. Imagine a richer Magic Mirror or smart dashboard experience controlled by voice.
I’ve spoken previously of our work with the KDE Plasma team, and I continue to be impressed by the individuals and technologies they’ve brought to the cause. The first floor of the graphical interface that we’ve built on top of their foundational technology is robust and feature-rich.
Since the beginning of the year, we have closed the loop on this front. With QML, we can display information and pass back information to Mycroft as well as Skills running under Mycroft. This allows Mycroft to combine verbal and visual interactions seamlessly and beautifully.
The old adage is true – many times a graphic display is far more efficient for conveying information than words. A single-day forecast can be spoken efficiently, but speaking a 10-day forecast is painfully slow and ineffective.
So, I’ll follow that advice and let the following video do the rest of the talking.
Talk is good, and pictures are worth 1000 words, but what about the code? Well, guess what! You can see everything we’ve got for Mycroft GUI development and even start building skills with graphics! The repo is at https://github.com/mycroftai/mycroft-gui and we can’t wait to see what you make!
Steve has been building cutting edge yet still highly usable technology for over 25 years, previously leading teams at Autodesk and the Rhythm Engineering. He now leads the development team at Mycroft as a partner and the CTO.