By Leo Kelion – Technology reporter
The Wisee system does not require a camera to be attached to a computer for it to recognise gestures
Microsoft unveils Xbox One console
Leap Motion seals deal with HP
Microsoft opens up on Kinect code
Researchers say they have found a way to detect and recognise human gestures based on how they affect wi-fi signals.
They suggest it could let users control home appliances with a wave of the hand while in any room of the house.
They say the WiSee system offers a “simpler, cheaper” alternative to Microsoft’s camera-based Kinect and other specialist gesture sensors.
However, other experts in the field question whether the new tech will be able to be as accurate.
Details about the project have been published by the University of Washington’s computer science department ahead of the Mobicom computing conference in Miami in September. The paper is a “working draft” and has not appeared in a journal.
The researchers suggest offering an alternative to a vision-based system could make a range of home-based gesture controls practical.
“For example, using a swipe hand motion in-air, a user could control the music volume while showering, or change the song playing in the living room while cooking, or turn up the thermostat while in bed,” wrote lead researcher Shyam Gollakota.
To achieve this, the researchers have experimented with the Doppler effect – the way a wave’s frequency changes at the point it is observed depending on the source of the wave’s movements.
The best known example of the effect is how one hears the pitch of a train’s whistle change as a it approaches and then passes.
The team say a wireless router can be used to detect related changes in wi-fi signals – which are electromagnetic waves – as they reflect off a moving human body.
By using a specially developed software algorithm, the computer scientists say, they were able to distinguish nine different types of movements including a pushing motion, a punch, a circular hand movement and a kick.
To demonstrate the system, the team carried out tests in an office and a two-bedroom apartment.
They say their system was able to correctly identify 846 of the 900 gestures performed – a 94% accuracy rate.
They say these included situations in which the user was in a different room to both the wi-fi transmitter and receiver, requiring the waves to pass through walls before being detected.
The researchers acknowledge the risk of such a system being triggered by unintended gestures or even the risk of a hacker seeking to take control of a target’s equipment.
The researchers say their software can use a wi-fi router to detect when a human is making a gesture
To tackle this they suggest a password system that would involve the user repeating a preset sequence of gestures four times in order to ready their equipment for a command.
They say that an added benefit of this would be that it would reduce the risk of false positives – situations when the system mistakes natural variance in wi-fi signals for a gesture.
The researchers claim their equipment can work with up to five people in the vicinity of the router so long as it it is fitted with multiple antennas. But they note that the more people there are, the less accurate the system becomes.
They say their next step is to try to work out the best way to use the system to control multiple devices at once.
In the meantime they have set up a website to publicise WiSee, suggesting they want to bring it to market.
“Imagine that in the near future you would buy wireless router which could also do gesture recognition. WiSee enabled,” they say.
“Unlike other gesture recognition systems like Kinect, Leap Motion or MYO [sensor armband], WiSee requires neither an infrastructure of cameras nor user instrumentation of devices.
“WiSee requires no change to current standards.”
Dr Richard Picking – a human-computer interaction specialist at Glyndwr University in Wrexham – said the US team’s research had merit, but would still need to overcome several hurdles to become a commercial product.
“There is real potential for WiSee to compete with other devices in their established markets, such as gaming and entertainment,” he told the BBC.
“However, although the developers claim that it is unlikely that false commands could be triggered and that it is essentially a secure technology, there is a long way to go before people will be convinced that it will be reliable and safe enough to control household appliances.”
Another activity recognition expert – Daniel Roggen from Newcastle University – agreed that the system had potential, praising its idea of reusing existing resources rather than requiring the installation of cameras and other sensors.
Microsoft’s Kinect 2 sensor uses a 1080p resolution camera to improve its activity recognition abilities
However, he noted that the wi-fi equipment used by the researchers was more expensive than the norm, costing about 10 times the price of Microsoft’s Kinect.
“It remains to be seen if either a single such device is sufficient to cover an entire house and if the price of the equipment can be brought down,” he said.
“The activities presented in the paper are also very coarse. It remains to be seen if subtler human behaviours can be picked up.
“[By contrast] Microsoft’s Kinect is specifically designed for activity recognition. As such, it has an advantage over ‘opportunistic sensing’ approaches, and it can pick up subtler movements such as finger movements in its newest version.”
The first HarmonyOS-powered phone from Huawei to arrive in 2021
Huawei’s HarmonyOS was unveiled last year during the Huawei Developer Conference and there’s a report claiming that this year’s conference on September 10 will bring the HarmonyOS 2.0. Interestingly, the rumor cites Richard Yu himself, the company’s CEO. And the first phone with the in-house operating system will launch as early as next year.
A smartphone running the said OS already exists and will likely hit the market next year along with a number of new devices including PCs, tablets, smart wearables and other IoT products. In fact, the first smartwatch running HarmonyOS is expected to make a debut until the end of this year.
iPhone XR will reportedly be replaced by iPhone 12s in Q2 2021
Previously, conflicting information had emerged about iPhone XR’s future. We now seemingly know when it will be discontinued and which phone will replace it.
The iPhone 12s will supposedly be LTE-only
Samsung, LG experiment with virtual demo rooms of the future amid IFA conference
Tech events so far this year have made something clear — it’s not tough for giants like Apple and Samsung to go all-virtual with their launches. But one aspect of a typical tech event doesn’t translate to a computer or phones screen: the demo room. Samsung thinks it’s found a possible solution.
The company on Wednesday hosted a virtual Life Unstoppable event that coincided with the IFA electronics show in Berlin. It wasn’t a typical press conference like the company’s two Unpacked events held over the past month. Instead, Samsung used Epic’s Unreal Engine for games to build a virtual, 3D tour experience — a sort of choose-your-own adventure digital demo — for the media and its partners.
“Would we have done it if COVID wasn’t around? I’m not sure,” Benjamin Braun, Samsung’s head of marketing for Europe, said in an interview. “That is a different way of presenting new products that no one’s done before.”
The novel coronavirus, which has infected more than 25 million people around the globe, has caused companies to rethink their product launches. GSMA canceled Mobile World Congress, the world’s biggest mobile show, a week before journalists arrived in Barcelona in late February. Instead of phone launches over the past several months, Apple, Samsung, Huawei and OnePlus all held digital events or introduced devices via press release.
IFA, taking place in Berlin from Sept. 3 to 5, is the only big tech conference with an in-person component this year. But only 5,000 people can attend, far below last year’s level of 200,000. While Samsung isn’t attending IFA, it’s still hosting events, like Life Unstoppable, that coincide with the shortened convention.
Samsung’s virtual house
Participants of Life Unstoppable will navigate around a digital house that contains about two dozen different Samsung devices, ranging from its $3,500 waterproof, outdoor Terrace TV to its updated Galaxy Z Fold 2 foldable phone. The visit revolves around a 45-minute guided tour, but participants are able to branch off on their own to look at the back ports of a TV or circle back to the kitchen to check out the appliances.
Samsung noted that “every detail,” from the home’s artwork to the furniture’s fabric, “was carefully selected following meticulous research into the type of guests that would be visiting Samsung House, resulting in a truly immersive home environment.”
There’s also an augmented reality component that lets people see what the new products, like TVs, will look like in their own homes. And Samsung noted that immersive 8D audio makes visitors feel like they’re really in the home
During Life Unstoppable, Samsung unveiled a host of new products, ranging from a smart video projector called The Premiere to its Wireless Charging Trio pad that can charge a phone, watch and earbuds at the same time. Samsung also introduced a new fitness band, the Galaxy Fit 2; a low-priced 5G smartphone, the Galaxy A42 5G; and the budget Galaxy Tab A7 tablet.
While Samsung determined Life Unstoppable was the best format for IFA, Braun said, it may go a different route with CES and other trade shows.
“We constantly need to force evolution, force innovation, not only in our products but also in the way we present ourselves,” Braun said. “At some point, once COVID is under control and we’re back to potentially physical [events], then we need to rethink them as well. How do we merge the two?”
LG’s ‘virtual exhibition’ and IFA’s ‘Xtended Space’
Samsung isn’t the only company trying to make the best of a less-than-ideal situation by creating a virtual experience for regular show attendees to enjoy in lieu of IFA this year.
On Tuesday, LG launched its IFA “virtual exhibition,” demonstrating its latest product lineups within a realistic rendering of its usual IFA home — the Berlin Messe’s Hall 18.
First impressions show this to be an improvement to the usual in-person experience. No longer must you spend upwards of 30 minutes attempting to navigate the labyrinthine convention center with its many entrances and exits to reach the LG booth, and gone are the hordes of people that usually delay your journey even further.
But as you click through the virtual exhibition, you start to remember why attending these shows in person was important in the first place.
The cinema screening room in which you are supposed to be able to enjoy the deep blacks of LG’s latest screen technology doesn’t have quite the same impact when you’re viewing it through your own laptop or phone screen. The same is true when testing the sound quality of LG’s speakers and headphones in its virtual audio booth.
It’s hard to say how cool and effective LG’s rollable TV is without being able to examine it from all angles. Maybe it would help if you could navigate the exhibition in VR, which would allow for a more immersive, less static experience. Samsung said its Life Unstoppable home could be viewed in VR, but it was mostly designed for PCs, phones or tablets.
While LG and Samsung are offering their own takes on the virtual trade show, the wider event is also going online this year via a digital platform it’s calling IFA Xtended Space.
All the new phones, laptops, smart home gadgets and more from IFA 2019
Through an online hub, virtual attendees will be able to join live streams of keynotes, press conferences, panel sessions, presentations and virtual exhibitor presentations and match-making opportunities that will allow them to establish new business contacts. New products will even be presented in 3D, although it remains to be seen how easy it is to form a proper first impression of new tech without being able to touch it or hold it in your hands.
IFA’s organizers acknowledge that this year’s show won’t replicate the experience most regular attendees are accustomed to, but they believe its digital platform will offer something novel to people — whether they’re using it to supplement their in-person visit to the show, or to attend remotely.
“A digital platform can hardly compensate for a true on-site experience,” IFA Executive Director Jens Heithecker said Tuesday in a press release. “However, the IFA Xtended Space enables all those who are interested to know even more and those who cannot join the IFA 2020 Special Edition physically in Berlin to have a truly unique virtual experience.”
Tech News3 days ago
Apple Loop: Shock iPhone 12 Details, Massive iOS 14 Problems, Macbook Pro Delay
Research3 days ago
Apple iPhone 12 Pro Max’s AnTuTu result shows minor performance gains
The Motivator3 days ago
PS5 Game Install Sizes Revealed, And They’re Enormous
Systems3 days ago
LG Wing takes aim at Galaxy Z Fold 2 – shakes up the new status quo
Internet5 days ago
Google Chrome prepares new tab groups feature that creates groups automatically
The Motivator3 days ago
Editing HTML Like A Boss In VS Code
Systems20 hours ago
IPHONE 12 MINI COMING WITH A 5.4-INCH OLED DISPLAY
Systems20 hours ago
Samsung Galaxy Z Fold 2 Price, Release Date, and Specs