Researchers are training home robots in simulations based on iPhone scans

Image Credits: Screenshot / YouTube

There’s a long list of reasons why you don’t see a lot of non-vacuum robots in the home. At the top of the list is the problem of unstructured and semi-structured environments. No two homes are the same, from layout to lighting to surfaces to humans and pets. Even if a robot can effectively map each home, the spaces are always in flux.

Researchers at MIT CSAIL this week are showcasing a new method for training home robots in simulation. Using an iPhone, someone can scan a part of their home, which can then be uploaded into a simulation.

Simulation has become a bedrock element of robot training in recent decades. It allows robots to try and fail at tasks thousands — or even millions — of times in the same amount of time it would take to do it once in the real world.

The consequences of failing in simulation are also significantly lower than in real life. Imagine for a moment that teaching a robot to put a mug in a dishwasher required it to break 100 real-life mugs in the process.

“Training in the virtual world in simulation is very powerful, because the robot can practice millions and millions of times,” researcher Pulkit Agrawal says in a video tied to the research. “It might have broken a thousand dishes, but it doesn’t matter, because everything was in the virtual world.”

Much like the robots themselves, however, simulation can only go so far when it comes to dynamic environments like the home. Making simulations as accessible as an iPhone scan can dramatically enhance the robot’s adaptability to different environments.

In fact, creating a robust enough database of environments such as these ultimately makes the system more adaptable when something is inevitably out of place, be it moving a piece of furniture or leaving a dish on the kitchen counter.

Home security giant ADT says it was hacked

an ADT sign outside someone's house in Miami, Florida

Image Credits: Joe Raedle / Getty Images

ADT confirmed this week that it was recently hacked, compromising some customer data.

The home security company did not say when the cyberattack and data breach occurred, but disclosed that the attackers accessed the company’s databases containing customer home addresses, email addresses and phone numbers.

In a brief regulatory filing published late Wednesday, ADT said it has “no reason to believe” that customer home security systems were compromised during the incident, but ADT did not say how it reached that conclusion. The statement said a “small percentage” of customers are affected, but did not provide a more specific number.

As of June 2024, ADT said it had six million customers. 

The disclosure comes a week after a seller on a known cybercrime forum, seen by TechCrunch, claimed in a post on July 31 to have more than 30,000 customer records stolen from ADT. TechCrunch could not immediately verify the authenticity of the claims.

Sarah Bellinger, a spokesperson for ADT via a third-party agency, declined to answer TechCrunch’s questions about the cyberattack and data breach.

ADT is one of the largest home security companies in the United States. It is currently owned by private equity giant Apollo Global Management, which also owns TechCrunch’s parent company, Yahoo.

Home security giant ADT says it was hacked

an ADT sign outside someone's house in Miami, Florida

Image Credits: Joe Raedle / Getty Images

ADT confirmed this week that it was recently hacked, compromising some customer data.

The home security company did not say when the cyberattack and data breach occurred, but disclosed that the attackers accessed the company’s databases containing customer home addresses, email addresses and phone numbers.

In a brief regulatory filing published late Wednesday, ADT said it has “no reason to believe” that customer home security systems were compromised during the incident, but ADT did not say how it reached that conclusion. The statement said a “small percentage” of customers are affected, but did not provide a more specific number.

As of June 2024, ADT said it had six million customers. 

The disclosure comes a week after a seller on a known cybercrime forum, seen by TechCrunch, claimed in a post on July 31 to have more than 30,000 customer records stolen from ADT. TechCrunch could not immediately verify the authenticity of the claims.

Sarah Bellinger, a spokesperson for ADT via a third-party agency, declined to answer TechCrunch’s questions about the cyberattack and data breach.

ADT is one of the largest home security companies in the United States. It is currently owned by private equity giant Apollo Global Management, which also owns TechCrunch’s parent company, Yahoo.

Researchers are training home robots in simulations based on iPhone scans

Image Credits: Screenshot / YouTube

There’s a long list of reasons why you don’t see a lot of non-vacuum robots in the home. At the top of the list is the problem of unstructured and semi-structured environments. No two homes are the same, from layout to lighting to surfaces to humans and pets. Even if a robot can effectively map each home, the spaces are always in flux.

Researchers at MIT CSAIL this week are showcasing a new method for training home robots in simulation. Using an iPhone, someone can scan a part of their home, which can then be uploaded into a simulation.

Simulation has become a bedrock element of robot training in recent decades. It allows robots to try and fail at tasks thousands — or even millions — of times in the same amount of time it would take to do it once in the real world.

The consequences of failing in simulation are also significantly lower than in real life. Imagine for a moment that teaching a robot to put a mug in a dishwasher required it to break 100 real-life mugs in the process.

“Training in the virtual world in simulation is very powerful, because the robot can practice millions and millions of times,” researcher Pulkit Agrawal says in a video tied to the research. “It might have broken a thousand dishes, but it doesn’t matter, because everything was in the virtual world.”

Much like the robots themselves, however, simulation can only go so far when it comes to dynamic environments like the home. Making simulations as accessible as an iPhone scan can dramatically enhance the robot’s adaptability to different environments.

In fact, creating a robust enough database of environments such as these ultimately makes the system more adaptable when something is inevitably out of place, be it moving a piece of furniture or leaving a dish on the kitchen counter.

Researchers are training home robots in simulations based on iPhone scans

Image Credits: Screenshot / YouTube

There’s a long list of reasons why you don’t see a lot of non-vacuum robots in the home. At the top of the list is the problem of unstructured and semi-structured environments. No two homes are the same, from layout to lighting to surfaces to humans and pets. Even if a robot can effectively map each home, the spaces are always in flux.

Researchers at MIT CSAIL this week are showcasing a new method for training home robots in simulation. Using an iPhone, someone can scan a part of their home, which can then be uploaded into a simulation.

Simulation has become a bedrock element of robot training in recent decades. It allows robots to try and fail at tasks thousands — or even millions — of times in the same amount of time it would take to do it once in the real world.

The consequences of failing in simulation are also significantly lower than in real life. Imagine for a moment that teaching a robot to put a mug in a dishwasher required it to break 100 real-life mugs in the process.

“Training in the virtual world in simulation is very powerful, because the robot can practice millions and millions of times,” researcher Pulkit Agrawal says in a video tied to the research. “It might have broken a thousand dishes, but it doesn’t matter, because everything was in the virtual world.”

Much like the robots themselves, however, simulation can only go so far when it comes to dynamic environments like the home. Making simulations as accessible as an iPhone scan can dramatically enhance the robot’s adaptability to different environments.

In fact, creating a robust enough database of environments such as these ultimately makes the system more adaptable when something is inevitably out of place, be it moving a piece of furniture or leaving a dish on the kitchen counter.

Samsung Ballie with a dog

Samsung brings back Ballie, its home robot, at CES 2024 — with a few upgrades

Samsung Ballie with a dog

Image Credits: Samsung

Remember Ballie, Samsung’s spherical home robot from CES 2020? I sure didn’t — until Samsung brought it back at this year’s keynote with a few on-trend AI upgrades.

The new and improved Ballie, which Samsung previewed during its press conference at CES 2024 in Las Vegas today, is around the size of a bowling ball, packing a battery that’s designed to last two to three hours. Ballie sports a spatial lidar sensor to help it navigate rooms and obstacles, as well as a 1080p projector with two lenses that allows the robot to project movies and video calls and even act as a second PC monitor.

“Use [Ballie] to project images and stream content on walls, and it can automatically adjust the picture based on the wall distance and lighting conditions,” Samsung writes in press release. “It [can] automatically detect people’s posture and facial angle and adjust the optimal projection angle for you.”

Samsung Ballie
Ballie can project content onto a wall or other surface, adjusting the angle of the picture as needed. Image Credits: Samsung

Ballie can be controlled with voice commands or, intriguingly, requests sent via text message (e.g. “play a movie on the nearest wall”). In the latter case, Ballie will respond with the aid of a chatbot to confirm requests before taking action.

Like other home robots in its class, Ballie can automatically turn on smart lights and, thanks to a built-in infrared transmitter, “non-smart” devices like air conditioners and older TVs. And the robot can map a floor plan, identifying where smart devices might be located inside a home.

Samsung’s promising a lot beyond these basics, like automatic reminders to water plants around the house, access to remote medical services (for older household members) and personalization depending on who the robot senses nearby. “With its built-in front [and] rear camera, [Ballie] can detect and analyze its surroundings and learn recurring user patterns,” Samsung continues in the press release.

But the details of these — as with Ballie’s availability and pricing — have yet to be firmed up.

The question is, will any of these features compel homeowners to buy Ballie when — or if, rather — it reaches market? Home robots have never been a slam-dunk, as recently demonstrated by Amazon’s attempt. Another promising attempt within the last few years, Mayfield Robotics, which hoped to sell a home robot in partnership with Bosch, ceased operations before shipping a single unit to early customers.

Perhaps Samsung will fare better. We’ll have to wait and see.

Read more about CES 2024 on TechCrunch

A logo sits illuminated outside the Samsung pavilion on the opening day of the World Mobile Congress

Samsung's new smart home features include household maps with 'AI characters'

A logo sits illuminated outside the Samsung pavilion on the opening day of the World Mobile Congress

Image Credits: David Ramos / Getty Images

Samsung wants to make the smart home smarter — if your home’s a Samsung home, that is.

During its CES 2024 keynote in Las Vegas tonight, the company announced a range of additions to — and capabilities for — its SmartThings home automation platform. A new dashboard screen, Now Plus, is headed to select Samsung TVs, programmed to turn on as you approach to display info about smart home devices and stats like the current indoor temperature. Accompanying it is a new “quick panel” with access to shortcuts for controlling connected devices, as well as functions like finding misplaced smartphones and other mobile gadgets.

Samsung SmartThings
Image Credits: Samsung

Elsewhere, Samsung launched a new “map view” for SmartThings similar to Amazon’s recently launched Map View. Samsung’s take shows an interactive map of your home complete with the location of any smart home devices (e.g. washing machines, refrigerators and so on) within. Maps can be created manually or automatically with the help of a photo of an existing floor plan or with a lidar-enabled Samsung device, like the company’s forthcoming Ballie robot or new JetBot robot vacuum.

In a cute (or creepy, depending on your point of view) touch, the new SmartThings maps show “AI characters” that stand in for family members and pets inside the home. The animated avatars “respond” to real-time conditions, for example appearing to sweat if the house gets too warm.

Samsung SmartThings
Image Credits: Samsung

Maps have to be generated using the SmartThings app on a smartphone or tablet. But once that’s done, they’ll display on supported Samsung TVs, the screen of the Samsung Family Hub smart fridge and Samsung’s M8 monitors.

Read more about CES 2024 on TechCrunch

Serenity takes a full-home radar approach to fall detection

Image Credits: Haje Kamps (opens in a new window) / TechCrunch (opens in a new window)

Serenity, the result of a fruitful partnership with Alarm.com, is an innovative fall-detection system that does away with traditional wearables. It is showing off its product for the first time at CES in Las Vegas.

“You just plug it in, and it blends into your life. There’s no need for apps or complicated configurations,” explains Sumit Nagpal, CEO and founder at Cherish Health. “Utilizing advanced radar technology and AI, Serenity can track up to two individuals, such as ‘mom and dad,’ within a 40-foot range through walls, offering detailed information about their activities without compromising privacy.”

Founded on January 2, 2020, Cherish navigated the tumultuous waters of the COVID-19 pandemic to emerge with a product that may just prove to save lives.

What sets Serenity apart is its ability to construct a 13-point skeleton model of individuals in near-real-time, using radar data processed by AI on the device. This model helps distinguish between intentional lying down and falls, including slow falls that traditional accelerometers fail to detect. “It’s about understanding the context and sequence of movements,” Nagpal says, emphasizing the system’s precision.

The cool thing is that it means there are no cameras or intrusive devices: People can go about their lives as usual, without feeling monitored or tracked, and without needing to remember to wear a wearable to keep themselves safe.

The company showed off its functionality in a video:

In an emergency, Serenity raises an alarm to a designated care circle or a 24/7 monitoring service. But its capabilities don’t stop at fall detection. Nagpal claims that Serenity can also monitor resting heart rate (!) and respiration (!!) from a distance, without any wearable device — a feature that has far-reaching implications for home healthcare.

The company has also envisioned broader applications for its patented technology, including public safety measures like concealed weapon detection in public spaces and health monitoring in vehicles, potentially saving lives in emergencies like strokes.

As for the manufacturing and distribution, Cherish has localized its operations.

“We’ve got manufacturing in New Hampshire and PCB manufacturing in Santa Clara,” Nagpal says, noting the efficiency of local production compared to overseas. The company says it is negotiating an order of half a million units, indicating a significant market interest.

At $300 plus $39 per month subscription, it’s a relatively pricy solution — but Nagpal says it is priced “competitively in the same range as a smart speaker with a help button.”

The device is designed to blend into the home and doubles as a two-way speaker and music player.

We started in the chaos of a global pandemic, but we’ve turned these challenges into opportunities for innovation,” Nagpal reflects on Cherish’s journey and its potential impact. “Serenity isn’t just a product; it’s a promise of independence, safety and peace of mind for our aging population.”

Read more about CES 2024 on TechCrunch

Samsung Ballie with a dog

Samsung brings back Ballie, its home robot, at CES 2024 — with a few upgrades

Samsung Ballie with a dog

Image Credits: Samsung

Remember Ballie, Samsung’s spherical home robot from CES 2020? I sure didn’t — until Samsung brought it back at this year’s keynote with a few on-trend AI upgrades.

The new and improved Ballie, which Samsung previewed during its press conference at CES 2024 in Las Vegas today, is around the size of a bowling ball, packing a battery that’s designed to last two to three hours. Ballie sports a spatial lidar sensor to help it navigate rooms and obstacles, as well as a 1080p projector with two lenses that allows the robot to project movies and video calls and even act as a second PC monitor.

“Use [Ballie] to project images and stream content on walls, and it can automatically adjust the picture based on the wall distance and lighting conditions,” Samsung writes in press release. “It [can] automatically detect people’s posture and facial angle and adjust the optimal projection angle for you.”

Samsung Ballie
Ballie can project content onto a wall or other surface, adjusting the angle of the picture as needed. Image Credits: Samsung

Ballie can be controlled with voice commands or, intriguingly, requests sent via text message (e.g. “play a movie on the nearest wall”). In the latter case, Ballie will respond with the aid of a chatbot to confirm requests before taking action.

Like other home robots in its class, Ballie can automatically turn on smart lights and, thanks to a built-in infrared transmitter, “non-smart” devices like air conditioners and older TVs. And the robot can map a floor plan, identifying where smart devices might be located inside a home.

Samsung’s promising a lot beyond these basics, like automatic reminders to water plants around the house, access to remote medical services (for older household members) and personalization depending on who the robot senses nearby. “With its built-in front [and] rear camera, [Ballie] can detect and analyze its surroundings and learn recurring user patterns,” Samsung continues in the press release.

But the details of these — as with Ballie’s availability and pricing — have yet to be firmed up.

The question is, will any of these features compel homeowners to buy Ballie when — or if, rather — it reaches market? Home robots have never been a slam-dunk, as recently demonstrated by Amazon’s attempt. Another promising attempt within the last few years, Mayfield Robotics, which hoped to sell a home robot in partnership with Bosch, ceased operations before shipping a single unit to early customers.

Perhaps Samsung will fare better. We’ll have to wait and see.

Read more about CES 2024 on TechCrunch

A logo sits illuminated outside the Samsung pavilion on the opening day of the World Mobile Congress

Samsung's new smart home features include household maps with 'AI characters'

A logo sits illuminated outside the Samsung pavilion on the opening day of the World Mobile Congress

Image Credits: David Ramos / Getty Images

Samsung wants to make the smart home smarter — if your home’s a Samsung home, that is.

During its CES 2024 keynote in Las Vegas tonight, the company announced a range of additions to — and capabilities for — its SmartThings home automation platform. A new dashboard screen, Now Plus, is headed to select Samsung TVs, programmed to turn on as you approach to display info about smart home devices and stats like the current indoor temperature. Accompanying it is a new “quick panel” with access to shortcuts for controlling connected devices, as well as functions like finding misplaced smartphones and other mobile gadgets.

Samsung SmartThings
Image Credits: Samsung

Elsewhere, Samsung launched a new “map view” for SmartThings similar to Amazon’s recently launched Map View. Samsung’s take shows an interactive map of your home complete with the location of any smart home devices (e.g. washing machines, refrigerators and so on) within. Maps can be created manually or automatically with the help of a photo of an existing floor plan or with a lidar-enabled Samsung device, like the company’s forthcoming Ballie robot or new JetBot robot vacuum.

In a cute (or creepy, depending on your point of view) touch, the new SmartThings maps show “AI characters” that stand in for family members and pets inside the home. The animated avatars “respond” to real-time conditions, for example appearing to sweat if the house gets too warm.

Samsung SmartThings
Image Credits: Samsung

Maps have to be generated using the SmartThings app on a smartphone or tablet. But once that’s done, they’ll display on supported Samsung TVs, the screen of the Samsung Family Hub smart fridge and Samsung’s M8 monitors.

Read more about CES 2024 on TechCrunch