top of page

AI-powered fridges that recognize food with image recognition

Use case

Another use case of REBECCA involves an AI-powered fridge developed by Arcelik. In this scenario, the fridge is equipped with two cameras: one mounted on the door, capturing the interior, and the other inside the body, capturing the door. When the door is opened, these cameras are triggered to capture multiple image frames until the door is closed again. Among these frames, the best ones, which provide optimal visibility of the fridge interior, are selected using a TOF sensor that measures the distance between the door and the body. The selected pairs of images are then transferred to the cloud for image processing and analysis, after which they are sent to the related users' Arcelik-specific mobile application (HomeWhiz™) for remote monitoring of the fridge interior.

In the current cloud-based architecture of this use case, all image processing algorithms and AI-based computer vision models, including object recognition, human detection, distortion removal, and cropping algorithms, run on the cloud platform. The object recognition model identifies and localizes 33 different objects, such as eggs, milk, water, apples, and more, creating an inventory list. The human detection model checks if there is a human in an image, which may occur unintentionally, and deletes such images if any are found due to privacy reasons. As part of the REBECCA project, edge versions of these AI models are being developed. These edge versions will initially be deployed, executed and evaluated on REBECCA emulators and eventually User interface of the HomeWhiz™ mobile application integrated into REBECCA chips.

As part of the REBECCA project, edge versions of these AI models are being developed. These edge versions will initially be deployed, executed and evaluated on REBECCA emulators and eventually User interface of the HomeWhiz™ mobile application integrated into REBECCA chips.

www.arcelik.com.tr

ACKNOWLEDGMENT: REBECCA project is supported by the Chips Joint Undertaking and its members, including the top-up funding by National Authorities under grant agreement n° 101097224. Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the granting authority. Neither the European Union nor the granting authority can be held responsible for them.
EN_Co-fundedbytheEU_RGB_WHITE.png
chips_white.png
Logo_white.png
  • X
  • LinkedIn
  • Youtube
bottom of page