How to paint on walls in Camera View android?

user_1910113 0
Viewed 2022

I am trying to paint a wall in my Camera View. Can Anyone tell me where should I start, Any library or something helpful that can point me in right direction.

I know its a difficult thing to do but I need some direction to continue my work. Currently I have only tried with VuForia but I don't know how we can use it with Wall recognizing and paint on walls on Augmented Reality.

Below is the required result:

enter image description here

enter image description here

vuforia glsurfaceview android-camera surfaceview android
1 Answers

As you say answering your question is not easy because there are multiple solutions to achieve what you want.

I think you should read about Object Detection especially about Convolutional Neural Nets (CNN). Good libs for the detection task are probably OpenCV and Googles Tensorflow. Also samples in Googles Mobile Vision API can show you how to have a live feed from the camera and manage overlaying it with your paintings. This example I personally found very helpful to see where/how to implement a detector as well as a graphic overlay even if its for Text Recognition. Finally here you have the Android Tensorflow demos.

But as easy as it seems it's still a long way to go. For this kind of implementation with Tensorflow you need to...

  1. Collect sample images with walls and what is not a wall ;)
  2. Think about preprocessing e.g. rescale, grayscale and filter and implement it
  3. Write and tune your Python code for your CNN model
  4. Train and evaluate your model with Python
  5. Port your model to Android
  6. Paint on the appropriate area

Another approach I can think of would be with Edge Detection and Hough Line Transform but I suggest you to use Neural Nets because results are probably better, Tensorflow (Mobile or Lite) is already optimized for Android and it's cutting edge tech ;)

Hope this helps!

user_70896300
Related