⭕Region-Based CNNs

Region Based Convolutional Neural Network

🔷 R-CNN (Region Based Convoltional Neural Network)

It depends on:

1. Selecting huge number of regions

2. And then decreasing them to 2000 by selective search

   • Each region is called a region proposal

3. Extracting convolutional features from each region

4. Finally checking if any object exists

🤔 What is Selective Search?

An algorithm to to identify different regions, There are basically four regions that form an object: varying scales, colors, textures, and enclosure. Selective search identifies these patterns in the image and based on that, proposes various regions

🙄 In other words: It is an algorithm that depends on computing hierarchical grouping of similar regions and proposes various regions

👀 Visualization

🙄 Disadvantages

• It takes too many time to be trained.

• It can not be impelemented real time.

• The selective search algorithm is a fixed algorithm. Therefore, no learning is happening at that stage.

  • This could lead to the generation of bad candidate region proposals.

🤔 Why are they slow?

R-CNNs are very slow 🐢 beacause of:

• Extracting 2,000 regions for each image based on selective search

• Extracting features using CNN for every image region.

  • If we have N images, then the number of CNN features will be N*2000 😢

💫 Fast R-CNN (Fast Region Based Convoltional Neural Networks)

Instead of running a CNN 2,000 times per image, we can run it just once per image and get all the regions of interest (regions containing some object).

So, it depends on:

1. We feed the whole image to the CNN

2. The CNN generates a feature map

3. Using the generated feature map we extract ROI (Region of interests)

   • Problem of 2000 regions is solved 🎉

   • We are still using selective search 🙄

4. Then, we resize the regions into a fixed size (using ROI pooling layer)

5. Finally, we feed regions to fully connected layer (to classify)

👀 Visualiztion

🙄 Disadvantages

Region proposals still bottlenecks in Fast R-CNN algorithm and they affect its performance.

➰ Faster R-CNN (Fast Region Based Convoltional Neural Networks)

Faster R-CNN fixes the problem of selective search by replacing it with Region Proposal Network (RPN) 🤗

So, it depends on:

1. We feed the whole image to the CNN

2. The CNN generates a feature map

3. We apply Region proposal network on feature map

4. The RPN returns the object proposals along with their objectness score

   • Problem of selective search is solved 🎉

5. Then, we resize the regions into a fixed size (using ROI pooling layer)

6. Finally, we feed regions to fully connected layer (to classify)

👀 Visualization

👩‍🏫 How does RPN work?

1. RPN takes a feature map from CNN

2. Uses 3*3 window over the map

3. Generates k anchor boxes

   • Boxes are in different shapes and sizes

Anchor boxes are fixed sized boundary boxes that are placed throughout the image and have different shapes and sizes. For each anchor, RPN predicts two things:

1. The probability that an anchor is an object

   • (it does not consider which class the object belongs to)

2. The bounding box regressor for adjusting the anchors to better fit the object

👀 Visualization

😵 To put them all together

Algorithm	Summary	Limitations
🔷 R-CNN	Extracts around 2000 regions from images using selective search	High computation time
💫 Fast R-CNN	Image is passed once to CNN to extract feature maps, regions are extracted by selective search then	Selective search is slow
➰ Faster R-CNN	Replaces the selective search method with RPN	slow (?)

🤹‍♀️ Benchmarks

🔎 Read More

• A Step-by-Step Introduction to the Basic Object Detection Algorithms

• Deep Learning for Object Detection: A Comprehensive Review