Extract and solve sudoku from an image using Computer Vision and Deep Learning

aakashjhawar aakashjhawar Last update: Aug 05, 2022

forthebadge

SolveSudoku

SolveSudoku extract and solve sudoku from image. It uses a collection of image processing techniques and Convolution Neural Network for training and recognition of characters.CNN is trained on MNIST dataset to detect digits.

Blog

Checkout the articles on SolveSudoku on Medium.com

Sudoku Solver using OpenCV and DL — Part 1

Sudoku Solver using OpenCV and DL — Part 2

Getting Started

How to use

git clone https://github.com/aakashjhawar/SolveSudoku.gitcd SolveSudokupython3 sudoku.py <path/to/input_image>

Prerequisites

  • Python 3.5
  • OpenCV
sudo apt-get install python-opencv

Procedure

  1. Image preprocessing (Thresholding).
  2. Find the largest contour (sudoku square).
  3. Get the cordinates of largest contour.
  4. Crop the image.
  5. Perform Warp perspective on image
  6. Extract each cells from the image by slicing the sudoku grid.
  7. Extract the largest component in the sudoku image (number).
  8. Remove noise in block.
  9. Send the number to pre trained Digit Recogition model.
  10. Send the grid to Sudoku Solver to perform the final step.

Working

Input image of Sudoku-

Input image of sudoku

Image of Sudoku after thresholding-

Threshold image of sudoku

Contour corners of Sudoku-

Contour of sudoku

Warp Image-

Warp of sudoku

Final output of ExtractSudoku-

Final image of sudoku

Extracted grid-

extracted grid

Solved grid-

Solved grid

Subscribe to our newsletter