Dtyjlui

Given an R x C grid of 1s and 0s (or True and False values), I need a function that can find the size of the largest connected component of 1s. For example, for the following grid,

grid = [[0, 1, 0, 1],

        [1, 1, 1, 0],

        [0, 1, 0, 0],

        [0, 0, 0, 1]]

The answer is 5.

Here is my implementation:

def largest_connected_component(nrows, ncols, grid):

    """Find largest connected component of 1s on a grid."""



    def traverse_component(i, j):

        """Returns no. of unseen elements connected to (i,j)."""

        seen[i][j] = True

        result = 1



        # Check all four neighbours

        if i > 0 and grid[i-1][j] and not seen[i-1][j]:

            result += traverse_component(i-1, j)

        if j > 0 and grid[i][j-1] and not seen[i][j-1]:

            result += traverse_component(i, j-1)

        if i < len(grid)-1 and grid[i+1][j] and not seen[i+1][j]:

            result += traverse_component(i+1, j)

        if j < len(grid[0])-1 and grid[i][j+1] and not seen[i][j+1]:

            result += traverse_component(i, j+1)

        return result



    seen = [[False] * ncols for _ in range(nrows)]



    # Tracks size of largest connected component found

    component_size = 0



    for i in range(nrows):

        for j in range(ncols):

            if grid[i][j] and not seen[i][j]:

                temp = traverse_component(i, j)

                if temp > component_size:

                    component_size = temp



    return component_size

Feel free to use the following code to generate random grids to test the function,

from random import randint



N = 20

grid = [[randint(0,1) for _ in range(N)] for _ in range(N)]

Problem: My implementation runs too slow (by about a factor of 3). Since I wrote this as a naive approach by myself, I am guessing there are clever optimizations that can be made.

Context: This is for solving the Gridception problem from Round 2 of Google Codejam 2018. My goal is to solve the problem in Python 3. As a result, there is a hard constraint of using only the Python 3 standard library.

I have figured out that this particular portion of the full solution is my performance bottleneck and thus, my solution fails to clear the Large Input due to being too slow.

Thank you so much!

Edit: Adding some timeit benchmarks

For a randomly generated 20 x 20 grid, my implementation takes 219 +/- 41 μs (a grid of 0s takes 30 μs, and a grid of 1s takes 380 μs).

In programming challenges, proper performances improvement usually come from a smarter algorithm. Unfortunately, I have no algorithm better than the one you have implemented.

I have found a single trick to shave off some time.

Remove all the logic around seen

In all places where you access elements from grid and seen, we have basically: if grid[pos] and not seen[pos].

An idea could be to update grid in place to remove seen elements from it. From an engineering point of view, it is not very nice: I would not expect an function computing the size of the biggest connected components to update the provided input. For a programming challenge, we can probably accept such a thing...

We'd get:

def largest_connected_component(nrows, ncols, grid):

    """Find largest connected component of 1s on a grid."""



    def traverse_component(i, j):

        """Returns no. of unseen elements connected to (i,j)."""

        grid[i][j] = False

        result = 1



        # Check all four neighbours

        if i > 0 and grid[i-1][j]:

            result += traverse_component(i-1, j)

        if j > 0 and grid[i][j-1]:

            result += traverse_component(i, j-1)

        if i < len(grid)-1 and grid[i+1][j]:

            result += traverse_component(i+1, j)

        if j < len(grid[0])-1 and grid[i][j+1]:

            result += traverse_component(i, j+1)

        return result



    # Tracks size of largest connected component found

    component_size = 0



    for i in range(nrows):

        for j in range(ncols):

            if grid[i][j]:

                temp = traverse_component(i, j)

                if temp > component_size:

                    component_size = temp



    return component_size

Another idea in order to do the same type of things without changing grid could be to store "positive" elements in a set. This also remove the need to check for edge cases of the grid. The great thing is that we can populate that set with less array accesses. This is still pretty hackish:

def largest_connected_component(nrows, ncols, grid):

    """Find largest connected component of 1s on a grid."""



    def traverse_component(pos):

        """Returns no. of unseen elements connected to (i,j)."""

        elements.remove(pos)

        i, j = pos

        result = 1



        # Check all four neighbours

        for new_pos in [(i-1, j), (i+1, j), (i, j-1), (i, j+1)]:

            if new_pos in elements:

                result += traverse_component(new_pos)

        return result



    # Tracks size of largest connected component found

    elements = set()



    for i, line in enumerate(grid):

        for j, cell in enumerate(line):

            if cell:

                elements.add((i, j))



    return max(traverse_component(pos) for pos in set(elements) if pos in elements)

Edit: rewriting the solution to avoid the copy of elements, we have a slightly faster solution:

def largest_connected_component(nrows, ncols, grid):

    """Find largest connected component of 1s on a grid."""



    def traverse_component(pos):

        """Returns no. of unseen elements connected to (i,j)."""

        i, j = pos

        result = 1



        # Check all four neighbours

        for new_pos in [(i-1, j), (i+1, j), (i, j-1), (i, j+1)]:

            if new_pos in elements:

                elements.remove(new_pos)

                result += traverse_component(new_pos)

        return result



    # Tracks size of largest connected component found

    elements = set((i, j) for i, line in enumerate(grid) for j, cell in enumerate(line) if cell)

    largest = 0

    while elements:

        pos = elements.pop()

        largest = max(largest, traverse_component(pos))

    return largest

Are you absolutely sure this is the bottleneck? Looking at the linked problem and the solution analysis, I'm not sure if this component is even needed to solve the given problem. It's possible your overall algorithm is inefficient in some way, but obviously I couldn't really tell unless I saw the whole program that this is part of.

@Josay's already given a good improvement, but in the grand scheme of things, this doesn't really shave off that much measurable time for larger grids. The original solution was a pretty good algorithm for solving the problem of largest connected subsections.

General comments

Having three lines here is unnecessary:

temp = traverse_component(i, j)

if temp > component_size:

    component_size = temp

because of one nice Python built-in, max:

component_size = max(component_size, traverse_component(i,j))

component_size could be named more descriptively as largest_size.