Three Elements That Sum To Zero
by Nathan LeClaire
There's an interview question (for developers) that recently I've been asking (if they have already proven they can FizzBuzz) which goes a little something like this:
Given a collection of integers, return the indices of any three elements which sum to zero. For instance, if you are given{1, 6, 8, 9, 10, 100, 78, 0, 1}
, you could return{0, 7, 8}
because1 + 1 + 0 == 0
. You can't use the same index twice, and if there is no match you should return{1, 1, 1}
.
I first heard this question in an interview with a San Franciscobased startup, and it has since become sort of a workhorse interview question around the office. As it turns out, this question has the potential to nerd snipe developers pretty effectively. I know, because I coded up the naive solution first before deciding that it wasn't good enough, and that I wanted to write it a faster way. Combining this with my recent revival of interest in C++ (I learned it long ago but have been mostly working with scripting languages lately) proved to be an interesting experience. This is the story of one man (me), and his quest to write code to efficiently solve this problem. In my solutions I use the std::vector
class, as I also used this as an opportunity to refresh some STL knowledge, but in the article I use the words "array" and "vector" interchangably (these solutions could also be implemented with arrays, there is nothing special about using vectors in this case).
Solving Things Naively
The obvious way to do this is with brute force. Starting with the zeroeth, first, and second elements of the collection, compare every possible combination of three elements to see if they sum to zero. Sample code (using namespace std;
is implied):
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 

three_vec
is a utility method that I use to return a vector of three integers:
1 2 3 4 5 6 

This is the obvious way to do the problem at first glance, and it has the advantage of simplicity and readability (a competent developer looking at the code should be able to figure it out fairly quickly). However, as noted in the comments for the function defined, it runs with a time complexity of O(n^{3}). Can we do better?
Solving Things Suavely
Of course we can, or else I wouldn't be writing this article! Reaching into our algorithmic bag of tricks, we begin to ask ourselves: Is there anything we can do to this otherwise unordered vector of integers that would make it easier for us to get what we're after?
"Hm," you say to yourself. "We could trying sorting it. This will run in O(n log n) time but it will allow us to find what we are looking for much more quickly." But wait sorting the vector will change the place of the elements, and consequently their index, which is what we are after. Therefore, we must rely on an additional (simple) data structure if we are going to take this approach:
1 2 3 4 

Now we can make a new array and sort that based on index_value_pair
's value
element:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 

Then, we can work our way forwards from the beginning of the array starting with the zeroeth and first elements (let's call them the i
th and j
th), and backwards from the end of the array with the third (the k
th). i
will go to n2
and start off an inner loop where j = i + 1
. In the inner loop, if the sum of the elements is positive, we decrement k
because we need a smaller sum (closer to zero). If the sum of the elements is negative, we increment j
because we need a larger sum (also closer to zero). If the elements sum to zero, great! We have our match. If j
and k
meet, we go on to the next loop. This process shaves a whole multiple of n
comparisons off our algorithm's runtime and allows us to do things in O(n^{2}) time.
You can intuitively grasp why this is faster by asking yourself how many comparisons it would take to find the elements that sum to zero with this array (sorted) and this algorithm:
1


versus this one (same elements, different order) with brute force:
1


Therefore the whole function looks like this and runs with O(n log n + n^{2}) time complexity including the sort. O(n ^{2}) is asymptotically larger than O(n log n), so this time complexity resolves to O(n ^{2}) (editor's note: thanks to Reddit user Olathe for pointing this out). This should outperform the O(n^{3}) algorithm in most cases:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 

Interestingly, with the first few benchmarks I ran, the naive version was outperforming the efficient version, and I couldn't quite figure out why (the first command line argument indicates how many random elements to generate in our test array in other words, N
).
1 2 3 4 5 6 7 8 9 10 

How could this be? My carefully crafted algorithm was getting stomped by an algorithm I knew to be inferior. After generating and poking around at a few callgrind files attempting to track down the issue, I suddenly realized that it was right in front of my eyes, in two constant definitions I had made and forgotten about early on:
1 2 

These settings were used to specify the range of the pseudorandom integers I was using to test the algorithms with, and when they were so close together the naive algorithm was outperforming the "suave" one because the additional overhead of sorting was so costly.
What if we change the bounds to be {10000000, 10000000}
?
1 2 3 4 5 6 7 8 9 

Much closer to what we expect! For smaller values of N, and upper/lower bounds that are closer together, the naive version seems to perform better. As the range and value of N gets larger, the "suave" algorithm begins to get more appealing. I'd be curious to see a more rigorous numerical analysis of why this is.
Check out the code on github if you're so inclined. Cheers, and I'll see you next week!
EDIT : Based on some feedback from Reddit I have revised a few things, notably:
 There was a bug in the implementation of
three_vec
that caused the returned value to be the same for suave and naive versions (fixed in 794993e01b1e0fa6154c722c4d74009b02cdef45 )  Constant definition is now done with
static const
instead of#define
statements