South Africa had failed to advance from the group stage in their first three World Cup appearances in 1998, 2002 and 2010.