Hi knolbl. There is a lot to see in South Africa, and it is a very beautiful country. The experience one has as a tourist is different from living in the country as a citizen, which is true anywhere. Some areas see more crime and poverty than others, and it's hard to paint the entire country with one brush.
Cape Town is breathtaking, and if you take reasonable precautions to stay safe, it can still be a great holiday spot, imo. My family has spent a lot of time touring the country, and we'd be happy to recommend some great holiday spots and attractions in the Cape. The animals are AMAZING, and the national parks and landscapes you'll find in SA are among the most beautiful on Earth. There are lots of great people, and most people are very obliging if you express interest in their culture.
Keep in mind that the crime is very high along with poverty across the country, unfortunately, and you do need to be more aware of your surroundings. Understand, too, that people who have been victims of violent crime are not likely to give the country glowing reviews, and that can be why you'll find varying opinions on the state of the nation. With politics and economic policies...there is polarization regarding the best way forward and the direction that the country is taking, and you'll find both pessimism and optimism on the topic.
There is a lot of revisionist history floating around when it comes to SA, which is unfortunate. You will find people from outside the country who have strong opinions on topics without really understanding the country or its history. If you would like to better understand the country as a whole, it's a good idea to speak with lots of different people, and with lots of different backgrounds and cultural groups. Also, refer to primary sources of information when you can (original newspaper articles, court documents, historical reports, photos, etc). It can be eye opening.