Can a self-driving car which is becoming reality (taxi's) be aware of danger for you and take you out of an immediate area of risk. I mean plan for worst and hope for best here. But say there is a building on fire at the address I'm going I don't want the car taking me to the front door. Just one example of an infinite number of dangerous places I don't want my car to take me. Not against the technology could use more free time just thinking. Will we always need some sort of control wheel or joystick?
As long as unexpected events can take place, you can't expect the Tesla to react properly in all cases. If the Tesla can't do a temperature measurement how would it know there's a fire in front of it? In one of the first deadly accidents the Tesla identified a truck as a "sign" and plowed into it. That's because the ride of the truck was higher than expected. That's the key word - "expected". And how are drivers to know what the Tesla is expecting or not expecting? I think we are way too early into AI development to allow it to control things that can kill us without complete human supervision. Understanding the fatal Tesla accident on Autopilot and the NHTSA probe [electrek.co]
A backup plan such as taking control of the wheel/system override wouldn't be a bad idea. The information centers in vehicles might be more advanced in the future, information on destination updated in real time.
The problem is that if you are driving you are more aware of your surroundings. If you are disengaged from controlling the car your reaction time is going to be delayed.