Good question. Perhaps they are. Such as the alleged encounter with Eisenhower after the formation of saucers flew over Wash DC, but let's just take that as heresay. Or we are in galactic quarantine, too hostile or something. As for Fermi's question, its arrogant and obtuse in the sense of developmental importance. Much like is a 5 year old really aware of the bigger world picture, were you aware?

Under Werner Von Braun ~Nazi rocket scientist and NASA director~ proved we could go to Mars. And that was before our computer tech input of today. Consider the technology of going to the moon. The voyage now to Mars is less time than when men went on sailing ships across oceans, and certainly submariners have stayed under the ocean surface longer as well.

Earthlings will never "get to the stars" regardless. Inter-stellar travel is impossible.
Travel at "light speed" (which is about 186 thousand miles per second) it would take about 4 years and 3 months to reach our nearest neighboring star Proxima Centauri.

Even if "warp speed" were possible (it isn't) it would take millions of years to reach the andromeda galaxy - our nearest galaxy neighbor.
Andromeda is 4.25 MILLION LIGHT YEARS distant from Earth.

@iThink

Sure, can't argue with that but it's kind of a figure of speech.

Some people are wondering what is it with the Yin and Yang nonsense?  It's in the pictures of the original post.  Cars and dolls.

Experiments have shown that female toddlers and monkeys if offered dolls or cars they will almost always pick the dolls and the males will pick cars.

We are for the most part unconscious of our instinctual drives.  It's pretty easy to pretend they don't exist.  At the individual level it's fairly hard to see how they play out.  At the group level it's a lot clearer.  In Sweden after decades of gender engineering to push females out of traditional roles they still dominate people jobs such as medicine and males thing jobs such as engineering.  You can apply this to the course of society in a wider scope.

Before there were physical computers there was a job called computer.  It's function was to solve mathematical problems.  It turned out that women were particularly good at this job.  The key being attention to detail and low error rates.  It unironically reflects a biological reality.  Females are less susceptible  to mutational load than males.  That means less instinctual variation.  It's important because females need to be unable to avoid the needs of infants.  They have to be sufficiently neurotic to not abandon an infant to see what is on the other side of the hill.   The instinct to work has to cause pain and be as reliable as possible.  Males on the other hand have the opposite instinct they have to randomly see what is on the other side of the hill.

Scott Adams likes to talk about the simulation.  The simulation is just the algorithm built into reality.  The simulation is just shorthand for determinism.  What many people miss is that the entire simulation is based on random events.  The simulation starts with some instability in reality called the big bang.  From there randomness continues to drive the evolution of everything from  increasingly complex atoms to increasingly complex organisms. 

Genius is the ability to randomly generate errors and sort through them with intelligence.  It defies stability, settledness. The blind clockmaker "designs" for reproductive fidelity.  Every once in a while something breaks, there is mutation and the blind clockmaker has to select what to keep and what to throw away.  As it applies to our topic the concept is reflected in Stephan Wolfram's new kind of science, not explicitly but it's there. 

What do little boys like to do?  They like to break things, blow them up.  It's an essential part of progress.  The female instinct like their biology likes security, cessation, non movement, reproductive fidelity, a safe space.
 
We like to think that our instincts are moral.  But the blind clockmaker is completely amoral.  Morality is not real.  It is a social construct.  Instincts are real.  Morality is "unnatural". 

Morality breaks our instincts.  It replaces individual security with group security.  In the civilized state it creates an artificial eusociality.  The individual's fitness is sacrificed for the interest of civilization.  Individuals are no longer infants to be cared for but creatures with agency, freewill, responsibility.  Morality is one of those mutations that has proven it's fitness that broke the reproductive fidelity of instincts.  It drives innovation because we are no longer chained to what our instincts tell us is right.  It makes us take risks we otherwise would not.  We are rewarded for being productive, a concept alien to the blind clockmaker, the blind clock maker just wants to make more clocks like the last one, the safe thing to do.