I think that life will be relatively common, but intelligent, technological life is rare. Also, space is really big. An intelligent race could be 500LY from us, and they wouldn't even have noticed us yet, if they are of comparable Tech. Light speed is a nasty limiter in this.