You are right. The smells came from coffee. And yes, Hills Brothers was down south of the Ferry Building. I used to accompany my Dad to the Ferry Building to collect his longshoreman's paycheck. That was the time when there was a tunnel running in front of the Ferry Building. But, the smell of coffee permeated the entire neighborhood.