Cahill completed his £7million move to Stamford Bridge on Monday marking the end of a protracted transfer saga that was reportedly held up when Chelsea balked at his wage demands.
But the 26-year-old England defender insists his desire to join the Blues was founded on footballing reasons alone, and said: "It's disappointing when you see things in the press. You bite your lip because I didn't read one report that was correct. It was upsetting, but my family and the clubs knew the real situation."
He added: "It was really hard (to accept the perception I was greedy) because that's the perception I got.
"It was difficult to read some of the stories. If it was about wages, I would have waited until the end of the season to make the move.
"But I want to play football at a high level and would never turn down the opportunity to join Chelsea."
Cahill explains the reason for the delay in his transfer - the move was not finalised until three two weeks after a fee had been agreed between Bolton and Chelsea - was simply down to timing.
"The fee was announced really early because it had been agreed so early," he said. "I'd had no dialogue with Chelsea, but it had come out in the press that a fee had been agreed.
"It took four or five days from that point before we even sat down to speak about the move.
"It took a couple of weeks before I had a meeting to speak with the manager. Two days after that I signed."