"As much as we can blame individual mistakes I'm ultimately the manager, I pick the team, I brought some of the players in," he told BBC Radio Suffolk.
"We can't keep making these excuses and there will be a point where we say 'enough is enough'."
Town's slump has seen them go from early season play-off contenders to four points above the Championship relegation zone.
And Keane, whose contract is up in the summer, has come under increasing pressure from supporters to turn around his side's fortunes.
Your analysis of a man's potential rests solely on each result in the most topsy-turvy division this league has ever produced
SuperWazzaBlue
"Eight defeats out of 10 is unacceptable for a top club like Ipswich," he said.
"It doesn't matter if I have a week or 10 years left on my contract, I do look at my position every day.
"I thought the performance was pretty decent, so the word I'm going to use is frustrating more than anyone else."
Ipswich have been in freefall since early October, when a 2-1 home win over Leeds put them fifth in the table, but just six points from a possible 30 available has dragged them down to 17th and, according to Keane, a potential relegation battle.
"We're being sucked in," he said. "I still think I saw enough in the performance [against Swansea] and the attitude to think we're a decent team.
"It's no good me saying that when we keep losing matches.
"As the manager I take responsibility for it, but obviously we lost David Norris with a virus, Darren O'Dea's gone off with a hamstring, there was the penalty decision.
"Whatever decisions are going they're certainly not going our way but I'm one to say you've got to make your own luck."
The club will assess the hamstring injury picked up by on-loan Celtic defender O'Dea this week.
Source: BBC Sport
Source: BBC Sport